syncronization issues

[schlichtanders]

I am using parcel to build javascript into a frontend-dist directory.

The routine will first delete the folder and then recreate it with all new files.
Somehow kubycat is not able to correctly syncronize the files respectively (this frontend-dist directory is listed under the yaml key from:)

When restarting kubycat (sync-on-start is activated), everything is correct.

I hope this information can help finding the bug/missing feature

[katjuncker]

Can you reproduce this and send the Kubycat command line logs? It logs every file change and the corresponding kubectl commands it issues. Since Kubycat processes file changes from fs.watch synchronously and in the order it receives them, the logs should show exactly what is going wrong.

[schlichtanders]

I'll keep an I on it - I am still working in the same setting where this appeared first and my run soon again into it.

[schlichtanders]

I have collected on output now where I think the syncronization was again broken:

sync    /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.30fa611d.css
 - sync=ImpactFestival2023-Pluto
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba exec dev-5422m7ox3enmm2gr-557456bd-776ld -- /bin/sh -c "rm -Rf /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.30fa611d.css"
 - success
sync    /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.30fa611d.css
 - sync=ImpactFestival2023-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba cp /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.30fa611d.css dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba/dev-5422m7ox3enmm2gr-557456bd-776ld:/home/ssahm/.julia/dev/Pluto/frontend-dist/editor.30fa611d.css
 - success
sync    /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.a7fc49bd.js
 - sync=ImpactFestival2023-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba cp /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.a7fc49bd.js dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba/dev-5422m7ox3enmm2gr-557456bd-776ld:/home/ssahm/.julia/dev/Pluto/frontend-dist/editor.a7fc49bd.js
 - success
sync    /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.acfe4af8.js
 - sync=ImpactFestival2023-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba cp /home/ssahm/.julia/dev/Pluto/frontend-dist/editor.acfe4af8.js dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba/dev-5422m7ox3enmm2gr-557456bd-776ld:/home/ssahm/.julia/dev/Pluto/frontend-dist/editor.acfe4af8.js

When restarting I the following is printed about frontend-dir

sync    /home/ssahm/.julia/dev/Pluto/frontend-dist
 - sync=ImpactFestival2023-Pluto
 - status=Directory_Modified
 - running on all 1 pods
 - kubectl --namespace dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba cp /home/ssahm/.julia/dev/Pluto/frontend-dist dev-5422m7ox3enmm2grqtg6l6kqxqllethyblioffo6lvt3ehvvhvba/dev-5422m7ox3enmm2gr-557456bd-776ld:/home/ssahm/.julia/dev/Pluto/

the file list which was rebuild in frontend-dist is

../frontend-dist/editor.html                              2.9 KB     269ms
../frontend-dist/favicon-16x16.a43373bf.png                679 B     402ms
../frontend-dist/favicon-32x32.30acc80f.png              1.38 KB     211ms
../frontend-dist/favicon-96x96.8b1de181.png              3.22 KB     402ms
../frontend-dist/logo.c7b3bf93.svg                      11.61 KB     261ms
../frontend-dist/favicon_unsaturated.be3fa8fe.svg        1.92 KB     147ms
../frontend-dist/juliamono.9f769536.css                    965 B     238ms
../frontend-dist/vollkorn.93f576b6.css                   1.11 KB     136ms
../frontend-dist/editor.30fa611d.css                    71.05 KB     238ms
../frontend-dist/editor.38e2a102.css                       364 B     137ms
../frontend-dist/editor.444670ee.css                     4.28 KB     239ms
../frontend-dist/editor.653a51a9.css                     6.09 KB     136ms
../frontend-dist/editor.97ae239b.css                     1.02 KB     238ms
../frontend-dist/editor.a7fc49bd.js                    365.49 KB     9.52s
../frontend-dist/index.700a59d2.js                     849.55 KB     260ms
../frontend-dist/editor.8a3292da.js                        519 B     149ms
../frontend-dist/index.html                              3.24 KB     267ms
../frontend-dist/editor.acfe4af8.js                  ⚠️  1.17 MB    17.59s
../frontend-dist/index.01d558ef.css                      3.39 KB     238ms
../frontend-dist/index.54b2d257.css                      20.2 KB     137ms
../frontend-dist/index.2021149f.js                     138.29 KB     9.52s
../frontend-dist/error.jl.html                             372 B     261ms

[schlichtanders]

I again have another output.

Remember, The rebuild first deletes the folder, then recreates it and fills it. If I understood it correctly, I think only the new file with a different name is synced, all the others with same name are somehow skipped.

kubycat outputs

 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.dedd6020.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.dedd6020.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.dedd6020.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.08085abb.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.08085abb.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.08085abb.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.dedd6020.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a exec dev-ll3zzdsn7nh37262-5769b7954d-dd7cs -- /bin/sh -c "rm -Rf /home/myhome/.julia/dev/Pluto/frontend-dist/editor.dedd6020.js"
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.08085abb.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a exec dev-ll3zzdsn7nh37262-5769b7954d-dd7cs -- /bin/sh -c "rm -Rf /home/myhome/.julia/dev/Pluto/frontend-dist/editor.08085abb.js"
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.0a489113.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.0a489113.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.0a489113.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.bea72903.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.bea72903.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.bea72903.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.876fe860.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.876fe860.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.876fe860.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.5a962f10.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.5a962f10.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.5a962f10.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.d2106f5c.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.d2106f5c.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.d2106f5c.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.feab0b54.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.feab0b54.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.feab0b54.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.2f4c9113.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.2f4c9113.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.2f4c9113.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.1d3b163c.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.1d3b163c.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.1d3b163c.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.2f4c9113.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a exec dev-ll3zzdsn7nh37262-5769b7954d-dd7cs -- /bin/sh -c "rm -Rf /home/myhome/.julia/dev/Pluto/frontend-dist/editor.2f4c9113.js"
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.1d3b163c.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a exec dev-ll3zzdsn7nh37262-5769b7954d-dd7cs -- /bin/sh -c "rm -Rf /home/myhome/.julia/dev/Pluto/frontend-dist/editor.1d3b163c.js"
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.fcd27acd.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.fcd27acd.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.fcd27acd.js
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.258556ca.js
 - sync=JolinWorkspaceTemplate-Pluto
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.258556ca.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/Pluto/frontend-dist/editor.258556ca.js
 - success

the last rebuild outputs the following (you see that many files are updated)

npm run build

> pluto-bundler2@0.1.0 build
> rm -r frontend-dist || true && cd frontend && npx parcel build --no-source-maps --public-url . --dist-dir ../frontend-dist editor.html index.html error.jl.html && node ../add_sri.js ../frontend-dist/editor.html


console: Browserslist: 
caniuse-lite is outdated. Please
 run:
  npx 
update-browserslist-db@latest
  Why you should do it 
regularly: 
https://github.com/browserslist/update-db#readme
✨ Built in 31.71s

../frontend-dist/editor.html                              2.9 KB     269ms
../frontend-dist/favicon-16x16.a43373bf.png                679 B     402ms
../frontend-dist/favicon-32x32.30acc80f.png              1.38 KB     211ms
../frontend-dist/favicon-96x96.8b1de181.png              3.22 KB     402ms
../frontend-dist/logo.c7b3bf93.svg                      11.61 KB     261ms
../frontend-dist/favicon_unsaturated.be3fa8fe.svg        1.92 KB     147ms
../frontend-dist/juliamono.9f769536.css                    965 B     238ms
../frontend-dist/vollkorn.93f576b6.css                   1.11 KB     136ms
../frontend-dist/editor.0e193c83.css                    71.35 KB    43.68s
../frontend-dist/editor.38e2a102.css                       364 B     137ms
../frontend-dist/editor.444670ee.css                     4.28 KB     239ms
../frontend-dist/editor.653a51a9.css                     6.09 KB     136ms
../frontend-dist/editor.97ae239b.css                     1.02 KB     238ms
../frontend-dist/editor.fcd27acd.js                    366.18 KB     9.70s
../frontend-dist/index.700a59d2.js                     849.55 KB     260ms
../frontend-dist/editor.8a3292da.js                        519 B     149ms
../frontend-dist/index.html                              3.24 KB     267ms
../frontend-dist/editor.258556ca.js                  ⚠️  1.17 MB    29.09s
../frontend-dist/index.01d558ef.css                      3.39 KB     238ms
../frontend-dist/index.54b2d257.css                      20.2 KB     137ms
../frontend-dist/index.2021149f.js                     138.29 KB     9.52s
../frontend-dist/error.jl.html                             372 B     261ms
console: 📄 Wrote bundle 
manifest to: 
/home/myhome/.julia/dev/Pluto/frontend-dist/parcel-manifest.json
✅ SRI added to  ../frontend-dist/editor.html

[schlichtanders]

I now tried to make it a subfolder, but unfortunately still kubycat has problems recreating the first deleted frontend-dist folder

the output is again

 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist
 - sync=JolinWorkspaceTemplate-dev
 - status=Deleted
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a exec dev-ll3zzdsn7nh37262-5769b7954d-dd7cs -- /bin/sh -c "rm -Rf /home/myhome/.julia/dev/JolinWorkspace/Pluto/frontend-dist"
 - success
sync    /home/myhome/.julia/dev/Pluto/frontend-dist/editor.e41f4cb6.js
 - sync=JolinWorkspaceTemplate-dev
 - status=Modified
 - running on all 1 pods
 - kubectl --namespace dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a cp /home/myhome/.julia/dev/Pluto/frontend-dist/editor.e41f4cb6.js dev-ll3zzdsn7nh37262reqabao3pcmbuic75immwiz5gc3icu2tbe4a/dev-ll3zzdsn7nh37262-5769b7954d-dd7cs:/home/myhome/.julia/dev/JolinWorkspace/Pluto/frontend-dist/editor.e41f4cb6.js

Despite many more files are changed (recreated).