Changes to interactive jobs
November 8, 2024, Joachim Folz
We will soon be rolling out changes to interactive jobs. Read below how to adjust your jobs to fit the new requirements.
...We will soon be rolling out changes to interactive jobs. Read below how to adjust your jobs to fit the new requirements.
...Here is our summary of all changes to Pegasus during the 2023 year end maintenance period.
...Our image compression saga concludes (for now) with a comparison
of image sizes before and after we applied our new settings
to all existing images in /enroot
.
Thought we were done with compression? So did we, but as it turns out, we overlooked a Squashfs parameter that is maybe even more important than compression settings: block size.
...We previously tested container startup times with different Squashfs compression settings. We now revisit this topic from the perspective of users importing from Docker Hub or creating custom images.
...After an extended testing period, our local PyPI cache is now live.
...There is now a supported way to build container images defined by Dockerfile (or Containerfile) via podman and enroot. More below the fold.
...A quick update on the cluster state after the AC issues we experienced on 18th July.
...We’ve installed a local cache for PyPI packages. Hosting frequently installed packages locally is nicer to PyPI and should significantly speed up package installation. Read below how to use it.
...We tested container startup times from SquashFS with lz4 and zstandard compression versus uncompressed files. Spoiler: compression is good.
...