Skip to content

Conversation

@bergsalex
Copy link
Collaborator

This PR updates the singularity image locations to reference the new meta/images image repository.

Before we merge this, I would like to check with @SkepticRaven about the gait frailty and rclone images.

Copy link

@michberger michberger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a question...why are there multiple latest.sif in each of the images? Some are in a folder called "latest" and some inside a version folder. There is probably a logical reason but it strikes me as redundant files.

container = "/projects/kumar-lab/meta/images/mouse-tracking-runtime/RBase/v0.1.2/latest.sif"
}
withLabel: "gait" {
container = "/projects/kumar-lab/multimouse-pipeline/nextflow-containers/gait-pipeline-2025-03-27.sif"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gait is a difficult one to version right now. It has unrelated histories between private (bitbucket) and public (github, cited paper version). I think the differences are just in Gautam's analysis and vms.
It looks like the paper version is v1.0.0.
The runtime currently there should probably be v1.1.0.

container = "/projects/kumar-lab/multimouse-pipeline/nextflow-containers/gait-pipeline-2025-03-27.sif"
}
withLabel: "frailty" {
container = "/projects/kumar-lab/multimouse-pipeline/nextflow-containers/vfi-2025-03-27.sif"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

VFI paper version was v1.
There should probably be a new release based on the history. Recommend v1.0.1 (all look like bugpatches).

container = "/projects/kumar-lab/multimouse-pipeline/nextflow-containers/sleap-io-0.2.0.sif"
container = "/projects/kumar-lab/meta/images/mouse-tracking-runtime/sleap-io-0.2.0/v0.1.2/latest.sif"
}
withLabel: "rclone" {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rclone container is a trivial container definition. I only add bash to the container so that nextflow logging can run. The version it's running happens to be rclone v1.70.3 (according to the tool itself).
I can add the definition file to the vm folder in this PR if you want.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would be great.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added vm/rclone.def
Feel free to be more specific about its version, but I don't think it matters much.

@bergsalex
Copy link
Collaborator Author

Just a question...why are there multiple latest.sif in each of the images? Some are in a folder called "latest" and some inside a version folder. There is probably a logical reason but it strikes me as redundant files.

@michberger

All of the latest folders/files are soft links, so we don't duplicate any of the data. The soft links get updated whenever we rebuild the images. This give us a convenient way to keep our workflows pointing to the most recent image that you're comfortable using.

For example:

  • The most recent RBase image, regardless of version:
    • /projects/kumar-lab/meta/images/mouse-tracking-runtime/RBase/latest.sif
  • A shortcut to the newest image directory for RBase
    • /projects/kumar-lab/meta/images/mouse-tracking-runtime/RBase/latest/
  • The latest v0.1.2 RBase image:
    • /projects/kumar-lab/meta/images/mouse-tracking-runtime/RBase/v0.1.2/latest.sif
  • A specific v0.1.2 RBase image:
    • /projects/kumar-lab/meta/images/mouse-tracking-runtime/RBase/v0.1.2/d9736c87a8d3132bd8e466374dad9bab0813d8a03df2303d26c252160da8c62f.sif

We should probably have a lab wide presentation on the new image and classifier directory structures.

@bergsalex bergsalex marked this pull request as ready for review September 30, 2025 18:45
@bergsalex
Copy link
Collaborator Author

I'm going to merge as is for now so that @michberger can use the updated images. I'll make a new PR once we have final paths for the remaining images.

@bergsalex bergsalex merged commit 7f8010b into main Sep 30, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants