Skip to content

Pax process sthml#23

Open
XeBoris wants to merge 12 commits intomasterfrom
pax_process_sthml
Open

Pax process sthml#23
XeBoris wants to merge 12 commits intomasterfrom
pax_process_sthml

Conversation

@XeBoris
Copy link

@XeBoris XeBoris commented Jun 8, 2016

  1. I added some features to cax-status which helps to identify the status of files/folder of our data in the data base. I started to use this tool as replacement for actual using the web interface to the run data base

  2. I tested cax-process manually. Furthermore I added parser options to make life more easier in case someone wants to use cax-process. Batch processing should work too.

cax/cax.json Outdated
"download_options": ["midway-login1"],
"pax_processing_versions": [
"v4.10.0"
"v4.10.2"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

won't this trigger a reprocessing?

@tunnell
Copy link
Member

tunnell commented Jun 8, 2016

Anyways, added a few comments. Some big things (check main.py). One key thing: the data type is processed and status is transferred. That means good. If you manually change verifying to transferred, then you have no idea if the data is any good... that's why we have checksumming.

@tunnell tunnell self-assigned this Jun 8, 2016
cax/config.py Outdated
def pax_deploy_directories(host, pax_version):
PAX_DEPLOY_DIRS = {
'midway-login1' : '/project/lgrandi/deployHQ/pax',
'tegner-login-1': '/afs/pdc.kth.se/projects/xenon/software/pax/pax_'+pax_version
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do you need to specify pax version here? You should have one anaconda setup that has different environments for different pax versions. That's why this wasn't a function.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think my aim was to specify to the actual pax version in the path. But this is not important. Changed it back

@tunnell
Copy link
Member

tunnell commented Jun 17, 2016

Looks good, added some comments. Not far from merging. Need to resolve some merge conflcits.

@tunnell
Copy link
Member

tunnell commented Jun 22, 2016

Can you merge with master?

@pdeperio
Copy link
Contributor

Also, @XeBoris when you get a chance, can you please update the README with all the latest features/options?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants