The NIDAP2SBG package is a 2-step tool for:
- Exporting a NIDAP (based in Palantir) transform code
- Import the pipeline to Seven Bridges Genomics (CGC)
The NIDAP Exporter can automatically:
- Download complete workbooks, its transform codes and datasets from NIDAP
- Creates the step-by-step pipeline from the workbook, by parsing and recreating all of the transform steps in local scripts
- Prepare the docker file to be able to run the scripts in a container
- Prepare it for a publication - in a form of a github project
The SBG Importer receives the output from the NIDAP Exporter, and:
- Build the docker image and deploy it to the SBG docker registry
- Based on the inputs from NIDAP Exporter, recreate the scripts to be able to be run using parameters by CWL calls
- Recreate the topological graph with the CWL pipeline that runs this workflow
- Upload this CWL pipeline and the whole project structure to SBG.