Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update DB ingestion for PerSectionParameters table #1523

Open
Tracked by #1508
manasaV3 opened this issue Jan 24, 2025 · 0 comments
Open
Tracked by #1508

Update DB ingestion for PerSectionParameters table #1523

manasaV3 opened this issue Jan 24, 2025 · 0 comments
Assignees
Labels
backend P0 Must have

Comments

@manasaV3
Copy link
Contributor

manasaV3 commented Jan 24, 2025

Blocked by: #1056

Task

This import step should be executed after the import of Tiltseries and Frames to ensure all the records that are referenced are already created.

DB schema

The schema of the new table

Name Data type Nullable Defaults
astigmatic_angle float true  
frame_id int false  
id int false Auto Increment
major_defocus float true  
minor_defocus float true  
phase_shift float true 0.0
max_resolution float true  
raw_angle float false  
run_id int false  
tiltseries_id int false  
z_index int false  

Metadata mapping

The data is sourced from the tiltseries_metadata.json

Name Source
astigmatic_angle  metadata: per_section_parameters[*]. astigmatic_angle
frame_id frame.id find frame by run_id, and acquisition_order
major_defocus metadata: per_section_parameters[*]. major_defocus
minor_defocus metadata: per_section_parameters[*]. minor_defocus
phase_shift metadata: per_section_parameters[*]. phase_shift defaults to 0.0 if value is null.
max_resolution metadata: per_section_parameters[*]. max_resolution
raw_angle metadata: per_section_parameters[*]. raw_angle
run_id parent: run.id
tiltseries_id parent: tiltseries.id
z_index metadata: per_section_parameters[*]. z_index

What done looks like?

The api has been updated to reflect the per section parameter data model, and data can be populated for all the per section parameter field.

Notes

  1. https://github.com/chanzuckerberg/cryoet-data-portal-backend/tree/main/apiv2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend P0 Must have
Projects
None yet
Development

No branches or pull requests

2 participants