You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This feature expects the source data to have the required related entities before it can be ingested to surface the frames and ctf metadata. To ensure that the source data is in a valid state, we need to add a validation step that can determine if the data is accurate before the ingestion.
Tasks
Validations for MDOC/Frames
number of mdoc sections == number of frame files on s3 == number of items in frames table/metadata
frame file names match file names in mdoc section
tilt axis angle in mdoc file matches that in tilt series metadata (+/- 10 deg)
tilt axis angle in mdoc file matches that in the alignment metadata [PSAP.rotation_angle] (+/- 10 deg)
number of frames >= # of per section parameters
Validations for Frames Metadata
When isGainCorrected == False, a Gains entity exists for the run
max(acquisitionOrder) < number of frames - 1
Sum of exposureDose of all frames associated with a tilt series == totalFlux of tilt series
Sorting acquisitionOrder low-to-high and accumulatedDose low-to-high results in the same order
Validations for PerSectionParameter Metadata
-180 <= astigmaticAngle <= 180
majorDefocus > minorDefocus
0 <= phaseShift <= 2*pi
maxResolution > 0
rawAngle matches mdoc angle as defined above
0 <= zIndex <= (z-Dimension of tilt series - 1)
What Done Looks Like?
The existing validation tests include the new tests. We are able to run validation for any standardized data from command line or in the batch environment.
The text was updated successfully, but these errors were encountered:
Relates to: #1418
Rationale
This feature expects the source data to have the required related entities before it can be ingested to surface the frames and ctf metadata. To ensure that the source data is in a valid state, we need to add a validation step that can determine if the data is accurate before the ingestion.
Tasks
Validations for MDOC/Frames
Validations for Frames Metadata
Validations for PerSectionParameter Metadata
What Done Looks Like?
The existing validation tests include the new tests. We are able to run validation for any standardized data from command line or in the batch environment.
The text was updated successfully, but these errors were encountered: