Skip to content

feat: add Starter Code Integrity Validator to DevPath Sentinel - #1357

Open
jyotish6699 wants to merge 7 commits into
komalharshita:mainfrom
jyotish6699:feat/sentinel-starter-code-validator
Open

feat: add Starter Code Integrity Validator to DevPath Sentinel#1357
jyotish6699 wants to merge 7 commits into
komalharshita:mainfrom
jyotish6699:feat/sentinel-starter-code-validator

Conversation

@jyotish6699

Copy link
Copy Markdown
Contributor

Summary

This PR adds a new Starter Code Integrity Validator to DevPath Sentinel to extend repository integrity validation beyond the existing Dataset Validator.

The new validator integrates with the Sentinel CLI and reporting pipeline, enabling contributors to identify common starter code issues before submitting changes.

Closes #1356


What was added

Starter Code Integrity Validator

Introduced a new validator to verify the integrity of the starter_code/ directory by detecting:

  • Orphan starter code files
  • Empty starter code files
  • Hidden files
  • Unsupported starter code file types

CLI Integration

  • Registered the Starter Code Integrity Validator with the Sentinel CLI
  • Enabled sequential execution of all available validators
  • Unified validation workflow through a single CLI command
python -m tools.sentinel.cli

Validation Reporting

  • Integrated the new validator into the shared reporting pipeline
  • Standardized validation output across multiple validators
  • Added metadata-driven reporting for consistent result formatting

Tests

Added a dedicated test suite covering:

  • Valid starter code structure
  • Orphan file detection
  • Empty file detection
  • Hidden file detection
  • Unsupported extension detection
  • Missing dataset handling
  • Missing starter code directory handling
  • Invalid dataset handling

Documentation

Updated documentation to reflect the new validation workflow.

Files updated include:

  • README.md
  • CONTRIBUTING.md
  • CHANGELOG.md
  • tools/sentinel/README.md

Validation

  • All existing tests pass
  • New validator tests pass
  • Documentation updated
  • Integrated with the existing DevPath Sentinel workflow

Screenshots

Screenshot from 2026-07-26 15-39-02

Implement the Starter Code Integrity Validator with repository scanning, dataset loading, and validation checks for orphan files, empty files, hidden files, and unsupported file extensions. The validator returns a ValidationResult and is ready for CLI integration.
Apply Ruff formatting to the existing validator files without changing functionality.
Update the Sentinel CLI to execute both the Dataset Validator and the Starter Code Integrity Validator through a scalable validator orchestration flow.
Refactor the Sentinel reporting architecture by introducing a standardized ValidationResult details schema with resource, count, checks, and metadata fields. Replace validator-specific reporting with a generic metadata-driven report renderer, classify validation checks by error and warning severity, and update the Dataset Validator and Starter Code Integrity Validator to use the shared reporting pipeline for consistent CLI output.
Add comprehensive tests for the Starter Code Integrity Validator.
Update path handling to support temporary test directories, return
ValidationResult for validation failures, and improve validator
robustness and consistency with the dataset validator.
Document the Starter Code Integrity Validator, multi-validator CLI workflow, contributor guidance, and changelog entries.
@vercel

vercel Bot commented Jul 26, 2026

Copy link
Copy Markdown

@jyotish6699 is attempting to deploy a commit to the komalsony234-1530's projects Team on Vercel.

A member of the Team first needs to authorize it.

@jyotish6699

Copy link
Copy Markdown
Contributor Author

Hi @komalharshita ,

This PR is submitted under GSSoC 2026.

Changes included

  • Added a modular Starter Code Integrity Validator
  • Integrated it with the DevPath Sentinel CLI
  • Extended the validation reporting pipeline
  • Added comprehensive unit tests
  • Updated the relevant documentation

I would appreciate your review and feedback. Thank you!

@komalharshita komalharshita added the need review Further information is requested label Jul 30, 2026
@komalharshita

Copy link
Copy Markdown
Owner

@jyotish6699 kindly resolve the merge conflicts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Add a modular Starter Code Integrity Validator to DevPath Sentinel

2 participants