Skip to content

feat(sync): --src-subpath + --exclude for monorepo subdir-source support #774

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jeremyknows wants to merge 2 commits into
base: master
Choose a base branch
from
+485 −50
Open

feat(sync): --src-subpath + --exclude for monorepo subdir-source support #774

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
ee0754c
feat(sync): add --src-subpath + --exclude for monorepo subdir-source …
jeremyknows May 9, 2026
b4bfb70
fix(sync): gate slugRoot on opts.srcSubpath — preserve path-relative …
jeremyknows May 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 17 additions & 6 deletions src/commands/import.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ export interface RunImportResult {
failures: Array<{ path: string; error: string }>;
}

export async function runImport(engine: BrainEngine, args: string[], opts: { commit?: string } = {}): Promise<RunImportResult> {
export async function runImport(engine: BrainEngine, args: string[], opts: { commit?: string; exclude?: string[]; slugRoot?: string } = {}): Promise<RunImportResult> {
const noEmbed = args.includes('--no-embed');
const fresh = args.includes('--fresh');
const jsonOutput = args.includes('--json');
Expand Down Expand Up @@ -58,19 +58,28 @@ export async function runImport(engine: BrainEngine, args: string[], opts: { com

// Collect all .md files
const allFiles = collectMarkdownFiles(dir);
console.log(`Found ${allFiles.length} markdown files`);

// Apply exclude patterns from opts (passed by performFullSync for --exclude support)
let filteredFiles = allFiles;
if (opts.exclude && opts.exclude.length > 0) {
const { matchesAnyGlob } = await import('../core/sync.ts');
filteredFiles = allFiles.filter(abs => !matchesAnyGlob(relative(dir, abs), opts.exclude!));
console.log(`Found ${filteredFiles.length} markdown files (${allFiles.length - filteredFiles.length} excluded by --exclude patterns)`);
} else {
console.log(`Found ${allFiles.length} markdown files`);
}

// Resume from checkpoint if available
const checkpointPath = gbrainPath('import-checkpoint.json');
let files = allFiles;
let files = filteredFiles;
let resumeIndex = 0;

if (!fresh && existsSync(checkpointPath)) {
try {
const cp = JSON.parse(readFileSync(checkpointPath, 'utf-8'));
if (cp.dir === dir && cp.totalFiles === allFiles.length) {
if (cp.dir === dir && cp.totalFiles === filteredFiles.length) {
resumeIndex = cp.processedIndex;
files = allFiles.slice(resumeIndex);
files = filteredFiles.slice(resumeIndex);
console.log(`Resuming from checkpoint: skipping ${resumeIndex} already-processed files`);
}
} catch {
Expand Down Expand Up @@ -102,8 +111,10 @@ export async function runImport(engine: BrainEngine, args: string[], opts: { com
progress.tick(1, `imported=${imported} skipped=${skipped} errors=${errors}`);
}

const slugBase = opts.slugRoot ?? dir;

async function processFile(eng: BrainEngine, filePath: string) {
const relativePath = relative(dir, filePath);
const relativePath = relative(slugBase, filePath);
try {
// v0.27.1 (F2): dispatch image extensions to importImageFile when
// multimodal is enabled. The walker (collectMarkdownFiles) only picks
Expand Down
Loading