Skip to content

Allow for custom parsing solutions #113

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
eoyoa wants to merge 13 commits into
base: main
Choose a base branch
from
Draft

Allow for custom parsing solutions #113

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
742d4a9
Myriad improvements to ast
cmwade Jul 16, 2025
be44b5a
Make tests for parser
eoyoa Jul 21, 2025
8355b8f
Abstract out Tokenizer.next() logic
eoyoa Jul 21, 2025
e83536d
Allow custom tokenizer to be passed into stringToTokens
eoyoa Jul 21, 2025
75c27ff
Move parser-related files to own directory
eoyoa Jul 21, 2025
56abdba
Allow custom parsing settings to be passed into parseValue
eoyoa Jul 21, 2025
4030f4e
Update type declarations
eoyoa Jul 22, 2025
4c7eecd
Export SyntaxNode, update type declarations
eoyoa Jul 22, 2025
22ac547
Push all unpushed type declarations
eoyoa Jul 22, 2025
c7289a9
Merge remote-tracking branch 'charlotte/better-tree' into custom-toke…
eoyoa Jul 22, 2025
3fd8b69
Update AST type declarations
eoyoa Jul 22, 2025
96ed43b
Export ParseHandler interface
eoyoa Jul 22, 2025
0f6bb6b
Passed handling settings into parseValue recursive calls, ran auto-fo…
eoyoa Jul 22, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion jest.config.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -175,7 +175,18 @@ const config: Config = {
// testRunner: "jest-circus/runner",

// A map from regular expressions to paths to transformers
// transform: undefined,
transform: {
"^.+\\.ts?$": [
"ts-jest",
{
useESM: true,
},
],
},
extensionsToTreatAsEsm: [".ts"],
moduleNameMapper: {
"^(\\.{1,2}/.*)\\.js$": "$1",
},

// An array of regexp pattern strings that are matched against all source file paths, matched files will skip transformation
// transformIgnorePatterns: [
Expand Down
1,388 changes: 866 additions & 522 deletions package-lock.json
View file
Open in desktop

Large diffs are not rendered by default.

3 changes: 2 additions & 1 deletion package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
"preview": "vite preview",
"deploy": "./deploy $npm_package_version",
"clean": "rm -rf dist",
"test": "jest"
"test": "NODE_OPTIONS=--experimental-vm-modules jest"
},
"type": "module",
"author": "",
Expand Down Expand Up @@ -40,6 +40,7 @@
},
"dependencies": {
"@codemirror/language": "^6.9.0",
"@jest/globals": "^30.0.4",
"@lezer/highlight": "^1.1.6",
"@lezer/lr": "^1.3.10",
"@types/showdown": "^2.0.6",
Expand Down
Loading