Process for supporting more languages?

[esafak]

I'd like to use it with Kotlin, for example. If you are open to contributions and don't want to handle everything yourself, could you create a guide to adding a new language so we can maintain consistency with your repo's patterns?

[rs545837]

Thanks for the recommendation, I also had a chat with another user who wanted this. I will push it soon.

[rs545837]

Kotlin support is now available, will be in v0.3.9. Thanks for the request @esafak!

How to add a new language to sem

Adding a language takes about 10 minutes. Everything lives in two files.

1. Add the tree-sitter grammar dependency

In crates/sem-core/Cargo.toml, add the tree-sitter grammar crate:

tree-sitter-kotlin-ng = "1.1"

Use crates.io to find the right crate. Make sure it is compatible with tree-sitter = "0.26" and exports a LANGUAGE constant. Crates from the tree-sitter-grammars org are usually the most up-to-date.

2. Add the language config

In crates/sem-core/src/parser/plugins/code/languages.rs:

a. Add a get_language function:

fn get_kotlin() -> Option<Language> {
    Some(tree_sitter_kotlin_ng::LANGUAGE.into())
}

b. Add a LanguageConfig static with:

• entity_node_types: AST node types that represent entities (functions, classes, etc.)
• container_node_types: nodes that contain child entities (class bodies, blocks)
• extensions: file extensions

To find the right node types, parse a sample file and inspect the AST, or check the grammar node-types.json on GitHub.

c. Add it to ALL_CONFIGS and get_all_code_extensions().

3. Add a test

In crates/sem-core/src/parser/plugins/code/mod.rs, add a test that parses a sample file and checks that the expected entity names are extracted.

4. Verify

cd crates && cargo test

That is it. Open a PR with these changes and we will review it.

[esafak]

I'd save this in a file like CONTRIBUTING.md

[Palanikannan1437]

This is done now @esafak 🙌