Commit b7cbd87
feat(dbt): add database and schema pattern filtering
- Add database_pattern and schema_pattern config fields with AllowDenyPattern support
- Enhance _is_allowed_node() to filter nodes by database and schema in addition to node names
- Add comprehensive integration tests for new filtering capabilities
- Support combined filtering patterns for fine-grained dbt ingestion control
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <[email protected]>1 parent c1694a3 commit b7cbd87
File tree
5 files changed
+11964
-4
lines changed- metadata-ingestion
- src/datahub/ingestion/source/dbt
- tests/integration/dbt
5 files changed
+11964
-4
lines changedLines changed: 19 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
294 | 294 | | |
295 | 295 | | |
296 | 296 | | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
297 | 306 | | |
298 | 307 | | |
299 | 308 | | |
| |||
1018 | 1027 | | |
1019 | 1028 | | |
1020 | 1029 | | |
1021 | | - | |
1022 | | - | |
| 1030 | + | |
| 1031 | + | |
| 1032 | + | |
| 1033 | + | |
| 1034 | + | |
| 1035 | + | |
| 1036 | + | |
| 1037 | + | |
1023 | 1038 | | |
1024 | 1039 | | |
1025 | 1040 | | |
1026 | 1041 | | |
1027 | 1042 | | |
1028 | 1043 | | |
1029 | | - | |
| 1044 | + | |
1030 | 1045 | | |
1031 | 1046 | | |
1032 | 1047 | | |
| |||
1119 | 1134 | | |
1120 | 1135 | | |
1121 | 1136 | | |
1122 | | - | |
| 1137 | + | |
1123 | 1138 | | |
1124 | 1139 | | |
1125 | 1140 | | |
| |||
0 commit comments