Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Specifying compute doesn't work in models imported via dbt packages #11240

Open
2 tasks done
jelstongreen opened this issue Jan 27, 2025 · 0 comments
Open
2 tasks done
Labels
bug Something isn't working triage

Comments

@jelstongreen
Copy link

Is this a new bug in dbt-core?

  • I believe this is a new bug in dbt-core
  • I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

When a dbt package is installed in a project that contains a model with a databricks_compute config assigned , that compute is not used by the invoking dbt project.

Expected Behavior

Compute should be used regardless of if the model is imported or native to the invokinf project.

Steps To Reproduce

Create a test model with a Databricks compute specified in the model level config different to the default compute to the rest of the project. Run it as part of a dbt project and verify it runs on its specified compute. Now move the model to an imported package and try again. It will run on the default compute instead of the specified compute.

Relevant log output

Environment

- OS:
- Python:
- dbt: 1.8.8

Which database adapter are you using with dbt?

spark

Additional Context

No response

@jelstongreen jelstongreen added bug Something isn't working triage labels Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

No branches or pull requests

1 participant