Releases: TobikoData/sqlmesh
Releases · TobikoData/sqlmesh
v0.8.0
✨ Features
- Add loading logging to dbt adapter (#804) @crericha
- Gateway configuration BREAKING CHANGE (#807) @izeigerman
- Extend Airflow integration with the ability to provide an external DB connection for SQLMesh state (#811) @izeigerman
- Introduce logical merge for adapters that do not natively support merge (#802) @crericha
- BREAKING always parse macro returns as sql (#815) @tobymao
- Add Github Actions CI/CD Bot (#810) @eakmanrq
- Set up Docs (#801) @mykalmax
- Log exception stack traces from executor tasks to API console (#825) @vchan
- Use dbt manifest to load dbt projects (#821) @izeigerman
🪲 Bug fixes
- In Postgres engine adapter only commit if there's no active transaction (#800) @izeigerman
- Pin ruamel.yaml version when running airflow tests on CircleCI @izeigerman
- Data leakage was incorrect with window functions BREAKING CHANGE (#805) @tobymao
- Enforce unpaused parent snapshots only for new snapshots (#809) @izeigerman
- Don't add where false if no from statement @tobymao
- Use package materialization config in dbt fixture (#816) @crericha
- Cnclude missing direct model names (#822) @mykalmax
🧹 Chore
👽 Other
- Update uvicorn development server configs (#806) @vchan
- Continue watching even if context.load() fails, e.g. typos in a model file (#808) @vchan
- Format code (#812) @cornzyblack
- Update engines.md (#813) @wseaton
- Remove unneeded expand @tobymao
- Improve BigQuery Pandas Implementation (#814) @eakmanrq
- Add missing import (#823) @eakmanrq
v0.7.0
✨ Features
- Introduce LLM integration (#799) @izeigerman
🪲 Bug fixes
- Make start_date an actual date and add start_dt @tobymao
v0.6.4
🪲 Bug fixes
- Remove overlapping intervals in old snapshots superseded by a new unpaused snapshot with the effective date set (#788) @izeigerman
- Normalize macro names @tobymao
- Merge should use columns_to_types, so it can support pandas dfs (#792) @crericha
- DataFrame Where Clause Quoting (#793) @eakmanrq
🛠️ Refactor
- Print rendered dag location in terminal (#789) @cornzyblack
🧹 Chore
- Add redshift profile to dbt example project (#791) @crericha
- Bump sqlglot to v11.6.3 (#795) @georgesittas
👽 Other
v0.6.3
✨ Features
- Add ability to set the effective date for forward-only snapshots (#785) @izeigerman
🪲 Bug fixes
- For forward-only plans run backfill after promotion (#774) @izeigerman
- Display nodes more condensed, update connection on column name change (#781) @mykalmax
- Support dbt model jinja method, use dialect when parsing, catch duplicate key errors, and improve parse time for very large sql models (#782) @crericha
- When applying a forward-only plan in dev the backfill shoulde precede the promotion (#786) @izeigerman
- Handle no rows in versions table due to corruption @tobymao
- Flaky test with new sqlglot. @tobymao
🧹 Chore
- Upgrade to sqlglot 11.6 and clean up example project paths @tobymao
👽 Other
- Reset selected lineage columns on tab change (#772) @mykalmax
- Add Dataframe Merge Support (#770) @eakmanrq
- Remove self from depends_on (#773) @eakmanrq
- Use jinja2 loopcontrols extension (#776) @crericha
- Remove catalog/db from spark temp view (#777) @eakmanrq
- What does backfill mean? (#778) @foundinblank
- Modify quickstart project and add seed file (#779) @foundinblank
- Add model tags field (#775) @vchan
- Redshift config port can be a string in profiles.yml (#784) @crericha
v0.6.2
🪲 Bug fixes
- Caching of rendered dbt model configs by making the dependencies attribute public (#768) @izeigerman
- Don't validate on migration (#771) @tobymao
v0.6.1
v0.6.0
✨ Features
- Display tests report (#729) @mykalmax
- [dbt] Support incremental_by_unique_key when unique_key defined with no incremental_strategy (#731) @crericha
- Add execution config for BigQuery (#732) @eakmanrq
- Introduce the caching layer when loading SQL models (#733) @izeigerman
- Column-level lineage (#663) @mykalmax
- Lookback windows closes #728 (#736) @tobymao
- Add dialect to cli render closes #741 @tobymao
- Add lookback to dbt projects (#760) @crericha
- Highlight know columns in editor (#761) @mykalmax
🪲 Bug fixes
- Fix links (#739) @crericha
- Clarify in docs that type casting in a model's query is not mandatory (#742) @izeigerman
- Drop view in order to replace it when using Postgres (#751) @izeigerman
- Explicitly set the end and the latest dates in the Airflow end-to-end test @izeigerman
- Enable logging in CLI when the debug mode is enabled @izeigerman
- Clean-up target defaults (#735) @crericha
- Dbt hook yaml formats, duplicate yaml keys, and sources without tables (#745) @crericha
- Apply lookback window to the data interval start date when running a cadence DAG in Airflow (#759) @izeigerman
- Allow empty files in models folder and refetch lineage on model file change (#746) @mykalmax
- Selecting column in lineage (#766) @mykalmax
- Migrate table schemas only for snapshots with the FORWARD_ONLY category explicitly assigned (#763) @izeigerman
- Introduce environment finalization (#764) @izeigerman
- Airflow integration test by assigning a change category correctly @izeigerman
🧹 Chore
- Add ability to enable a debug mode (#743) @izeigerman
- Add the 'info' command to CLI (#744) @izeigerman
- Move batch_size inside kind. BREAKING CHANGE. (#749) @tobymao
- Update vm2 version (#747) @mykalmax
- Delete project cache before using in a test (#762) @crericha
👽 Other
- Updated notebook.md (#734) @ShanksData
- Fixed typo (#738) @AlessandroLollo
- Add bigquery storage dependency (#756) @eakmanrq
- Add Postgres to engine configuration list (#755) @jared-rimmer
- Remove pg keep_alives default (#758) @eakmanrq
- Update tests @tobymao
- Update slack links @tobymao
- Update slack link (#767) @vchan
v0.5.0
✨ Features
- Support nested add/remove columns + positional additions (#655) @eakmanrq
- File state adapter (#711) @z3z1ma
- Support dbt quoting config (#715) @crericha
- Support multiple repos (#704) @tobymao
- Add Postgres Support (built-in, Airflow, dbt) (#677) @eakmanrq
- Render should not quote identifiers by default (#726) @crericha
🪲 Bug fixes
- Sqlglot wasn't replacing all lambda vars with identifiers @tobymao
- Include hours and minutes when formatting missing intervals (#722) @izeigerman
- [dbt] materialized can be jinja and allow, but warn, on extra profile fields (#721) @crericha
- Run plan in default event loop instead of an executor (#727) @vchan
🧹 Chore
👽 Other
- Split test command for unit and e2e (#710) @mykalmax
- Update EditorPreview.tsx (#713) @mykalmax
- Cleanup transactional file implementation (#716) @tobymao
- Add the 'Virtual Environments for Data' blog post (#714) @izeigerman
- Edit the Virtual Data Environments post @izeigerman
- Add stamp to docs @tobymao
- [Fix] Small fix after integration testing on GCS (#723) @z3z1ma
- Cleanup @tobymao
- Rename blog post file @izeigerman
- Use virtual environment name (#725) @eakmanrq
- Update docs @tobymao
v0.4.1
✨ Features
- Dbt namespace macros (#690) @crericha
- Introduce API endpoint for column lineage (#691) @vchan
- Add
forall
audit (#698) @plaflamme - Make tasks progress component more flexible (#664) @mykalmax
🪲 Bug fixes
- Make first tab closable (#675) @mykalmax
- Show view name in models needing backfill (#687) @eakmanrq
- Cache DBT macros to improve load time (#695) @crericha
- Styling bugs and incorrect spelling (#694) @mykalmax
- Forall with only one criteria (#701) @plaflamme
- Rename
values
parameter tois_in
(#703) @plaflamme - Floor yesterday to a date to prevent it from being later than start (#705) @tobymao
- Ensure that removed models are not referenced downstream during plan creation (#706) (#708) @izeigerman
- Fix type import and missing null check for models (#709) @mykalmax
🧹 Chore
👽 Other
- Update README.md (#693) @robscriva
- Respect audit skip flag (#700) @vchan