Commit b8259a7
authored
# Release v0.10.11 (#2077)
## Analyzer
No updates in this release
## Converters
### General
- Fixed special character handling in filenames by introducing
from_uri() helper function for safer URI handling
- Ensured SQL converter returns UTF-8 encoded files for proper character
encoding
- Fixed filename to correctly output
databricks_conversion_supplements.py supplemental file
- Improved handling of encoding-related errors by catching
UnicodeDecodeError and LookupError exceptions during file processing,
creating TranspileError with specific encoding-error codes instead of
stopping
### Morpheus
#### Snowflake
- Added support for TRUNCATE TABLE statements with proper IR and
translation support
- Correctly support $IDENTITY and $ROWGUID system variables
- Refactored and extended grammar and AST support for SQL procedure
creation with improved handling of raw string literals
#### TSQL
- Added support for TRUNCATE TABLE statements with proper IR and
translation support
- Support full CREATE and ALTER INDEX statements in TSQL parsing,
rejecting INDEX CREATE/ALTER statements sensibly instead of raising
syntax errors
- Fixed implementation of IF scripting blocks with improvements to SQL
parser, grammar enhancements, and enhanced scripting grammar for more
robust handling of block statements and conditional branches
- Allow CLUSTERED to be an identifier to improve CREATE TABLE syntax as
a CONSTRAINT qualifier
- Support percentage expressions in TSQL options (e.g., OPT = 42%)
instead of raising parsing errors
- Added support for REVOKE statements, similar to existing GRANT
statement implementation
- Ensure that ROWS and OBJECTS can be used as identifiers even with
Jinja templates
- Correctly support $IDENTITY and $ROWGUID system variables
#### General (Multiple Dialects)
- Support comments on column declarations when generating SQL and
renamed legacy builders for consistency
- Refactored IR around CREATE FUNCTION and CREATE PROCEDURE, unifying
all ways to create stored procedures under a single
CreateStoredProcedure IR node and all ways to create user defined
functions under a single CreateUDF IR node
- Implemented grammar and IR placeholders for named windows, introducing
initial support for the SQL standard WINDOW clause in parser grammar
### BladeBridge
#### Oracle
- Removed unsupported Oracle DDL constraints (add/create constraint
unique) and extraneous TBLPROPERTIES from converted output
#### MSSQL
- Added handle_xml_nodes function for MS SQL processing
- Fixed multiple MSSQL issues including CTEs in views/stored procedures,
ADD CONSTRAINT problems, DEFAULT value handling, and parameter data
types
#### Synapse
- Fixed multiple Synapse issues including CTEs in views/stored
procedures, ADD CONSTRAINT problems, DEFAULT value handling, parameter
data types, error handling in stored procedures, and Synapse-specific
features (e.g., table distribution)
#### Teradata
- Added Teradata function mappings including ZEROIFNULL,
TEMPORAL_TIMESTAMP, TRYCAST, ANY, FIRST, NULLIFZERO, DECODE with
different parameter counts, and HASHAMP
- Removed collect statistics and lock table statements
#### DataStage
- Implemented DataStage Checksum component translation to SparkSQL
equivalent and fixed Pyspark checksum translation to use MD5() instead
of SHA2()
## Reconcile
- Added handling for special characters in reconcile aggregate,
enhancing the library to handle special characters in column names by
properly delimiting identifiers in SQL queries
- Fixed deploy reconcile jobs by updating wheel file handling,
simplifying deployment process to use single wheel path, and fixing
broken documentation links
- Enhanced schema reconciliation functionality to support Snowflake
arrays, addressing the corner case where Databricks arrays are typed and
Snowflake arrays are untyped
## Documentation
- Fixed download link in docs (reconcile automation) by replacing broken
markdown link with JSX link utilizing useBaseUrl hook
- Fixed broken splitter URL by updating directory naming conventions
from "Downloads" to "downloads"
## General
- Implemented new describe-transpile CLI subcommand that describes
installed transpilers, including their versions, configuration paths,
and supported source dialects
- Switched from urllib to requests library for making HTTP calls to PyPI
and Maven Central, with default 60-second timeout and improved error
handling
- Work around DATABRICKS_HOST normalization issue during install and
uninstall by introducing new Lakebridge subclass with appropriate
workspace client
# Dependency updates
* Bump Databricks SDK Version to 0.67.0 by @goodwillpunning in
#2062
* Bump sigstore/gh-action-sigstore-python from 3.0.0 to 3.0.1 by
@dependabot[bot] in
#1753
Special thanks to @BrianDeacon for his contribution to fix
#18581 parent a8552db commit b8259a7
2 files changed
+74
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
3 | 76 | | |
4 | 77 | | |
5 | 78 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
0 commit comments