Skip to content

Document USE_LOGIC_TYPE format option for PARQUET and AVRO files #2490

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from

Conversation

Copilot
Copy link

@Copilot Copilot AI commented Jul 2, 2025

This PR documents the USE_LOGIC_TYPE format option that was introduced in databendlabs/databend#18232 for PARQUET and AVRO file formats.

Changes Made

English Documentation (docs/en/sql-reference/00-sql-reference/50-file-format-options.md)

  • Added USE_LOGIC_TYPE = TRUE | FALSE to the formatTypeOptions syntax
  • Added USE_LOGIC_TYPE (Load Only) section to PARQUET Options
  • Added USE_LOGIC_TYPE (Load Only) section to AVRO Options

Chinese Documentation (docs/cn/sql-reference/00-sql-reference/50-file-format-options.md)

  • Added USE_LOGIC_TYPE = TRUE | FALSE to the formatTypeOptions syntax
  • Added USE_LOGIC_TYPE (仅加载) section to PARQUET 选项
  • Added USE_LOGIC_TYPE (仅加载) section to AVRO 选项

Option Details

The USE_LOGIC_TYPE option controls how temporal data types are interpreted during data loading:

  • TRUE (Default): Date and timestamp values are loaded as their logical data types (DATE and TIMESTAMP)
  • FALSE: Date and timestamp values are loaded as raw integer values (INT32 for dates, INT64 for timestamps)
  • Availability: Load only, applicable to PARQUET and AVRO formats

Testing

  • ✅ English documentation builds successfully (npm run build:en)
  • ✅ Chinese documentation builds successfully (npm run build:cn)
  • ✅ All changes follow existing documentation patterns and formatting

Fixes #2489.

Warning

Firewall rules blocked me from connecting to one or more addresses

I tried to connect to the following addresses, but was blocked by firewall rules:

  • repo.databend.com
    • Triggering command: node /home/REDACTED/work/databend-docs/databend-docs/node_modules/.bin/docusaurus build (dns block)

If you need me to access, download, or install something from one of these locations, you can either:


💬 Share your feedback on Copilot coding agent for the chance to win a $200 gift card! Click here to start the survey.

Copy link

vercel bot commented Jul 2, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
databend ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 2, 2025 4:45am

@Copilot Copilot AI changed the title [WIP] USE_LOGIC_TYPE format option Document USE_LOGIC_TYPE format option for PARQUET and AVRO files Jul 2, 2025
@Copilot Copilot AI requested a review from BohuTANG July 2, 2025 04:44
Copilot finished work on behalf of BohuTANG July 2, 2025 04:44
@BohuTANG BohuTANG closed this Jul 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

USE_LOGIC_TYPE format option
2 participants