allow configuring dataset model uri collation

[zhangyangyu]

Description

Currently, the dataset model's uri column has a hard code collation. The 'latin1_general_cs' collation is not supported by some MySQL compatible database, like TiDB. So it's not possible to use the database with Airflow while most other features are compatible.

airflow/airflow/models/dataset.py

Line 59 in 17e5e7b

collation="latin1_general_cs",

Use case/motivation

Allow users to customize the collation while still default to 'latin1_general_cs'.

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[hussein-awala]

@zhangyangyu Adding a new Airflow configuration to configure the table collation and set its default value to latin1_general_cs can do the job, I assigned you.

[taodaling]

Hi @zhangyangyu , have you made any progress on this issue, I have met the same issue when I migrated airflow db to TIDB.

[potiuk]

@zhangyangyu We are unassigning you from this issue as part of our updated assignment policy.

This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.

We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.

[1fanwang]

hey folks opened a pr to address this @potiuk @zhangyangyu @taodaling @hussein-awala #71249