Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support count_true and count_false for boolean columns in BigQuery #610

Merged

Conversation

suelai
Copy link
Contributor

@suelai suelai commented Nov 10, 2023

Allow count_true and count_false metrics for boolean columns for BigQuery
From my testing (I have blurred the table name):
Screenshot 2023-11-10 at 15 56 52

closes elementary-data/elementary#1273

@suelai suelai marked this pull request as ready for review November 10, 2023 15:21
@@ -4,6 +4,7 @@
'column_any_type': ['null_count', 'null_percent', 'not_null_percent'],
'column_string': ['min_length', 'max_length', 'average_length', 'missing_count', 'missing_percent', 'not_missing_percent'],
'column_numeric': ['min', 'max', 'zero_count', 'zero_percent', 'not_zero_percent', 'average', 'standard_deviation', 'variance', 'sum']
Copy link
Contributor

@noaKurman noaKurman Jan 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're missing a semicolon here at the end

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is why the tests fail

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@noaKurman Ah when I merged main into my branch, I missed it when resolving the conflicts. It is ready now!

@suelai suelai requested a review from noaKurman January 3, 2024 08:50
@ofek1weiss
Copy link
Contributor

ofek1weiss commented Feb 5, 2024

Hey @suelai, sorry for the long delay 😓 Im here now so lets do it 😎

there seems to be a small issue here, you are missing a comma at the end of the line, like so:

{%- if 'count_false' in column_monitors -%} {{ elementary.count_false(column) }} {%- else -%} null {% endif %} as count_false,

after that i believe that everything should work and this could be merged 🙏

@suelai
Copy link
Contributor Author

suelai commented Feb 5, 2024

Hey @suelai, sorry for the long delay 😓 Im here now so lets do it 😎

there seems to be a small issue here, you are missing a comma at the end of the line, like so:

{%- if 'count_false' in column_monitors -%} {{ elementary.count_false(column) }} {%- else -%} null {% endif %} as count_false,

after that i believe that everything should work and this could be merged 🙏

Great, fixed in c0a60a6

@ofek1weiss
Copy link
Contributor

Awesome! the tests are currently running here, and seem to be doing well so far 🤞

Copy link
Contributor

@ofek1weiss ofek1weiss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@ofek1weiss ofek1weiss merged commit 75a8134 into elementary-data:master Feb 6, 2024
@ofek1weiss
Copy link
Contributor

@suelai thank you so much for this contribution 🙏! Keep your eyes peeled for the next release 👀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support boolean columns and their metrics in BigQuery
3 participants