Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added filtering ability. #79

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jrsperry
Copy link

Added the ability to supply filters. Very handy to avoid having to pull all records (say for example isDeleted, or by some ownerId etc.).

Current implementation would only work if you are pulling a single object, or apply it to all objects being pulled. More than happy to adjust it to be smarter than that.

I can write tests, but i don't see any tests in the project.

@edgarrmondragon edgarrmondragon self-assigned this Feb 13, 2025
@@ -393,22 +396,30 @@ def get_start_date(self, state, catalog_entry):
def _build_query_string(self, catalog_entry, start_date, end_date=None, order_by_clause=True):
selected_properties = self._get_selected_properties(catalog_entry)

query = "SELECT {} FROM {}".format(",".join(selected_properties), catalog_entry["stream"])
query = "SELECT {} FROM {}".format(",".join(selected_properties), catalog_entry['stream'])
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @jrsperry. Can we revert these styling changes? If just to make reviewing the actual changes easier.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants