Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Source Outreach: Remove custom incremental class and use new filter syntax #55888

Merged
merged 5 commits into from
Mar 21, 2025

Conversation

kyleromines
Copy link
Contributor

What

Previous PR here started failing due to cdk updates: #55180
It turns out Outreach has a new filter syntax, docs here: https://developers.outreach.io/api/making-requests/#new-filter-syntax

This allows us to add the the greater than or equal logic to the request parameter name instead of in the paramater value.
Now requests look like .com/accounts?filter[updatedAt][gte]=2017-01-01 instead of .com/accounts?filter[updatedAt]=2017-01-01..inf

This eliminates the need for the custom class or complicated injection logic in the yaml.

Also changed datetime_format to %_ms instead of %f as the api returns milliseconds and %f was causing the start date timestamp to get converted to microseconds which will error out the api request as it only goes up to miliseconds.

How

Add parameter newFilterSyntax = true, remove CustomIncrementalSync class and switch to start_time_option with field_name = filter[updatedAt][gte].

Review guide

  1. manifest.yaml
  2. components.py

User Impact

Currently cannot set up source with latest version as the check fails and upgrading an existing source to the latest connector version causes syncs to fail with same error.

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link

vercel bot commented Mar 20, 2025

@kyleromines is attempting to deploy a commit to the Airbyte Growth Team on Vercel.

A member of the Team first needs to authorize it.

@shubham-agrawal-glean
Copy link

shubham-agrawal-glean commented Mar 21, 2025

@kyleromines Thanks for raising this new PR, hope it gets verified quickly. I am waiting on this for my ingestion pipeline.

Copy link

vercel bot commented Mar 21, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 21, 2025 11:33am

@marcosmarxm marcosmarxm merged commit ce53dfa into airbytehq:master Mar 21, 2025
26 checks passed
@shubham-agrawal-glean
Copy link

Thanks everyone , connector works just fine.
One question: As this connector is not maintained by airbyte, can i rely on this for production data ingestion? Any suggestion?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

Successfully merging this pull request may close these issues.

4 participants