Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notebook on System Field ingestion #110

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

petermarshallio
Copy link
Collaborator

@petermarshallio petermarshallio commented Jul 9, 2024

Notebook dedicated to incorporating system field data into tables.

Fix for #114

Brought forward content from the old batch ingestion intro.
Applied the template and added a transform to the field.
Reported an issue with the ingestion not completing.
Added some refs, added a bit to the query.
@petermarshallio
Copy link
Collaborator Author

Currently unable to complete this notebook due to apache/druid#16709 - this worked fine in Druid 29, hence passing tests in this environment.

@petermarshallio
Copy link
Collaborator Author

Adding a note that this notebook is waiting on a fix. It has not been resolved in Druid 31.

@petermarshallio petermarshallio changed the title Create 16-batch-systemfields.ipynb Notebook on System Field ingestion Dec 20, 2024
@petermarshallio
Copy link
Collaborator Author

Confirming that ingestion still fails in Druid 31 with:

java.lang.RuntimeException: java.lang.ClassCastException: class org.apache.druid.segment.transform.TransformedInputRow cannot be cast to class org.apache.druid.data.input.ListBasedInputRow (org.apache.druid.segment.transform.TransformedInputRow and org.apache.druid.data.input.ListBasedInputRow are in unnamed module of loader 'app')

Rename to avoid clash.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant