Skip to content

Avro encoding error message lacks detail. #24046

@jsonbrooks

Description

@jsonbrooks

Right now, I'm seeing some errors using the gcp_pubsub sink indicating it's having trouble encoding a few logs to avro. I have a lot of fields and I have no idea which it's having a problem with. It would be nice if it either:

A. Showed me which field the problem is with.
OR
B. Showed me the log that the problem was with. Is there any way to do this anyway, by the way? Just logging every message to the console would be far too many. I'd like a way to just see which ones are giving me errors.

This is the error message btw:

2025-10-22T16:37:26.094948Z ERROR sink{component_kind="sink" component_id=logs_bq_mim_to_pubsub component_type=gcp_pubsub}: vector::internal_events::codecs: Failed serializing frame. error=Could not find matching type in union error_code="encoder_serialize" error_type="encoder_failed" stage="sending" internal_log_rate_limit=true |  

Metadata

Metadata

Assignees

No one assigned

    Labels

    domain: codecsAnything related to Vector's codecs (encoding/decoding)type: enhancementA value-adding code change that enhances its existing functionality.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions