[FEATURE] JSON or String Metadata

[Samoed]

Is your feature request related to a problem? Please describe.

Currently, only TermsMetadata, IntMetadata, and FloatMetadata are available, which is quite limited. It would be great to have the option to add more types of metadata for greater flexibility.

Describe the solution you'd like

I suggest adding String and/or Json metadata fields.

Describe alternatives you've considered

No response

Additional context

Mention of JSON metadata was here #5425

[davidberenstein1957]

Hi @Samoed we have not included this because of bloated indexes in elastic that we might create in elastic without type constraints. You could still do allow_extra_metadata=True but this doesn't enable search.

[Samoed]

Yes, I missed it! Thanks

[Samoed]

I've replied to wrong issue. I understand that this can bloat search, but I want somehow to store some additional information about records and see it in UI/get from python. The only metntion of allow_extra_metadata is:

You can also set the allow_extra_metadata argument in the dataset to True to specify whether the dataset will allow metadata fields in the records other than those specified under metadata. Note that these will not be accessible from the UI for any user, only retrievable using the Python SDK.

But this not providing examples how to use it.

[davidberenstein1957]

@Samoed this allows you to just upload arbirary metadata along with records, however, the data will not be available for search or visisible for annotators. It is more used for storage.

You could also choose to add another TextField or CustomField to store information, which should be available for search.