-
Notifications
You must be signed in to change notification settings - Fork 25.3k
Open
Labels
:Analytics/Compute EngineAnalytics in ES|QLAnalytics in ES|QL:StorageEngine/MappingThe storage related side of mappingsThe storage related side of mappings>enhancementTeam:AnalyticsMeta label for analytical engine team (ESQL/Aggs/Geo)Meta label for analytical engine team (ESQL/Aggs/Geo)Team:StorageEngine
Description
Today when reading stored fields in compute engine the https://github.com/elastic/elasticsearch/blob/31c2594bb96d47748b29ee923706312b01fd547e/server/src/main/java/org/elasticsearch/index/fieldvisitor/StoredFieldLoader.java#L208
gets used via:
elasticsearch/server/src/main/java/org/elasticsearch/index/fieldvisitor/StoredFieldLoader.java
Line 208 in 31c2594
this.visitor = new CustomFieldsVisitor(fields, loadSource); |
This has a number of inefficiencies when loading ignored source for all documents that match the query. Like interacting with hash map / hash set / parsing id when a document is processed. This is ok in the context of the fetch phase in search api, however in the context of loading ignored source in esql not.

Looks like ~10% can be improved here.
Metadata
Metadata
Assignees
Labels
:Analytics/Compute EngineAnalytics in ES|QLAnalytics in ES|QL:StorageEngine/MappingThe storage related side of mappingsThe storage related side of mappings>enhancementTeam:AnalyticsMeta label for analytical engine team (ESQL/Aggs/Geo)Meta label for analytical engine team (ESQL/Aggs/Geo)Team:StorageEngine