I'm running HyperDX with an external ClickHouse and MongoDB setup. Our ClickHouse instance has the "force_index_by_date" setting enabled, which appears to conflict with some of the queries HyperDX runs.
For example, the following query does not include a time filter, which leads to a full table scan:
SELECT DISTINCT lowCardinalityKeys(arrayJoin(LogAttributes.keys)) AS key
FROM otel.otel_logs
LIMIT _CAST(1000, 'Int32')
FORMAT JSON
Is there a recommended way to address this without disabling force_index_by_date? We'd like to avoid full scans, especially given the volume of data we're working with.