Filter cache statistics

Records core-specific filter cache statistics over time.

Record core-specific filter cache statistics over time.

Note: All statistics reset upon node restart.

This table is configured with gc_grace_seconds 0 to avoid issues with persistent tombstones as rows expire; tombstones are removed during compaction no matter how recently they were created.

Solr exposes a core’s filter cache statistics through its registered index searcher, but the core may have many index searchers over its lifetime. To reflect this, statistics are provided for the currently registered searcher as well as cumulative/lifetime statistics.

If the dseFilterCache hit_ratio declines over time, and this hit_ratio decline corresponds to a higher average latency from the QueryMetrics.getAverageLatency(EXECUTE, null) MBean, consider increasing the size of your filter cache in the search index config.

JMX analog

solr/core/dseFilterCache/com.datastax.bdp.search.solr.FilterCacheMBean

Schema

CREATE TABLE dse_perf.solr_filter_cache_stats (
  node_ip inet,
  core text,
  date timestamp,
  time timestamp,
  hits bigint,
  inserts bigint,
  evictions bigint,
  hit_ratio float,
  lookups bigint,
  num_entries bigint,
  cumulative_lookups bigint,
  cumulative_hits bigint,
  cumulative_hitratio float,
  cumulative_inserts bigint,
  cumulative_evictions bigint,
  warmup_time bigint,
  PRIMARY KEY ((node_ip, core, date), time)
)
WITH gc_grace_seconds=0
FieldTypePurpose
node_ipinetNode IP address.
coretextSearch core name, such as keyspace.table.
datetimestampMidnight on the mm/dd/yyyy the statistics were recorded.
timetimestampThe exact time the statistics were recorded.
hitsbigintCache hits for the registered index searcher.
insertsbigintCache insertions for the registered index searcher.
evictionsbigintCache evictions for the registered index searcher.
hit_ratiofloatThe ratio of cache hits/lookups for the registered index searcher.
lookupsbigintCache lookups for the registered index searcher.
num_entriesbigintNumber of cache entries for the registered index searcher.
cumulative_lookupsbigintCumulative cache lookups for the core.
cumulative_hitsbigintCumulative cache hits for the core.
cumulative_hitratiofloatCumulative ratio of cache hits/lookups for the core.
cumulative_insertsbigintCumulative cache inserts for the core.
cumulative_evictionsbigintCumulative cache evictions for the core.
warmup_timebigintWarm-up time for the registered index searcher.

Snapshots for cumulative statistics recorded on 10/17/2014 for core “keyspace.table” on the node 127.0.0.1:

SELECT cumulative_lookups, cumulative_hits, cumulative_hitratio, cumulative_inserts
FROM solr_filter_cache_stats 
WHERE node_ip = '127.0.0.1' AND core = 'keyspace.table' AND date = '2014-10-17';

Most recent 5 snapshots recorded on 10/17/2014 for core keyspace.table on the node 127.0.0.1:

SELECT *  
FROM solr_filter_cache_stats
WHERE node_ip = '127.0.0.1'
    AND core = 'keyspace.table' 
    AND date = '2014-10-17'
ORDER BY time DESC 
LIMIT 5;