Channels
test-channel-bot
pw-pinot
debug_upsert
feat-presto-connector
pinot-helix
troubleshooting
pinot-sketches
resources
roadmap
discuss-validation
minion-improvements
community
config-tuner
test-channel
fix-numerical-predicate
kinesis_help
pinot-perf-tuning
feat-partial-upsert
pinot_website_improvement_suggestions
segment-write-api
releases
devrel
pinot-trino
pinot-k8s-operator
release-certifier
udf-type-matching
transform-functions
release060
latency-during-segment-commit
feat-text-search
pinot-realtime-table-rebalance
inconsistent-segment
feat-rt-seg-complete
pinot-power-bi
flink-pinot-connector
pinotadls
twitter
minion-star-tree
pinot-rack-awareness
jobs
fix_llc_segment_upload
metrics-plugin-impl
linen_dev
complex-type-support
pinot-s3
feat-geo-spatial-index
feat-compound-types
v2_engine_beta_feedback
inconsistent-perf
metadata-push-api
feat-pravega-connector
enable-generic-offsets
announcements
feat-upsert
multiple_streams
feat-better-schema-evolution
fraud
onboarding
docs
aggregators
query-latency
s3-multiple-buckets
presto-pinot-connector
multi-region-setup
apa-16824
events
segment-cold-storage
odsc-europe-2022-workshop
bangalore-meetups
new-office-space
lp-pinot-poc
time-based-segment-pruner
group-by-refactor
pql-sql-regression
random
custom-aggregators
order-by
pinot-website
qps-metric
product-launch
dhill-date-seg
thirdeye-pinot
introductions
pinot-dev
getting-started
pinot-docsrus
daily-digest
general
Powered by
#troubleshooting
Title
e
Elon
08/05/2020, 11:01 PM
Also, noticed that we can't do text_match until the text index is created, looks like the latency could be up to 30 mins
s
Sidd
08/05/2020, 11:17 PM
Are the text_match queries returning empty results or taking long time to return response?
e
Elon
08/05/2020, 11:17 PM
Empty results, let me retry now, just to make sure
s
Sidd
08/05/2020, 11:20 PM
empty results could be due to the refresh lag.. realtime index reads the index snapshot and a background thread refreshes the snapshot periodically
how many realtime segments are there that are having text index and how many columns with text index per segment
the refresh threshold is configurable but currently it is hardcoded to 10ms
so that shouldn't lead to empty results
with refresh happening every 10ms, ideally you should see increasing number of hits/matches
also, what is the 30min latency?
e
Elon
08/05/2020, 11:23 PM
So 2 columns for text index
for the latency, do you mean the jmx counter?
s
Sidd
08/05/2020, 11:25 PM
No, I wanted to understand if you meant that queries are taking 30mins to return response
e
Elon
08/05/2020, 11:25 PM
Oh, no:) They return super fast
s
Sidd
08/05/2020, 11:25 PM
you said
"looks like the latency could be up to 30 mins"
ok got it
we need to improve the lag I guess
Post