Ambika
05/12/2021, 10:37 AMArun Vasudevan
05/12/2021, 9:32 PMsuperset
to Pinot using <pinot://pinot-broker:9000/query/sql?controller=http://pinot-controller:9000/>
But, I am getting the below error…
ERROR: (builtins.NoneType) None
(Background on this error at: <http://sqlalche.me/e/13/dbapi>)
Could anyone assist?Jonathan Meyer
05/14/2021, 10:47 AMSegment_1
& Segment_2
) -> Segment_3(date=01/01/2021, data=[DATA 1, DATA 2])
Or do we have to regenerate the 2 segments entirely ? (if so, we need to identify what they contain) - Possibly after merging them ?Mayank
Ken Krugler
05/14/2021, 10:24 PMRK
05/15/2021, 1:09 PMNitish Amnerkar
05/16/2021, 9:02 AMdocker run \
--network=pinot-demo \
--name thirdeye \
-p 1426:1426 \
-p 1427:1427 \
-d apachepinot/thirdeye:latest ephemeral
Giving this error
docker: invalid reference format.
See 'docker run --help'.
zsh: command not found: --network=pinot-demo
Please suggest how to proceed hereRK
05/17/2021, 5:06 PMSadim Nadeem
05/18/2021, 8:15 AMPhúc Huỳnh
05/19/2021, 2:28 AMRK
05/19/2021, 5:58 AMMachhindra
05/19/2021, 3:03 PMdocker run --network=pinot-demo --name pinot-quickstart -p 9000:9000 -d apachepinot/pinot:test QuickStart -type stream
Here is the exception in the log - SSL handshake failedCharles
05/20/2021, 1:38 AMJonathan Meyer
05/20/2021, 4:11 PM{'errorCode': 410, 'message': 'BrokerResourceMissingError'}
?
Got it from pinot-db
Python client
The query runs fine from the UI thoughMike Davis
05/20/2021, 9:57 PMCaught exception while gathering stats
org.apache.parquet.io.InvalidRecordException: NEW_FIELD_NAME not found in message schema {
ingestionConfig:
"ingestionConfig": {
"transformConfigs": [
{
"columnName": "NEW_FIELD_NAME",
"transformFunction": "fromEpochDays(OLD_FIELD_NAME)"
}
]
},
Elon
05/21/2021, 3:05 AMARRAY[1,2,3]
in a filter and a select and it didn't work.Manju Priyadharshini
05/21/2021, 7:47 AMeywek
05/21/2021, 9:01 AMLIMIT
on a table with 4.5 millions of rows,
When I’m doing this query:
SELECT * FROM datasource_609bc4f74e3c000300131110 ORDER BY "timestamp" ASC LIMIT 100000,10
I’m getting a result in ~2.5s, and I can see in the query response stats totalDocs=4794306
which is fine
But when I’m doing this one (offset 1 000 000 instead of 100 000):
SELECT * FROM datasource_609bc4f74e3c000300131110 ORDER BY "timestamp" ASC LIMIT 1000000,10
I’m getting no rows (which isn’t the expected behavior) in ~10s and the totalDocs is 569840
(which isn’t the expected behavior either?)
I have an hybrid table with segmentPruning by time
Do you have any idea why I’m having this kind of issue?
Thank youSyed Akram
05/21/2021, 10:32 AMPedro Silva
05/21/2021, 10:48 AMjava.lang.IllegalStateException: Cannot flatten value node: null
at shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:518) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.spi.utils.JsonUtils.flatten(JsonUtils.java:246) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.realtime.impl.json.MutableJsonIndex.add(MutableJsonIndex.java:71) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.indexsegment.mutable.MutableSegmentImpl.addNewRow(MutableSegmentImpl.java:631) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.indexsegment.mutable.MutableSegmentImpl.index(MutableSegmentImpl.java:475) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.processStreamEvents(LLRealtimeSegmentDataManager.java:497) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.consumeLoop(LLRealtimeSegmentDataManager.java:402) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
Because a given field comes with null default value:
"inputForUiControls" : "null",
It's schema definition is:
dimensionFieldSpecs: [,...., {
"name": "inputForUiControls",
"dataType": "STRING",
"maxLength": 2147483647
}]
Pedro Silva
05/21/2021, 2:35 PM2021/05/21 14:32:34.378 ERROR [SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel] [HelixTaskExecutor-message_handle_thread] Caught exception in state transition from OFFLINE -> ONLINE for resource: HitExecutionView_REALTIME, partition: HitExecutionView__12__21__20210520T1019Z
org.apache.pinot.core.segment.index.loader.V3UpdateIndexException: Default value indices for column: inputForUiControls cannot be updated for V3 format segment.
at org.apache.pinot.core.segment.index.loader.defaultcolumn.V3DefaultColumnHandler.updateDefaultColumn(V3DefaultColumnHandler.java:53) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.segment.index.loader.defaultcolumn.BaseDefaultColumnHandler.updateDefaultColumns(BaseDefaultColumnHandler.java:144) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.segment.index.loader.SegmentPreProcessor.process(SegmentPreProcessor.java:104) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.indexsegment.immutable.ImmutableSegmentLoader.load(ImmutableSegmentLoader.java:99) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.core.data.manager.realtime.RealtimeTableDataManager.addSegment(RealtimeTableDataManager.java:283) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.server.starter.helix.HelixInstanceDataManager.addRealtimeSegment(HelixInstanceDataManager.java:138) ~[pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.pinot.server.starter.helix.SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel.onBecomeOnlineFromOffline(SegmentOnlineOfflineStateModelFactory.java:164) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at sun.reflect.GeneratedMethodAccessor48.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_282]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_282]
at org.apache.helix.messaging.handling.HelixStateTransitionHandler.invoke(HelixStateTransitionHandler.java:404) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:331) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) [pinot-all-0.7.1-jar-with-dependencies.jar:0.7.1-afa4b252ab1c424ddd6c859bb305b2aa342b66ed]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_282]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
I've changed the default value of a String dimension field from "null"
to "{}"
troywinter
05/22/2021, 4:01 AMstream.kafka.hlc.bootstrap.server
, stream.kafka.hlc.zk.connect.string
, stream.kafka.zk.broker.url
is correct, but it’s not consuming.
2021/05/21 13:59:59.025 WARN [PinotRealtimeSegmentManager] [<http://ZkClient-EventThread-104-mse-93c7add0-zk.mse.aliyuncs.com:2181|ZkClient-EventThread-104-mse-93c7add0-zk.mse.aliyuncs.com:2181>] Caught exception while processing segment fetrace_biz2-pinot_0__0__1621605599020 for instance Server_pinot-server-2.pinot-server-headless.pinot.svc.cluster.local_8098, skipping.
java.lang.NullPointerException: null
at org.apache.pinot.controller.helix.core.realtime.PinotRealtimeSegmentManager.assignRealtimeSegmentsToServerInstancesIfNecessary(PinotRealtimeSegmentManager.java:247) [pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at org.apache.pinot.controller.helix.core.realtime.PinotRealtimeSegmentManager.processPropertyStoreChange(PinotRealtimeSegmentManager.java:304) [pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at org.apache.pinot.controller.helix.core.realtime.PinotRealtimeSegmentManager.handleDataChange(PinotRealtimeSegmentManager.java:405) [pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at org.apache.helix.manager.zk.zookeeper.ZkClient$7.run(ZkClient.java:1039) [pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at org.apache.helix.manager.zk.zookeeper.ZkEventThread.run(ZkEventThread.java:69) [pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
kauts shukla
05/22/2021, 3:18 PMPedro Silva
05/24/2021, 1:31 PMShailesh Jha
05/24/2021, 2:13 PMMayank
Jonathan Meyer
05/24/2021, 7:59 PM"-Infinity"
and the Web UI shows the sameSyed Akram
05/25/2021, 11:16 AMRK
05/25/2021, 1:01 PMMayank