https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • s
    Copy code
    {
  "OFFLINE": null,
  "REALTIME": {
    "serviceCallView__0__0__20200416T2055Z": {
      "Server_pinot-server-2.pinot-server.traceable.svc.cluster.local_8098": "CONSUMING"
    },
    "serviceCallView__1__0__20200416T2055Z": {
      "Server_pinot-server-3.pinot-server.traceable.svc.cluster.local_8098": "CONSUMING"
    }
  }
}
  • s
    controller-2.log,controller-1.log,controller-0.log
    controller-1.logcontroller-2.logcontroller-0.log
  • x
    hmm
  • x
    do you have broker logs
  • n
    did you try broker restart?
  • s
    broker-2.log,broker-1.log,broker-0.log
    broker-1.logbroker-0.logbroker-2.log
  • s
    yes tried restarting all - controllers, brokers and servers
  • x
    Copy code
    2020/04/16 21:29:37.162 WARN [ClientCnxn] [main-SendThread(zookeeper.traceable.svc.cluster.local:2181)] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
<http://java.net|java.net>.ConnectException: Connection refused
	at <http://sun.nio.ch|sun.nio.ch>.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_212]
	at <http://sun.nio.ch|sun.nio.ch>.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) ~[?:1.8.0_212]
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) ~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144) ~[zookeeper-3.4.11.jar:3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0]
2020/04/16 21:29:38.326 INFO [HelixBrokerStarter] [main] Setting up broker server builder
Apr 16, 2020 9:29:39 PM org.glassfish.grizzly.http.server.NetworkListener start
INFO: Started listener bound to [0.0.0.0:8099]
Apr 16, 2020 9:29:39 PM org.glassfish.grizzly.http.server.HttpServer start
INFO: [HttpServer] Started.
2020/04/16 21:29:40.207 INFO [HelixBrokerStarter] [main] Initializing cluster change mediator
2020/04/16 21:29:40.792 INFO [HelixBrokerStarter] [main] Connecting participant Helix manager
2020/04/16 21:29:40.867 WARN [ParticipantHealthReportTask] [main] ParticipantHealthReportTimerTask already stopped
2020/04/16 21:29:41.301 WARN [CallbackHandler] [main] Callback handler received event in wrong order. Listener: org.apache.helix.messaging.handling.HelixTaskExecutor@2bc378f7, path: /traceable-views/INSTANCES/Broker_pinot-broker-1.pinot-broker.traceable.svc.cluster.local_8099/MESSAGES, expected types: [CALLBACK, FINALIZE] but was INIT
2020/04/16 21:29:41.365 INFO [HelixBrokerStarter] [main] Registering service status handler
2020/04/16 21:29:41.376 INFO [HelixBrokerStarter] [main] Finish starting Pinot broker
2020/04/16 21:29:41.972 WARN [ConfigAccessor] [ZkClient-EventThread-33-zookeeper:2181/pinot] No config found at /traceable-views/CONFIGS/RESOURCE/brokerResource
2020/04/16 21:29:42.591 ERROR [BaseRoutingTableBuilder] [HelixTaskExecutor-message_handle_thread] Found no server hosting segment serviceCallView__1__0__20200416T2055Z for table serviceCallView_REALTIME
2020/04/16 21:29:42.595 ERROR [BaseRoutingTableBuilder] [HelixTaskExecutor-message_handle_thread] Found no server hosting segment rawServiceView__1__0__20200416T1802Z for table rawServiceView_REALTIME
  • x
    could you check if zookeeper is up?
  • x
    seems that pinot cannot talk to zk
  • x
    hmm
  • x
    but helix can still return the map of segments…
  • s
    yes it is up
  • s
    zookeeper-0 1/1 Running 0 41d zookeeper-1 1/1 Running 0 42d zookeeper-2 1/1 Running 0 41d
  • s
    i'm able to access zkui and look at metadata
  • x
    got it
  • x
    can you try to restart one broker, say broker-0
  • x
    to see what’s the logs
  • s
    after restart
    broker-0.log
  • x
    still the same?
  • s
    yea
  • s
    i can bounce zk
  • x
    can you port forward to broker-0
  • x
    of port 8099
  • x
    see localhost:8099/help
  • s
    ok am in
  • p
    Hi here, Facing unavailable segments with errorCode:305 for many tables, what could be reason for this?
    m
    • 2
    • 1
  • a
    Hi Pinot community, Is there any way we can download the query results in the excel or csv format through api or cli? Any input would be welcome!
    a
    l
    • 3
    • 12
  • s
    Hi team, I am trying to understand how does Pinot query execution decide the relative ordering of various filters in a given query? Tried to explain plan for the following query:
    Copy code
    explain plan for
select span_id from eventView
	where REGEXP_LIKE(request_url,'<http://example.com|example.com>')
	AND environment = 'production'
	AND api_id != 'null'
	AND start_time_millis > 1689187672000
	limit 100
    The output is attached. As per the doc https://docs.pinot.apache.org/users/user-guide-query/explain-plan, Pinot will run the operators bottom-up in the operator tree. That means Pinot will first execute REGEXP_LIKE (operator_id 10) that involves full scan, and then its output will be used for executing the other 2 inverted indexes (operator_id 9 and 8 ). Is this the correct interpretation? Ideally, it is expected that Pinot should perform costly full scans as the last thing, after applying all inverted indexes that will give the minimal docIdSet. Is there a way to alter the ordering sequence of various filter expressions? Thanks in advance.
  • d
    Hi team! I have a question on how to overcome the following issue on my hybrid table. I have created an star tree index on both my OFFLINE and REALTIME tables that works great if I query them directly. The issue is that if I query using only the table name the index is not used. I think that's because of the time boundary that is implicit added in the query. Our timeColumn is in ms so we are not adding it to the star tree index but that query is translated to 2 distinct calls to both tables filtering by our time column that is not present on the star tree. Im not seeing an easy way to overcome this and use the ST index on the hybrid table.
    j
    • 2
    • 6
1...858687...166Latest