https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • s
    bin/pinot-admin.sh StartController -configFileName bin/controller.properties &
  • s
    i am not passing any credentials
  • m
    I guess that’s the issue?
  • s
    but even ui is not able to access
  • s
    u can check above screenshot
  • m
    Yeah because controller was configured to allow only the Admin user, so in requests it is expecting credentials for admin.
  • s
    Hi I am trying to create tenant in the pinot cluster, i am seeing below error, please help me to resolve it, i am using latest version of pinot (0.7.1) and running in cluster mode on vm’s
  • s
    Copy code
    bin/pinot-admin.sh AddTenant -name XXXXX -role BROKER -instanceCount 2 -exec
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:file:/opt/pinot/lib/pinot-all-0.7.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-file-system/pinot-s3/pinot-s3-0.7.1-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See <http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
    SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
    WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
    WARNING: An illegal reflective access operation has occurred
    WARNING: Illegal reflective access by org.apache.pinot.spi.plugin.PluginClassLoader (file:/opt/pinot/lib/pinot-all-0.7.1-jar-with-dependencies.jar) to method java.net.URLClassLoader.addURL(java.net.URL)
    WARNING: Please consider reporting this to the maintainers of org.apache.pinot.spi.plugin.PluginClassLoader
    WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
    WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
    WARNING: All illegal access operations will be denied in a future release
    Error: Option "-offlineInstanceCount" is required
  • s
    provided with required values and tried it but it didnt work for me
  • s
    followed the command from the below docs
    👋 1
  • s
  • r
    Is there any limit in Pinot to execute queries simentenoulsly. I.e. I have created a pipeline through pinot where we are ingesting data from Kafka topic and creating Pinot table.After that connecting from prestro using pinot-connector and in the last step connecting from superset and from there querying pinot table. Here I have generated 4 graphs using diff SQL queries and added all 4 in one dashboard.After sometime when I am trying refresh the dashboard page so it's firing 4 queries to Pinot and all are getting failed it's showing internal error couldn't reach host, and if I am refreshing one slice from the dashboard then it's working fine.i.e. when firing one query at a time. P.S. I am facing this issue when I have started pinot in cluster mode with 3 servers 2 controller and 2 broker. When I am doing the same using quick-start it's working fine and entire dashboard is loading/refreshing at same time.
  • r
    Pipeline steps. 1. Connection b/w pinot and Kafka. 2. Connection b/w Pinot and Prestro through Pinot-prestro Connector. 3. Connecting Superset with Pinot with the help of Prestro catalog. So here superset and pinot is communicating with the help of prestro.when I am submitting query is connecting to Pinot schema and table with the help of prestro.
  • x
    so are those queries directly against prestosql?
  • s
    enabled authorization in my setup, and successfully added schema, while trying to ingest data, i am getting below error. bin/pinot-admin.sh LaunchDataIngestionJob -jobSpecFile /home/sas/apache-pinot-incubating-0.8.0-SNAPSHOT-bin/examples/batch/airlineStats/ingestionJobSpec.yaml Got exception to kick off standalone data ingestion job - java.lang.RuntimeException: Failed to read from Schema URI - 'http://localhost:9000/tables/airlineStats/schema' at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.getSchema(SegmentGenerationUtils.java:87) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.init(SegmentGenerationJobRunner.java:144) ~[pinot-batch-ingestion-standalone-0.8.0-SNAPSHOT-shaded.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:140) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:113) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:132) [pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:164) [pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:184) [pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: http://localhost:9000/tables/airlineStats/schema at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1894) ~[?:1.8.0_212] at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) ~[?:1.8.0_212] at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.fetchUrl(SegmentGenerationUtils.java:231) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.getSchema(SegmentGenerationUtils.java:85) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] ... 6 more Exception caught: java.lang.RuntimeException: Failed to read from Schema URI - 'http://localhost:9000/tables/airlineStats/schema' at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.getSchema(SegmentGenerationUtils.java:87) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.init(SegmentGenerationJobRunner.java:144) ~[pinot-batch-ingestion-standalone-0.8.0-SNAPSHOT-shaded.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:140) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:113) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:132) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:164) [pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:184) [pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: http://localhost:9000/tables/airlineStats/schema at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1894) ~[?:1.8.0_212] at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) ~[?:1.8.0_212] at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.fetchUrl(SegmentGenerationUtils.java:231) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] at org.apache.pinot.common.segment.generation.SegmentGenerationUtils.getSchema(SegmentGenerationUtils.java:85) ~[pinot-all-0.8.0-SNAPSHOT-jar-with-dependencies.jar:0.8.0-SNAPSHOT-9becc57eec981d71d5b45af5da7b720840d18f17] ... 6 more
  • s
    can someone please help?
  • r
    Hello Everyone,I am trying to use hdfs as deepatorage for Pinot I followed all the steps which mentioned in pinot documents and everything worked fine.Then I have created pinot table and on pinot UI I am able to see the tables and segments. Now I am expecting that same segment should be available at the location also which we have mentioned as controller.data.dir (default.fs/hdfs dir) But here the directory is empty. Kindly suggest if I need to do anything else.
  • r
  • r
    @Xiang Fu @Akash
  • e
    Thread dump from jstack
    Thread dump from jstack
  • r
    It's showing this msg but data is not reflecting in table.
  • r
    This is the configuration file
  • r
    @Neha Pawar @Xiang Fu @Ken Krugler @Mayank @Elon
  • i
    hi ,I am wondering if this is https://docs.pinot.apache.org/users/user-guide-query/supported-transformations the comprehensive list of supported transformation function, I am looking for other functions like coalesce, is there a coming feature list
  • s
    HI @Mayank @Daniel Lavoie @Neha Pawar I got few questions on Pinot Restore Mechanism... Can offline tables be converted back to realtime after pushing the segments backup from offline table .. and the backup of realtime table that is stored in pinot .. can it be used to create an offline table means is it possible by any means to restore the realtime table data if gcp service account is changed and vpc is changed? Kindly help me out in figuring out restoration on realtime tables. Thanks in Advance. CC: @Sadim Nadeem @Mohamed Sultan @Manju Priyadharshini
  • r
    Hi, I have one hybrid table in pinot in tablename_OFFLINE table I have 250000 records and tablename_realtime I have total 2000 records. When I am doing select count from table it showing 252000 that is correct count. But when I am doing select * from tablename in superset for the same query. It's below error message.
  • r
    IMG_20210608_110126.jpg
  • r
    @Xiang Fu @Ken Krugler @Jackie kindly suggest is there any row limit in pinot.?
  • r
    This is the complete log
1...148149150...166Latest