https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • s
    hey all, is there a pipeline to load the segments(purged from server due to exceeding retention period) from segment store to server?
  • x
    if the data are locally accessible
    👍 1
  • x
  • x
    to load them
  • x
  • x
    change 
    jobType
    to 
    SegmentTarPush
  • x
    just ensure that you extend the retention period
  • s
    Thanks a lot @User, I'll go through the links and come back to you
  • p
    Hi All, When I run the below command to start streaming my github events into the kafka topic , I get the below error. Command : bin/pinot-admin.sh StreamGitHubEvents -topic pullRequestMergedEvents -personalAccessToken <token> -kafkaBrokerList localhost:19092 -schemaFile examples/stream/githubEvents/pullRequestMergedEvents_schema.json Error : Error: “StreamGitHubEvents” is not a valid value for “<subCommand>” . Can anyone help me in identifying issue over here ? Thank you.
  • n
    are you using the source code or the release @User?
  • n
    this is not part of the release
  • p
  • p
    I am using the release code.
  • n
    this recipe did not make it to the release. can you try building from source?
  • x
    or you can use the latest docker image
  • x
    docker pull apachepinot/pinot:latest
  • p
    Sure. I will try both.
  • p
    Thank you.
  • p
    I was able to build and run it from the source code. It works fine now. Thank you so much for helping out @User and @User.
    👍 1
  • n
    good to know!
  • d
    I'm hitting a bug with the Pinot Presto connector. I'll execute a query that joins a Pinot table with a MySQL table. Here's the query and the exception behind hit. I'm using the connector that is built into prestodb.
    Copy code
    with stats as (select customer_id as stats.customer_id, sum(cost) as cost from pinot.default.events where customer_id = 1 group by customer_id having (sum(cost) > 1000000)) select customer_id, costfrom mysql.mydb.customers left join stats on (customers.platform_id = stats.customer_id) group by customer_id, cost having cost > 100000;
    Copy code
    2020-04-26T21:04:28.305-0700	ERROR	SplitRunner-90-110	com.facebook.presto.execution.executor.TaskExecutor	Error processing Split 20200426_172458_02320_jaurt.3.0.0-0 PinotSplit{connectorId=pinot, splitType=BROKER, segmentPql=Optional.empty, brokerPql=Optional[GeneratedPql{pql=SELECT sum(cost) FROM events_testing WHERE (customer_id = 1) GROUP BY platform_id TOP 10000, table=events, expectedColumnIndices=[0, 1], groupByClauses=1, haveFilter=true, isQueryShort=true}], segments=[], segmentHost=Optional.empty} (start = 1.299608117031976E9, wall = 0 ms, cpu = 0 ms, wait = 0 ms, calls = 1)
java.lang.ArrayIndexOutOfBoundsException: 1
	at com.facebook.presto.spi.PageBuilder.getBlockBuilder(PageBuilder.java:109)
	at com.facebook.presto.pinot.PinotBrokerPageSource.getNextPage(PinotBrokerPageSource.java:222)
	at com.facebook.presto.operator.ScanFilterAndProjectOperator.processPageSource(ScanFilterAndProjectOperator.java:272)
	at com.facebook.presto.operator.ScanFilterAndProjectOperator.getOutput(ScanFilterAndProjectOperator.java:237)
	at com.facebook.presto.operator.Driver.processInternal(Driver.java:379)
	at com.facebook.presto.operator.Driver.lambda$processFor$8(Driver.java:283)
	at com.facebook.presto.operator.Driver.tryWithLock(Driver.java:675)
	at com.facebook.presto.operator.Driver.processFor(Driver.java:276)
	at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:1077)
	at com.facebook.presto.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:162)
	at com.facebook.presto.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:545)
	at com.facebook.presto.$gen.Presto_0_232_cc1019c____20200426_032927_1.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
  • k
    Does the query work when run on Pinot directly
    Copy code
    SELECT sum(cost) FROM events_testing WHERE (customer_id = 1) GROUP BY platform_id TOP 10000
  • m
  • d
    i heavily use aggregations so i am trying to undersatand if pinot can work good for my needs..basically i slices my data to calculate cumulative sum for example, calculate the drawdown of the prices (i am working with financial timeseries right now)
  • d
    yeah i am thinking to start with docker to test it quickly
  • d
    hello everybody, someone is having problem with the doc?
  • d
  • d
    now yes, it is slow but i can see it
  • d
    thanks
  • d
    A brief update on the Pinot Presto 
    TOP
    issue, switching to image 
    apachepinot/pinot-presto:0.234.3
    fixed the issue.
    👍 1
1...126127128...160Latest