Abhijeet Kushe
04/29/2022, 1:09 AMAlice
04/29/2022, 8:43 AMSaumya Upadhyay
04/29/2022, 10:55 AMLuis Fernandez
04/29/2022, 2:20 PMYoung Seok (Tony) Kim
04/29/2022, 8:03 PM0.11.0-SNAPSHOT
instead. (I got some runtime issues - Class not found exception).
Does anyone know how can I find the 0.11.0-snapshot binary?Jinal Panchal
05/02/2022, 12:43 PMDiogo Baeder
05/02/2022, 1:53 PMRyan Ruane
05/03/2022, 1:39 PMINT_ARRAY
, FLOAT_ARRAY
, TIMESTAMP_ARRAY
, etc. I have found that I can ingest using JSON all types as multi-valued dimension columns with the exception of BOOLEAN
, TIMESTAMP
, and BYTES
. I believe that JSON_ARRAY
isn't a valid type, but I wasn't sure about BYTES_ARRAY
. If anyone is about and can shed some light, I would be very appreciative. More info present in-threadTao Hu
05/03/2022, 6:49 PMGROUP BY with FILTER clauses is not supported
Do we have any plans to support FILTER clause with group by? And for now is there any workaround if I want to filter my aggregations in a group by query? ThanksNikhil Varma
05/05/2022, 5:30 AMDiogo Baeder
05/05/2022, 9:12 PMKevin Xu
05/06/2022, 2:49 AMDiogo Baeder
05/06/2022, 1:49 PMRebecca Lau
05/06/2022, 4:25 PMjava.lang.IllegalArgumentException: newLimit > capacity: (604 > 28)\n\tat java.base/java.nio.Buffer.createLimitException(Buffer.java:372)\n\tat java.base/java.nio.Buffer.limit(Buffer.java:346)\n\tat java.base/java.nio.ByteBuffer.limit(ByteBuffer.java:1107)\n\tat java.base/java.nio.MappedByteBuffer.limit(MappedByteBuffer.java:235)\n\tat java.base/java.nio.MappedByteBuffer.limit(MappedByteBuffer.java:67)\n\tat org.apache.pinot.segment.spi.memory.PinotByteBuffer.view(PinotByteBuffer.java:303)\n\tat org.apache.pinot.segment.spi.memory.PinotDataBuffer.view(PinotDataBuffer.java:379)\n\tat org.apache.pinot.segment.local.segment.index.readers.forward.BaseChunkSVForwardIndexReader.<init>(BaseChunkSVForwardIndexReader.java:97)\n\tat org.apache.pinot.segment.local.segment.index.readers.forward.FixedByteChunkSVForwardIndexReader.<init>(FixedByteChunkSVForwardIndexReader.java:37)\n\tat org.apache.pinot.segment.local.segment.index.readers.DefaultIndexReaderProvider.newForwardIndexReader(DefaultIndexReaderProvider.java:97)\n\tat org.apache.pinot.segment.spi.index.IndexingOverrides$Default.newForwardIndexReader(IndexingOverrides.java:184)\n\tat org.apache.pinot.segment.local.segment.index.column.PhysicalColumnIndexContainer.<init>(PhysicalColumnIndexContainer.java:166)\n\tat org.apache.pinot.segment.local.indexsegment.immutable.ImmutableSegmentLoader.load(ImmutableSegmentLoader.java:181)\n\tat org.apache.pinot.segment.local.indexsegment.immutable.ImmutableSegmentLoader.load(ImmutableSegmentLoader.java:121)\n\tat org.apache.pinot.segment.local.indexsegment.immutable.ImmutableSegmentLoader.load(ImmutableSegmentLoader.java:91)\n\tat org.apache.pinot.core.data.manager.offline.OfflineTableDataManager.addSegment(OfflineTableDataManager.java:52)\n\tat org.apache.pinot.core.data.manager.BaseTableDataManager.addOrReplaceSegment(BaseTableDataManager.java:373)\n\tat org.apache.pinot.server.starter.helix.HelixInstanceDataManager.addOrReplaceSegment(HelixInstanceDataManager.java:355)\n\tat org.apache.pinot.server.starter.helix.SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel.onBecomeOnlineFromOffline(SegmentOnlineOfflineStateModelFactory.java:162)\n\tat jdk.internal.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.apache.helix.messaging.handling.HelixStateTransitionHandler.invoke(HelixStateTransitionHandler.java:404)\n\tat org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:331)\n\tat org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97)\n\tat org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\n
@Luis Fernandez and I were wondering what this capacity
value (28, according to the trace) might be?
thanks!Prashant Pandey
05/06/2022, 5:50 PMcontroller.host
in controller config for a k8s deployment? I am deploying Pinot to a new env and leaving this field empty results in a NPE during controller startup:
java.lang.NullPointerException: null
at org.apache.pinot.common.utils.helix.HelixHelper.updateHostnamePort(HelixHelper.java:550) ~[pinot-all-0.9.3-jar-with-dependencies.jar:0.9.3-e23f213cf0d16b1e9e086174d734a4db868542cb]
at org.apache.pinot.controller.BaseControllerStarter.updateInstanceConfigIfNeeded(BaseControllerStarter.java:607) ~[pinot-all-0.9.3-jar-with-dependencies.jar:0.9.3-e23f213cf0d16b1e9e086174d734a4db868542cb]
at org.apache.pinot.controller.BaseControllerStarter.registerAndConnectAsHelixParticipant(BaseControllerStarter.java:583) ~[pinot-all-0.9.3-jar-with-dependencies.jar:0.9.3-e23f213cf0d16b1e9e086174d734a4db868542cb]
at org.apache.pinot.controller.BaseControllerStarter.setUpPinotController(BaseControllerStarter.java:382) ~[pinot-all-0.9.3-jar-with-dependencies.jar:0.9.3-e23f213cf0d16b1e9e086174d734a4db868542cb]
Ryan Persaud
05/06/2022, 10:07 PM./bin/pinot-admin.sh QuickStart -type batch
. I can see a log entry for the the table being added, and no obvious errors:
Adding offline table: baseballStats
Executing command: AddTable -tableConfigFile /var/folders/jv/g99n5jcj3hz0lbbf90gykcc40000gq/T/1651874628141/baseballStats_1651874628195.config -schemaFile /var/folders/jv/g99n5jcj3hz0lbbf90gykcc40000gq/T/1651874604715/baseballStats/baseballStats_schema.json -controllerProtocol http -controllerHost localhost -controllerPort 9000 -user null -password [hidden] -exec
but I do not see the table via the UI (please see screenshot). Is there an additional step that I need to take in order to see the table? Thanks!
Not sure if it's relevant, but here is some version information:
Java: openjdk 11.0.15 2022-04-19
pinot: pinot-0.10.0
Diogo Baeder
05/08/2022, 3:11 AM/ingestFromURI
endpoint from the Controller API to ingest a file as a segment, but defining the segment name myself? I tried passing segment.name
to the batchConfigMapStr
parameter JSON, but it didn't work, the Controller ends up creating the segment name by itself. I'd like to have more control over this, because I want to be able to more easily replace segments.Deepak Mishra
05/09/2022, 11:05 AMPrashant Pandey
05/09/2022, 11:27 AMLuis Fernandez
05/09/2022, 3:08 PM"numServersQueried": 4,
but i only have 2 servers o.O ?Tiger Zhao
05/09/2022, 6:41 PMrealtime.segment.flush.threshold.rows
for my realtime tables. It seems that the actual number of rows per segment becomes some value smaller than the value I set. For example, I'll set this to 1000000, but in the segment metadata, segment.flush.threshold.size
would be 500000 and the segment does only ingest 500000 rows. This seems to only happen for some tables, and sometimes it is shrunk by a factor 2 or 4. Just wondering if there is any other setting I'm missing that is causing this?Luis Fernandez
05/09/2022, 6:48 PMabhinav wagle
05/09/2022, 9:35 PMDeepak Mishra
05/10/2022, 3:55 AMLuis Fernandez
05/10/2022, 3:55 PM{"serve_time":1623110400.00000000,"p_id":8.0476135E7,"u_id":6047599.0,"i_count":1}
{"serve_time":1623110400.00000000,"p_id":8.1923416E7,"u_id":5407252.0,"i_count":1,"c_count":1,"c":17}
we endup having this exception for some of the files:
2022/05/10 15:48:19.314 ERROR [SegmentGenerationJobRunner] [pool-2-thread-1] Failed to generate Pinot segment for file - <gs://rb>
lau_tmp/raw_data/date=2020-07-25/part-00168-c741f867-338d-4c84-afaf-428f85c14088.c000.json
java.lang.RuntimeException: Unexpected end-of-input within/between Object entries
do you know why we may end up getting these errors?George He
05/11/2022, 6:29 AMLastWithTime
function to get the latest data of each group. But unfortunately I got NPE exception. Original intention is to get the top N of a group after group by ad hoc column. Wondering if I have a grammar issue of my PQL:
select hostname, lastWithTime('alertId', 'issued', 'STRING') from uas_nomalized_alert
where JSON_EXTRACT_SCALAR(attributes, '$.graphQL-businessService', 'STRING', '') = 'Meeting Centers'
group by hostname
alertId
is a 'STRING' column, issued
is a 'TIMESTAMP' columnFizza Abid
05/11/2022, 6:44 AMFizza Abid
05/11/2022, 6:45 AMAlice
05/11/2022, 8:27 AMMarium Faheem
05/11/2022, 8:50 AM{"code":403,"error":"Permission is denied for access type 'READ' to the endpoint '<http://controller.com/tables>'"}
Any idea how to resolve ?