https://pinot.apache.org/ logo
Join Slack
Powered by
So when I run the below query, it keeps returning ...
# troubleshooting
r
So when I run the below query, it keeps returning 100000.
Copy code
select count(*) from table
Also, the segments are not getting pushed to the s3 bucket after the threshold.
m
I am working on a similar issue. In my case looking at the server log showed that it was failing to parse some date fields so it did not know what segment to put the records into. Look in the server log for segment create errors.
r
Yes I checked the log and this is what I see
Copy code
Could not build segment
java.lang.IllegalArgumentException: Invalid format: "1609459439000" is malformed at "9000"
Figuring out this
m
What format did you list in your time field schema?
r
Copy code
{
      "name": "dateCreated",
      "dataType": "TIMESTAMP",
      "format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd HH:mm:ss",
      "granularity": "1:SECONDS"
the date format from the msg: 2021-10-26 070231.
I ran the below query
Copy code
select * from rakesh_test where dateCreated=1609459439000
the value is
Copy code
2021-01-01 00:03:59.0
I don't see any issue with the date and no idea why it fails
m
Datatype TIMESTAMP means a numeric timestamp. I think you need "dataType":"STRING" for a string time value.
r
Got it Let me try that
it worked!! Thanks for suggesting the change
m
Glad it worked. Still trying to get mine working.
r
Is it the same date issue ?
m
Mine was date formatting for ISO with the T in the middle. But, past that and hitting other odd behavior.
r
hmmm is the segment getting created ?
For me even though the segment got created, the table is not consuming the new records Im figuring out
m
After fixing the date issue, no errors reported but the UI is sluggish and it shows NaN as record count and status "BAD" in the table UI.
r
May be someone in this channel can give a try
m
They have been very helpful, but the one I was talking to is getting on a plane.
r
hmmm
Open in Slack
PreviousNext
Powered by