https://pinot.apache.org/ logo
Join Slack
Powered by
Hello guys, any ideas why pinot isnt reading all m...
# troubleshooting
g
Hello guys, any ideas why pinot isnt reading all messages from my kafka topic? According to the logs, it has reached the 3815366 offset , which is the amount of messages I have. However, when I query them on pinot, i got only 3794657
Copy code
pinot-server_1  | Consumed 0 events from (rate:0.0/s), currentOffset=3815366, numRowsConsumedSoFar=590061, numRowsIndexedSoFar=577470
m
Offsets are not necessarily contiguous, right? If so, how did you ensure the number of messages?
g
im counting them in ksqldb
m
Ok. Can you check the logs for any messages that were dropped due to schema mismatch etc
And also is this a realtime only table or a hybrid table?
g
realtime
got it `
Copy code
2021/09/23 02:57:17.146 ERROR [LLRealtimeSegmentDataManager_crs__0__7__20210923T0256Z] [crs__0__7__20210923T0256Z] Caught exception while transforming the record: {
  "fieldToValueMap" : {
    "TS_MS" : 1632087338018,
    "CURRENCY_ID" : 1,
    "SUCCESS" : "true",
    "AMOUNT_AUTHORIZED" : -168.0,
    "EXCHANGE_RATE" : 3.713,
    "HA__ID" : 90163974,
    "SERVICE_MODEL_ID" : 1,
    "STATE_T_T" : 1616475600000,
    "V_CRS__ID" : 24,
    "PR__ID" : 1,
    "HA_T" : "2021-03-23T15:54:31.756192Z",
    "STATE_T" : "2021-03-23T05:00:00Z",
    "V_LOG_CR__ID" : 21828011,
    "ST__ID" : 2820,
    "PAYMENT_NET" : -168.0,
    "AMOUNT" : -168.0,
    "PG_CLASS" : 1,
    "AUTO_APTURE" : null,
    "HA_T_T" : null
  },
  "nullValueFields" : [ ]
}
java.lang.IllegalStateException: Caught exception while invoking method: public static long org.apache.pinot.common.function.scalar.DateTimeFunctions.fromDateTime(java.lang.String,java.lang.String) with arguments: [2021-03-23T15:54:31.756192Z, yyyy-MM-dd'T'HH:mm:ssZ]
        at org.apache.pinot.common.function.FunctionInvoker.invoke(FunctionInvoker.java:131) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.segment.local.function.InbuiltFunctionEvaluator$FunctionExecutionNode.execute(InbuiltFunctionEvaluator.java:120) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.segment.local.function.InbuiltFunctionEvaluator.evaluate(InbuiltFunctionEvaluator.java:87) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.segment.local.recordtransformer.ExpressionTransformer.transform(ExpressionTransformer.java:96) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.segment.local.recordtransformer.CompositeTransformer.transform(CompositeTransformer.java:83) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.processStreamEvents(LLRealtimeSegmentDataManager.java:514) [pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.consumeLoop(LLRealtimeSegmentDataManager.java:417) [pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager$PartitionConsumer.run(LLRealtimeSegmentDataManager.java:564) [pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.lang.reflect.InvocationTargetException
        at jdk.internal.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.apache.pinot.common.function.FunctionInvoker.invoke(FunctionInvoker.java:128) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        ... 8 more
Caused by: java.lang.IllegalArgumentException: Invalid format: "2021-03-23T15:54:31.756192Z" is malformed at ".756192Z"
        at org.joda.time.format.DateTimeParserBucket.doParseMillis(DateTimeParserBucket.java:187) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.joda.time.format.DateTimeFormatter.parseMillis(DateTimeFormatter.java:826) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.common.function.DateTimePatternHandler.parseDateTimeStringToEpochMillis(DateTimePatternHandler.java:37) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at org.apache.pinot.common.function.scalar.DateTimeFunctions.fromDateTime(DateTimeFunctions.java:264) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
        at jdk.internal.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) ~[?:?]
        at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
        at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
        at org.apache.pinot.common.function.FunctionInvoker.invoke(FunctionInvoker.java:128) ~[pinot-all-0.9.0-SNAPSHOT-jar-with-dependencies.jar:0.9.0-SNAPSHOT-11f8550b9b2881ede4d105416ed970a5dd708463]
apparently some records are with another time format
m
Yeah that would explain the missing records
Open in Slack
PreviousNext
Powered by