This message was deleted.

Hey @Xarvis I've been able to find this to help with this. I haven't tried this myself since I don't have a Kafka cluster set up right now.

"timestampSpec": {
  "column": "lead_datetime",
  "format": "posix"
}
Make this change and restart your ingestion task. Your __time column should now correctly reflect the full timestamp with the proper minutes, seconds, and milliseconds derived from the lead_datetime field.

Keep in mind that you need to submit a modified supervisor spec and not just modify in place, as existing supervisors do not automatically pick up changes. You may need to stop the existing supervisor and submit the new spec.

if it's

millis

use

millis

(

posix

is for seconds) although, you should also check your

queryGranularity

in your ingest spec. if it is set to

hour

then you would also see this truncation to the hour

Ya, @Gian Merlino I was wondering about the

queryGranularity

setting. Thanks for correcting me on the

posix

config, I haven't seen

millis

before so this is new to me.

yea,

queryGranularity

was set to

hour

. After resetting it to null and restarting the supervisor spec, it worked. thanks a lot @Mike Sherman @Gian Merlino

No problem @Xarvis At my last company, we generally didn't touch the queryGranularity but I remember running into this problem a few times.