This message was deleted.
# generals
Slackbot
02/27/2023, 6:54 PMThis message was deleted.
j
John Kowtko
02/27/2023, 7:15 PMCan you just set it to CURRENT_TIMESTAMP in the ingestion spec?
ref: https://druid.apache.org/docs/latest/querying/sql-scalar.html#date-and-time-functions
b
Ben Krug
02/27/2023, 8:03 PMThere's currently no way to store time of ingestion as a timestamp. If one gets added, it'd have to check that replicas=1. For now, you can have replicas for kafka ingestion, and if you do, the ingestion times can be different on different replicas.
v
Vadim
02/27/2023, 8:24 PMCURRENT_TIMESTAMP is only a query thing. It is a SQL scaler it has nothing to do with Kafka ingestion
Vadim
02/27/2023, 8:27 PMWith Kafka you can use the
kafka__timeVadim
02/27/2023, 8:27 PMthere is no way to record the time the event was added to Druid, kafka timestamp is the closest you can get
l
Luiz Augusto
02/27/2023, 11:56 PMYeah, I've tried to use CURRENT_TIMESTAMP or even System.currentTimeMillis() as transformations earlier today, but I was not expecting a success.
Thanks for the ideas anyway, folks.
j
Jackie Lee
03/06/2023, 10:03 AMHi, Daniel
To insert ingest timestamp into an event, you might be able to write your own extensions that implement org.apache.druid.initialization.DruidModule interface.
https://druid.apache.org/docs/latest/development/modules.html
you can reference extensions has been implemented to implement it.
https://druid.apache.org/docs/latest/development/extensions.html
🤔 1