Hello Team we write the data in to pinot and we write a transformation function on date. "transformConfigs": [{ "columnName": "actual_insertion_timestamp", "transformFunction": "now()" }], can you tell me this time is the time when it inject...is there any chance this time will be past date. for example some record start writing current time.. will it be incremental

Hi San, The

now()

transform function simply calls the system clock and writes the current time in epoch milliseconds into the row. It doesn’t use your event timestamp, and it will never produce a value in the past—it always reflects the ingestion time at the moment the record is processed. Because it just returns the current time, there is no guarantee that successive values will be strictly increasing. If multiple rows are ingested in the same millisecond they will all have the same value. If you need a monotonically increasing sequence you would need to generate that yourself in your pipeline. So in short:

now()

gives you the ingestion time (UTC) and won’t go backwards, but it’s not intended to be an incremental counter. If you need to track the original event time, keep that as a separate column in your schema. Hope that helps!