Apache Pinot

Hello guys, we're using the `ingestFromFile`  endpoint to <https://docs.pinot.apache.org/basics/data-import/batch-ingestion|ingest> data, but after some minutes the table is empty again. Do we need to set up a <https://docs.pinot.apache.org/basics/data-import/pinot-file-system|persistence> backend?

hmmm, did you set a low retention time or something?

not really sure why else the data would disappear

Yeah, sounds like you set really low retention, or don’t have the right unit for time.

```{
  "tableName": "ads31",
  "tableType": "OFFLINE",
  "segmentsConfig": {
    "replication": 1,
    "timeColumnName": "device_timestamp",
    "timeType": "MILLISECONDS",
    "retentionTimeUnit": "DAYS",
    "retentionTimeValue": 365
  },
  "tenants": {
    "broker":"DefaultTenant",
    "server":"DefaultTenant"
  },
  "tableIndexConfig": {
    "loadMode": "MMAP"
  },
  "ingestionConfig": {
    "batchIngestionConfig": {
      "segmentIngestionType": "APPEND",
      "segmentIngestionFrequency": "DAILY"
    }
  },
  "metadata": {}
}```

Ok, another possibility is that your data is more than 1 year old

May be try removing retention, if this is just for testing.

Hello yes this is for testing purpose, so just in case we used 10 years retention and it's working, because the data is not clean yet.
thks