https://pinot.apache.org/ logo
#troubleshooting
Title
# troubleshooting
e

Eduardo Cusa

04/05/2022, 1:55 PM
Hello guys, we're using the
ingestFromFile
endpoint to ingest data, but after some minutes the table is empty again. Do we need to set up a persistence backend?
m

Mark Needham

04/05/2022, 3:12 PM
hmmm, did you set a low retention time or something?
not really sure why else the data would disappear
๐Ÿ‘€ 1
m

Mayank

04/05/2022, 4:45 PM
Yeah, sounds like you set really low retention, or donโ€™t have the right unit for time.
e

Eduardo Cusa

04/05/2022, 4:45 PM
Copy code
{
  "tableName": "ads31",
  "tableType": "OFFLINE",
  "segmentsConfig": {
    "replication": 1,
    "timeColumnName": "device_timestamp",
    "timeType": "MILLISECONDS",
    "retentionTimeUnit": "DAYS",
    "retentionTimeValue": 365
  },
  "tenants": {
    "broker": "DefaultTenant",
    "server": "DefaultTenant"
  },
  "tableIndexConfig": {
    "loadMode": "MMAP"
  },
  "ingestionConfig": {
    "batchIngestionConfig": {
      "segmentIngestionType": "APPEND",
      "segmentIngestionFrequency": "DAILY"
    }
  },
  "metadata": {}
}
m

Mayank

04/05/2022, 4:46 PM
Ok, another possibility is that your data is more than 1 year old
May be try removing retention, if this is just for testing.
๐Ÿ‘ 1
e

Eduardo Cusa

04/06/2022, 11:43 AM
Hello yes this is for testing purpose, so just in case we used 10 years retention and it's working, because the data is not clean yet. thks
๐Ÿ‘ 1