{ "tableName": "t_silver_ticket", "tableType":...
# general
m
{ "tableName": "t_silver_ticket", "tableType": "OFFLINE", "segmentsConfig": { "timeColumnName": "created_on", "timeType": "MILLISECONDS", "segmentPushType": "APPEND", "segmentAssignmentStrategy": "BalanceNumSegmentAssignmentStrategy", "schemaName": "t_silver_ticket", "replication": "1" }, "tableIndexConfig": { "loadMode": "MMAP", "invertedIndexColumns": [ "ticket_state" ], "sortedColumn": [ "created_on" ] }, "tenants": { "broker": "DefaultTenant", "server": "DefaultTenant" }, "metadata": { "customConfigs": {} }, "ingestionConfig": { "batchIngestionConfig": { "segmentIngestionType": "APPEND", "dataFormat": "PARQUET" } }, "task": { "taskTypeConfigsMap": { "SegmentGenerationAndPushTask": { "schedule": "0 */5 * * * ?", "inputDirURI": "wasbs://parquet-to-pinot@testwzdatalake.blob.core.windows.net/*.parquet", "outputDirURI": "/tmp/pinot-segments", "inputFormat": "parquet", "useRelativePath": "true", "assignedMinion": "minion_untagged", "controllerURI": "http://XXXXXXXXXXX:9000", "credentialsPath": "/etc/pinot/azure/azure.accountKey" } } } } is this table configfg sufficient for minion based batch ingestion? when i tried with this config, inside minion task managet, SegmentGenerationAndPushTask is threr, but no tasks are getting created. Segments also not getting created. I am stuck here, can someone pls help! (edited) [4:48 AM] mathew I am trying to ingest parquet file from a container in ADLS