StarTree Inc has joined this channel by invitation from Apache Pinot.

Hey, I can post questions here for the zoom meeting right?

{ "tableName": "t_silver_ticket", "tableType": "OFFLINE", "segmentsConfig": { "timeColumnName": "ticket_updated_on", "timeType": "MILLISECONDS", "segmentPushType": "APPEND", "segmentAssignmentStrategy": "BalanceNumSegmentAssignmentStrategy", "schemaName": "t_silver_ticket", "replication": "1" }, "tableIndexConfig": { "loadMode": "MMAP", "invertedIndexColumns": [ "ticket_state" ], "sortedColumn": [ "created_on" ] }, "tenants": { "broker": "DefaultTenant", "server": "DefaultTenant" }, "metadata": { "customConfigs": {} }, "ingestionConfig": { "batchIngestionConfig": { "segmentIngestionType": "APPEND", "segmentIngestionFrequency": "HOURLY", "batchConfigMaps": [ { "input.fs.className": "org.apache.pinot.plugin.filesystem.AzurePinotFS", "input.fs.prop.accountName": "testwzdatalake", "input.fs.prop.accountKey": "XXXXXXXXXXXXXXXXXXX", "inputDirURI": "abfs://parquet-to-pinot@testwzdatalake.dfs.core.windows.net/", "includeFileNamePattern": "glob:**/*.parquet", "excludeFileNamePattern": "glob:**/*.tmp", "inputFormat": "parquet" } ] } }, "task": { "taskTypeConfigsMap": { "SegmentGenerationAndPushTask": { "schedule": "0 */10 * * * ?", "taskQueueConfig": "SegmentGenerationAndPushTask" } } } }

Can I use this table config to leverage minions to ingest data to pinot from my Azure container?

I tried with this approach, but no segements, no tasks are being generated in Pinot

I am stuck here. IK the doubt is off the topic of discussion, but it will be great if you can just clarify this doubt @Max Thanks!

There are some other questions in: https://apache-pinot.slack.com/archives/C03N1JNHXLY/p1734543092886379

Hi @mathew! I think you should make that question in #C011C9JHN7R instead of here. There you will probably find more help. Also, I am going to be the host tomorrow and my expertise is in the query side, not minions or ingestion

Hi @Gonzalo Ortiz, I tried this the troubleshooting grp, but got no answer. Then a pinot guy shared this webinar, and when I signed up, I came to know that the questions can be posted here. That's y I took my chance😀

@Gonzalo Ortiz can u pls connect me with a guy, who knows how to solve this issue?! Thanks