Tommaso Peresson
09/27/2022, 1:02 PM"custom.map": "{\"input.data.file.uri\":\"hdfs://***\"}",
and instead I would want to have something like "custom.map": "{\"input.data.file.uri\":\"gs://***\"}",
so that the segment fetcher would know where to get the data from. Do you know if it's possible to do what I'm asking? ThanksNeha Pawar
Tommaso Peresson
09/27/2022, 4:01 PM/segments/{tableName}/{segmentName}/metadata
API, which from my understanding are stored in zk. Correct?Neha Pawar
Tommaso Peresson
09/27/2022, 4:03 PM{
"id": "<segment_id>",
"simpleFields": {
"segment.crc": "2408365506",
"segment.creation.time": "1664198489345",
"segment.download.url": "http://<controller-host>:9000/segments/<table_name>/<segment_id>",
"segment.end.time": "1651536000000",
"segment.index.version": "v3",
"segment.push.time": "1664199765768",
"segment.start.time": "1651536000000",
"segment.time.unit": "MILLISECONDS",
"segment.total.docs": "74478"
},
"mapFields": {
"custom.map": {
"input.data.file.uri": "hdfs://<path-to-segment-in-hdfs>"
}
},
"listFields": {}
}
"mapFields": {
"custom.map": {
"input.data.file.uri": "hdfs://<path-to-segment-in-hdfs>"
}
},
fieldNeha Pawar
Tommaso Peresson
09/27/2022, 4:06 PM