Arun Vasudevan
05/06/2021, 10:00 PMUpload the schema and Table Config
- https://docs.pinot.apache.org/basics/getting-started/pushing-your-streaming-data-to-pinot#uploading-your-schema-and-table-config
I am getting the following error…
Sending request: <http://pinot-quickstart:9000/schemas> to controller: ea8d7bfc16ea, version: Unknown
{"code":500,"error":"org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata"}
However I am able to login to my kafka docker and describe and that works fine…
bash-4.4# bin/kafka-topics.sh --bootstrap-server kafka:9092 --topic transcript-topic --describe
Topic: transcript-topic PartitionCount: 1 ReplicationFactor: 1 Configs: segment.bytes=1073741824
Topic: transcript-topic Partition: 0 Leader: 0 Replicas: 0 Isr: 0
Any idea where i am missing?Daniel Lavoie
05/06/2021, 10:06 PMTumeout expiered while fetching topic metadata
is typically a sign that pinot was able to connect to your kafka instance but failing to load the topic. Double check the topic nameArun Vasudevan
05/06/2021, 10:26 PMincubator-pinot (master) ✗ docker exec \
-t kafka \
/opt/kafka/bin/kafka-topics.sh \
--bootstrap-server kafka:9092 \
--topic transcript-topic --describe
Topic: transcript-topic PartitionCount: 1 ReplicationFactor: 1 Configs: segment.bytes=1073741824
Topic: transcript-topic Partition: 0 Leader: 0 Replicas: 0 Isr: 0
Doesn’t this mean its already able to recognize the host.Zookeeper
, `Kafka`….
But, i don’t see any other docker containers started other than pinot-quickstart
….Kishore G
Xiang Fu
Arun Vasudevan
05/06/2021, 11:56 PMschemaFile
and the tableconfigFile
be placed?
Tried it with placing it in local as well as in controller..didn’t work..
docker run \
--network=pinot-demo \
--name pinot-streaming-table-creation \
0e536a319df3 AddTable \
-schemaFile /tmp/pinot-quick-start/transcript-schema.json \
-tableConfigFile /tmp/pinot-quick-start/transcript-table-realtime.json \
-controllerHost pinot-controller \
-controllerPort 9000 \
-exec
FileNotFoundException
while creating table and schemaXiang Fu
Arun Vasudevan
05/07/2021, 12:51 PMTimeout expired while fetching topic metadata
when trying with the docker command.
So, i tried to execute pinot-admin.sh
within the Controller Container…
But, I am getting an exception Schema is incompatible with tableConfig
2021/05/07 12:36:02.787 ERROR [PinotAdministrator] [main] Exception caught:
org.apache.pinot.common.exception.HttpErrorStatusException: Got error status code: 400 (Bad Request) with reason: "Cannot add invalid schema: transcript. Reason: Schema is incompatible with tableConfig with name: transcript_REALTIME and type: REALTIME" while sending request: <http://172.18.0.3:9000/schemas> to controller: 31edf0f41322, version: Unknown
I am using the Schema
and Table Config
from this page - https://docs.pinot.apache.org/basics/data-import/pinot-stream-ingestion
Kindly advice!bin/pinot-admin.sh AddTable -tableConfigFile /tmp/pinot-quick-start/transcript-table.json -exec
as the schema was created earlier it pointed out the issue in the timestamp
field. So Fixed it in the table creation to have the same name as schema
"segmentsConfig": {
"timeColumnName": "timestampInEpoch",
Mayank