server log shows that it’s failed to download the segment from the controller:

Got temporary error status code: 500 while downloading segment from: <http://172.18.0.6:9000/segments/covid_cases/covid_cases_OFFLINE_1971%2F01%2F01_2021%2F03%2F30_0> to: /tmp/pinotSegments/covid_cases_OFFLINE/tmp-covid_cases_OFFLINE_1971/01/01_2021/03/30_0-86673f59-1b0d-4a29-8c03-c03e772d182c/covid_cases_OFFLINE_1971/01/01_2021/03/30_0.enc
org.apache.pinot.common.exception.HttpErrorStatusException: Got error status code: 500 (Internal Server Error) with reason: "Failed to get reason" while sending request: <http://172.18.0.6:9000/segments/covid_cases/covid_cases_OFFLINE_1971%2F01%2F01_2021%2F03%2F30_0>

wondering where you run this setup? seems local deployment?

can you also try to make a call to

<http://172.18.0.6:9000/segments/covid_cases/covid_cases_OFFLINE_1971%2F01%2F01_2021%2F03%2F30_0>

and see if you can download this segment

Push job says

Pushing segment: 30_0 to location: <http://pinot-controller:9000> for table covid_cases
Sending request: <http://pinot-controller:9000/v2/segments?tableName=covid_cases> to controller: pinot-controller, version: Unknown
Response for pushing table covid_cases segment 30_0 to location <http://pinot-controller:9000> - 200: {"status":"Successfully uploaded segment: covid_cases_OFFLINE_1971/01/01_2021/03/30_0 of table: covid_cases"}

so I think this means you are still on k8s.

then can you check segment metadata and see the downloadURL there

also for pinot controller ,can you check if u have this config in the

values.yaml

file:

pinot.set.instance.id.to.hostname=true

It should make pinot controller use hostname other than ip address to register itself

This is running on an ec2 host running docker compose and sharing resources with mongo/Trino so might as well be a local setup 🙂

I’ll try what you said in a moment Xiang! Thanks 🙏

@Xiang Fu, I just noticed that you said this.

so I think this means you are still on k8s.

I'm trying to set this up in docker compose right now...what is the default for this property if I haven't set it for other nodes?

controller.helix.cluster.name

Here are the settings in docker compose

pinot-controller:
    image: apachepinot/pinot:latest
    hostname: pinot-controller
    volumes:
      - ./pinot-docker-demo/pinot/controller:/tmp/data/controller
      - ./conf:/opt/pinot/conf
    ports:
      - "9000:9000"
    command: StartController -configFileName /opt/pinot/conf/pinot-controller.conf
    depends_on:
      - zookeeper
      - kafka
    networks:
      - trino-network

  pinot-broker:
    image: apachepinot/pinot:latest
    hostname: pinot-broker
    ports:
      - "8099:8099"
    command: StartBroker -zkAddress zookeeper:2181
    depends_on:
      - zookeeper
      - kafka
      - pinot-controller
    networks:
      - trino-network

  pinot-server:
    image: apachepinot/pinot:latest
    hostname: pinot-server
    volumes:
      - ./pinot-docker-demo/pinot/server:/tmp/data/server
    ports:
      - "8098:8098"
    command: StartServer -zkAddress zookeeper:2181
    depends_on:
      - zookeeper
      - kafka
      - pinot-controller
    networks:
      - trino-network

also for

pinot-broker.conf

and

pinot-server.conf

segment is still showing up as bad...I think I must be doing something off like one setting I missed or something

hmmm

Anything off in my table config?

{
  "OFFLINE": {
    "tableName": "covid_cases_OFFLINE",
    "tableType": "OFFLINE",
    "segmentsConfig": {
      "timeType": "MILLISECONDS",
      "schemaName": "covid_cases",
      "timeColumnName": "cdc_report_dt",
      "replication": "1"
    },
    "tenants": {
      "broker": "DefaultTenant",
      "server": "DefaultTenant"
    },
    "tableIndexConfig": {
      "enableDefaultStarTree": false,
      "enableDynamicStarTreeCreation": false,
      "aggregateMetrics": false,
      "nullHandlingEnabled": true,
      "invertedIndexColumns": [],
      "autoGeneratedInvertedIndex": false,
      "createInvertedIndexDuringSegmentGeneration": false,
      "loadMode": "MMAP"
    },
    "metadata": {},
    "isDimTable": false
  }
}

looks ok

can you click segment metadata and look at the downloadURI field

I think that one should be fixed as well

brings me to the homescreen

I have to run out for 15 min i'll be right back

and shows

"segment.offline.download.url": "<http://192.168.86.73:9000/segments/baseballStats/baseballStats_OFFLINE_0>"

also can you try to set

timeType

to

SIMPLE_DATE_FORMAT:yyyy/MM/dd

in your table config