Hello team, we are evaluating Pinot and we setup P...
# troubleshooting
c
Hello team, we are evaluating Pinot and we setup Pinot on GKE with the helm chart version 0.2.6-SNAPSHOT. We created an ingestionJobSpec to ingest from GCS bucket and write segments to GCS as deep store. Although the ingestion job succeeds and there are no apparent error/warn logs in the job output and the controller logs and a segment tar file seemingly appears in the GCS output bucket, the Pinot console shows 0 bytes in the table even long after. What are we missing ? Another question is whether the
outputDirURI
in the
ingestionJobSpec
can be same as the
controller.data.dir
? We are assuming yes. Config files, table config and job spec attached.
n
Did you try the query console ?
c
Yes - it show 0 bytes
n
I have a case where it shows 0 bytes but making a query show results
c
Even queries show 0 results
I am able to get past this problem by two changes. One the
controller.data.dir
is pointed to
<gs://REDACTED/controller/data>
and the `controller.local.tmp.dir`is pointed to some
/tmp/dir
on the pod instead of the persistent disk directory
/PDmountdir/some/dir
. I don't know how exactly these changes fixed it though
👍 1