https://pinot.apache.org/ logo
Join Slack
Powered by
Hi team, I have a question about pinot 0.10.0 and ...
# general
h
Hi team, I have a question about pinot 0.10.0 and Azure Data Lake Storage. Is there a way to replace a segment if it already exists otherwise just push it using the Job spec ?
m
Pushing a segment with same name will overwrite existing one if the one being pushed is newer
This is regardless of ADLS. @Seunghyun
h
I'm facing this issue:
Copy code
Exception while uploading segment: Status code 409, "{"error":{"code":"PathAlreadyExists","message":"The specified path already exists.
Copy code
023/02/08 15:33:51.265 ERROR [LaunchDataIngestionJobCommand] [main] Got exception to kick off standalone data ingestion job -
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:148) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30
c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:118) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c463
5bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:121) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10
.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.tools.Command.call(Command.java:33) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.tools.Command.call(Command.java:29) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine.executeUserObject(CommandLine.java:1953) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine.access$1300(CommandLine.java:145) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee8
8f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2346) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2311) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a6
50607f]
        at picocli.CommandLine.execute(CommandLine.java:2078) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:161) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b9
3bcd4a650607f]
        at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:192) [pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93bc
d4a650607f]
Caused by: java.lang.RuntimeException: org.apache.pinot.spi.utils.retry.AttemptsExceededException: Operation failed after 1 attempts
        at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner.run(SegmentTarPushJobRunner.java:90) ~[pinot-batch-ingestion-standalone-0.10.0-shaded.ja
r:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:146) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30
c4635bfeee88f88aa9c9f63b93bcd4a650607f]
 ... 13 more
Caused by: org.apache.pinot.spi.utils.retry.AttemptsExceededException: Operation failed after 1 attempts
        at org.apache.pinot.spi.utils.retry.BaseRetryPolicy.attempt(BaseRetryPolicy.java:61) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88aa9c9f63b93b
cd4a650607f]
        at org.apache.pinot.segment.local.utils.SegmentPushUtils.pushSegments(SegmentPushUtils.java:123) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30c4635bfeee88f88
aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner.run(SegmentTarPushJobRunner.java:88) ~[pinot-batch-ingestion-standalone-0.10.0-shaded.ja
r:0.10.0-30c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:146) ~[pinot-all-0.10.0-jar-with-dependencies.jar:0.10.0-30
c4635bfeee88f88aa9c9f63b93bcd4a650607f]
        ... 13 more
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:148)
        at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:118)
        at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:121)
        at org.apache.pinot.tools.Command.call(Command.java:33)
        at org.apache.pinot.tools.Command.call(Command.java:29)
        at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
        at picocli.CommandLine.access$1300(CommandLine.java:145)
        at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
        at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
        at picocli.CommandLine.execute(CommandLine.java:2078)
        at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:161)
        at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:192)
Caused by: java.lang.RuntimeException: org.apache.pinot.spi.utils.retry.AttemptsExceededException: Operation failed after 1 attempts
        at org.apache.pinot.spi.utils.retry.BaseRetryPolicy.attempt(BaseRetryPolicy.java:61)
        at org.apache.pinot.segment.local.utils.SegmentPushUtils.pushSegments(SegmentPushUtils.java:123)
        at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner.run(SegmentTarPushJobRunner.java:88)
        ... 14 more
s
@Hassan Ait Brik Are you using ADLSGen2 or AzurePinotFS?
h
ADLS Gen2
s
can we retry after deleting the destination path?
the current implementation doesnt overwrite
h
the solution we have now is to delete the segment and push it
s
hmmm i will look into this
this looks to be sth that needs to be addressed
h
indeed 😁
Is there a way to deal with this issue ? without deleting the segment. Overwrite the segment using ADLS Gen2 does not work
using another file system for our deep store could resolve it ? @Seunghyun
s
@Hassan Ait Brikwhich push type are you using? (metadata/uri/file push)
h
Ingestion Jobs with jobType=SegmentCreationAndTarPush
when pushing a segment that already exists
Copy code
2023/02/21 16:37:25.767 ERROR [SegmentGenerationJobRunner] [pool-3-thread-1] Failed to generate Pinot segment for file - file:/communities/raw/60fe7ef4b28d583bcdcd4e43.parquet
com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 409, "{"error":{"code":"PathAlreadyExists","message":"The specified path already exists.\nRequestId:b52d2f31-b01f-006d-7912-4634ef000000\nTime:2023-02-21T16:37:25.7457864Z"}}"
s
is it an option for you to use s3 as deep storage?
unlike other storage, ADLS doesn’t overwrite the file by default
i checked s3, local file system and they both overwrites existing data
filed the fix on this.
🙏 2
h
Thx @Seunghyun
@Mayank this fix will be available only in the next version of pinot ? how can we take advantage of this fix on our pinot 0.10.0 ? Patch ?
m
Yes, it is only fix forward. Can you upgrade?
h
Not easy to say. We are migrating pinot from 0.9.2 to 0.10.0 + deep store
In which stable version the fix will be deployed ?
s
it will be included in 
0.13.0
@Hassan Ait Brik another approach is to build the hotfix jar from the source code. How does your pinot env look like? Do you use kubernetes + docker images?
h
yes kubernetes + docker image
s
hmm we publish the new pinot docker images daily based on the latest code but you probably need the stable version (or 0.10.0 + hotfix)
h
😉😉😉 trying this today
Copy code
2023/02/24 09:13:41.900 INFO [ADLSGen2PinotFS] [jersey-server-managed-async-executor-0] The destination path already exists and we are overwriting the file (dstUri=<adl2://data-dev>@insideboarddatalakedev.dfs.core.windows.net/segments/communities_demo_unicorn/63f61177df202bcd2b40b0b6)
2023/02/24 09:13:42.102 ERROR [PinotSegmentUploadDownloadRestletResource] [jersey-server-managed-async-executor-0] Exception while uploading segment: com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 412, "{"error":{"code":"ConditionNotMet","message":"The condition specified using HTTP conditional header(s) is not met.\nRequestId:01b0d9a7-e01f-000c-6c30-4807d4000000\nTime:2023-02-24T09:13:42.0937483Z"}}"
java.io.IOException: com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 412, "{"error":{"code":"ConditionNotMet","message":"The condition specified using HTTP conditional header(s) is not met.\nRequestId:01b0d9a7-e01f-000c-6c30-4807d4000000\nTime:2023-02-24T09:13:42.0937483Z"}}"
Seems related to https://github.com/apache/pinot/pull/10230
s
hmm interesting . i cherry picked that pr :(
let me double check on this!
@Hassan Ait Brik Can you retry with the same image tag? (I republished the image) Found that the 
0.10.0
has the older azure library so only 1 place needs to be changed.
h
let's try this
again... same issue @Seunghyun
Copy code
2023/02/27 11:30:59.914 ERROR [SegmentGenerationJobRunner] [pool-3-thread-1] Failed to generate Pinot segment for file - file:/communities/raw/63f61177df202bcd2b40b0b6.parquet
java.io.IOException: com.azure.storage.file.datalake.models.DataLakeStorageException: Status code 412, "{"error":{"code":"ConditionNotMet","message":"The condition specified using HTTP conditional header(s) is not met.\nRequestId:415624c5-701f-000e-4c9e-4ab96c000000\nTime:2023-02-27T11:30:59.9164710Z"}}"
I tried with the latest image too
Copy code
2023/02/28 10:55:33.576 ERROR [JacksonVersion] [main] Version '0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73' of package 'jackson-annotations' is not supported (older than earliest supported version - `2.10.0`), please upgrade.
2023/02/28 10:55:33.576 ERROR [JacksonVersion] [main] Version '0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73' of package 'jackson-core' is not supported (older than earliest supported version - `2.10.0`), please upgrade.
2023/02/28 10:55:33.576 ERROR [JacksonVersion] [main] Version '0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73' of package 'jackson-databind' is not supported (older than earliest supported version - `2.10.0`), please upgrade.
2023/02/28 10:55:33.577 ERROR [JacksonVersion] [main] Version '0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73' of package 'jackson-dataformat-xml' is not supported (older than earliest supported version - `2.10.0`), please upgrade.
2023/02/28 10:55:33.577 ERROR [JacksonVersion] [main] Version '0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73' of package 'jackson-datatype-jsr310' is not supported (older than earliest supported version - `2.10.0`), please upgrade.
2023/02/28 10:55:36.834 ERROR [DataLakePathClient] [main] Status code 404, (BlobNotFound)
2023/02/28 10:55:36.906 ERROR [LaunchDataIngestionJobCommand] [main] Got exception to kick off standalone data ingestion job - 
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentMetadataPushJobRunner
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:130) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:130) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.tools.Command.call(Command.java:33) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.tools.Command.call(Command.java:29) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine.executeUserObject(CommandLine.java:1953) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine.access$1300(CommandLine.java:145) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at picocli.CommandLine.execute(CommandLine.java:2078) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:171) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:202) [pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
Caused by: java.io.IOException: Input is not in the .gz format
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.init(GzipCompressorInputStream.java:193) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.<init>(GzipCompressorInputStream.java:167) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.<init>(GzipCompressorInputStream.java:131) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.common.utils.TarGzCompressionUtils.untarOneFile(TarGzCompressionUtils.java:219) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.generateSegmentMetadataFile(SegmentPushUtils.java:422) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.sendSegmentUriAndMetadata(SegmentPushUtils.java:304) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.sendSegmentUriAndMetadata(SegmentPushUtils.java:139) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentMetadataPushJobRunner.uploadSegments(SegmentMetadataPushJobRunner.java:38) ~[pinot-batch-ingestion-standalone-0.13.0-SNAPSHOT-shaded.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.plugin.ingestion.batch.common.BaseSegmentPushJobRunner.run(BaseSegmentPushJobRunner.java:149) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:150) ~[pinot-all-0.13.0-SNAPSHOT-jar-with-dependencies.jar:0.13.0-SNAPSHOT-0e88f54510e58d61ce00337ae01a860368683a73]
	... 13 more
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentMetadataPushJobRunner
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:130)
	at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:130)
	at org.apache.pinot.tools.Command.call(Command.java:33)
	at org.apache.pinot.tools.Command.call(Command.java:29)
	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
	at picocli.CommandLine.access$1300(CommandLine.java:145)
	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
	at picocli.CommandLine.execute(CommandLine.java:2078)
	at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:171)
	at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:202)
Caused by: java.io.IOException: Input is not in the .gz format
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.init(GzipCompressorInputStream.java:193)
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.<init>(GzipCompressorInputStream.java:167)
	at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.<init>(GzipCompressorInputStream.java:131)
	at org.apache.pinot.common.utils.TarGzCompressionUtils.untarOneFile(TarGzCompressionUtils.java:219)
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.generateSegmentMetadataFile(SegmentPushUtils.java:422)
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.sendSegmentUriAndMetadata(SegmentPushUtils.java:304)
	at org.apache.pinot.segment.local.utils.SegmentPushUtils.sendSegmentUriAndMetadata(SegmentPushUtils.java:139)
	at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentMetadataPushJobRunner.uploadSegments(SegmentMetadataPushJobRunner.java:38)
	at org.apache.pinot.plugin.ingestion.batch.common.BaseSegmentPushJobRunner.run(BaseSegmentPushJobRunner.java:149)
	at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:150)
	... 13 more
s
hmm do you have your 
xxx.gz
file that you’re trying to upload?
the above looks a bit scary (file is not written correctly)
sorry for taking multiple rounds for this..
g
Hi @Seunghyun We are encountering this in our env. We are using the image 
apachepinot/pinot:0.12.1-linux-arm64.
. As per the PR raised for https://github.com/apache/pinot/pull/10230 this should have been working. Appreciate your help here.
Hi @Hassan Ait Brik were you able to work around this?
FYI @Venkat Boina(VB)
h
Hi @Gurpreet Singh The work around for this issue was available in this custom image 
0.10.0-adls-fix
v
@Hassan Ait Brik Does it have same functionality as 0.12.1
h
I'd say yes, but it's better to ask the people at Pinot
v
@Mayank @Jackie Please confirm
m
@Seunghyun ^^
s
@Venkat Boina(VB) 0.10.0-adls-fix is based on the 0.10.0. Can you use 
1.0.0
?
v
@Seunghyun stable to use now
As we did faced a lot of issues during initial adoption
m
Yes multiple deployments using it in production
Open in Slack
PreviousNext
Powered by