https://pinot.apache.org/ logo
Join Slack
Powered by
I just ran into this issue while trying to build p...
# troubleshooting
k
I just ran into this issue while trying to build pinot for m1 mac
Copy code
] Failed to execute goal org.apache.maven.plugins:maven-shade-plugin:3.2.1:shade (default) on project pinot-kafka-2.0: Error creating shaded jar:
I really don't need pinot kafka for my current test install is there a way to bypass this or fix the shade issue? Anyone run into this issue before. Before that I ran into issue with the spotless plugin which I commented out in the pom.xml in root folder and in the pinot-common directory.
s
Just checking, have you configured your settings.xml correctly as per https://docs.pinot.apache.org/basics/getting-started/running-pinot-locally#m1-mac-support?
k
Yes I believe I have
Copy code
more ~/.m2/settings.xml

<settings xmlns="<http://maven.apache.org/SETTINGS/1.0.0>" xmlns:xsi="<http://www.w3.org/2001/XMLSchema-instance>"
  xsi:schemaLocation="<http://maven.apache.org/SETTINGS/1.0.0> <https://maven.apache.org/xsd/settings-1.0.0.xsd>">
  <activeProfiles>
    <activeProfile>
      apple-silicon
    </activeProfile>
  </activeProfiles>
  <profiles>
    <profile>
      <id>apple-silicon</id>
      <properties>
        <os.detected.classifier>osx-x86_64</os.detected.classifier>
      </properties>
    </profile>
  </profiles>
</settings>

/Users/KevinPeng/.m2/settings.xml (END)
Also I would assume that if it wasn't setup right I would have more failures and it seems like most of the packages have been successfully built
Copy code
[INFO] Reactor Summary for Pinot 0.11.0-SNAPSHOT:
[INFO] 
[INFO] Pinot .............................................. SUCCESS [  2.709 s]
[INFO] Pinot Service Provider Interface ................... SUCCESS [  1.033 s]
[INFO] Pinot Segment Service Provider Interface ........... SUCCESS [  1.075 s]
[INFO] Pinot Plugins ...................................... SUCCESS [  0.705 s]
[INFO] Pinot Metrics ...................................... SUCCESS [  0.547 s]
[INFO] Pinot Yammer Metrics ............................... SUCCESS [  5.960 s]
[INFO] Pinot FMPP plugin .................................. SUCCESS [  1.779 s]
[INFO] Pinot Common ....................................... SUCCESS [ 33.576 s]
[INFO] Pinot Input Format ................................. SUCCESS [  0.637 s]
[INFO] Pinot Avro Base .................................... SUCCESS [  2.884 s]
[INFO] Pinot Avro ......................................... SUCCESS [  1.989 s]
[INFO] Pinot Csv .......................................... SUCCESS [  2.334 s]
[INFO] Pinot JSON ......................................... SUCCESS [  1.798 s]
[INFO] Pinot local segment implementations ................ SUCCESS [ 15.593 s]
[INFO] Pinot Core ......................................... SUCCESS [ 18.929 s]
[INFO] Pinot Server ....................................... SUCCESS [ 11.534 s]
[INFO] Pinot Segment Uploader ............................. SUCCESS [  3.432 s]
[INFO] Pinot Segment Uploader Default ..................... SUCCESS [  4.132 s]
[INFO] Pinot Controller ................................... SUCCESS [02:14 min]
[INFO] Pinot Broker ....................................... SUCCESS [  9.014 s]
[INFO] Pinot Clients ...................................... SUCCESS [  0.664 s]
[INFO] Pinot Java Client .................................. SUCCESS [  3.394 s]
[INFO] Pinot JDBC Client .................................. SUCCESS [ 17.450 s]
[INFO] Pinot Batch Ingestion .............................. SUCCESS [  3.093 s]
[INFO] Pinot Batch Ingestion Common ....................... SUCCESS [  4.449 s]
[INFO] Pinot Minion ....................................... SUCCESS [  4.281 s]
[INFO] Pinot Confluent Avro ............................... SUCCESS [  6.937 s]
[INFO] Pinot ORC .......................................... SUCCESS [ 24.700 s]
[INFO] Pinot Parquet ...................................... SUCCESS [ 19.027 s]
[INFO] Pinot Thrift ....................................... SUCCESS [  2.552 s]
[INFO] Pinot Protocol Buffers ............................. SUCCESS [  2.950 s]
[INFO] Pluggable Pinot file system ........................ SUCCESS [  0.474 s]
[INFO] Pinot Azure Data Lake Storage ...................... SUCCESS [  9.820 s]
[INFO] Pinot Hadoop Filesystem ............................ SUCCESS [  2.476 s]
[INFO] Pinot Google Cloud Storage ......................... SUCCESS [ 10.314 s]
[INFO] Pinot Amazon S3 .................................... SUCCESS [ 16.961 s]
[INFO] Pinot Batch Ingestion for Spark .................... SUCCESS [ 12.230 s]
[INFO] Pinot Batch Ingestion for Hadoop ................... SUCCESS [  7.830 s]
[INFO] Pinot Batch Ingestion Standalone ................... SUCCESS [  4.819 s]
[INFO] Pinot Batch Ingestion .............................. SUCCESS [  3.138 s]
[INFO] Pinot Ingestion Common ............................. SUCCESS [  8.920 s]
[INFO] Pinot Hadoop ....................................... SUCCESS [ 35.925 s]
[INFO] Pinot Spark ........................................ SUCCESS [ 57.768 s]
[INFO] Pinot Stream Ingestion ............................. SUCCESS [  0.520 s]
[INFO] Pinot Kafka Base ................................... SUCCESS [  1.611 s]
[INFO] Pinot Kafka 0.9 .................................... SUCCESS [  7.181 s]
[INFO] Pinot Kafka 2.x .................................... FAILURE [ 10.304 s]
[INFO] Pinot Kinesis ...................................... SKIPPED
[INFO] Pinot Pulsar ....................................... SKIPPED
[INFO] Pinot Minion Tasks ................................. SKIPPED
[INFO] Pinot Minion Built-In Tasks ........................ SKIPPED
[INFO] Pinot Dropwizard Metrics ........................... SKIPPED
[INFO] Pinot Segment Writer ............................... SKIPPED
[INFO] Pinot Segment Writer File Based .................... SKIPPED
[INFO] Pluggable Pinot Environment Provider ............... SKIPPED
[INFO] Pinot Azure Environment ............................ SKIPPED
[INFO] Pinot Tools ........................................ SKIPPED
[INFO] Pinot Test Utils ................................... SKIPPED
[INFO] Pinot Integration Tests ............................ SKIPPED
[INFO] Pinot Perf ......................................... SKIPPED
[INFO] Pinot Distribution ................................. SKIPPED
[INFO] Pinot Connectors ................................... SKIPPED
[INFO] Pinot Spark Connector .............................. SKIPPED
[INFO] Pinot Flink Connector .............................. SKIPPED
[INFO] Pinot Compatibility Verifier ....................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
Welp got around the issue by using the docker build instead
m
Thanks for confirming. I think @saurabh dubey also has a more native fix if I am not wrong, will let him share that.
s
The pom changes needed to build on m1 have already been merged to master. We should be good with just the settings.xml change.. This thread for details @Kevin Vu https://www.linen.dev/s/apache-pinot/t/46652/U011R2VMS4S-U0264HWF9FS-the-master-branch-should-compile-jus. Make sure you have rosetta installed for x86 only binaries to work on arm 
softwareupdate --install-rosetta
thankyou 1
m
Should we also put this in the docs?
👍 1
s
Done
🙏 2
@Kevin Peng, Just confirming if it worked with roestta?
k
@saurabh dubey are you referring to me? If so, I just abandoned it since I was able to get the docker deploy version to work.
m
I think he did (same first name as original thread + auto complete I'd guess) 😅
s
Yes that's my bad 🙂
Open in Slack
PreviousNext
Powered by