https://pinot.apache.org/ logo
Join Slack
Powered by
Is anyone else getting a dependency convergence fa...
# pinot-dev
k
Is anyone else getting a dependency convergence failure when building from master? Details in thread…
I ran 
mvn clean install -DskipTests -Pbin-dist
from the top, and it failed when building 
pinot-spark
with:
Copy code
[WARNING] 
Dependency convergence error for org.apache.hadoop:hadoop-yarn-api:2.6.5 paths to dependency are:
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.spark:spark-yarn_2.11:2.4.0
      +-org.apache.hadoop:hadoop-yarn-api:2.6.5
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
      +-org.apache.hadoop:hadoop-yarn-server-nodemanager:2.8.3
        +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
      +-org.apache.hadoop:hadoop-yarn-server-resourcemanager:2.8.3
        +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
      +-org.apache.hadoop:hadoop-yarn-server-resourcemanager:2.8.3
        +-org.apache.hadoop:hadoop-yarn-server-applicationhistoryservice:2.8.3
          +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
      +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
      +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-minicluster:2.8.3
      +-org.apache.hadoop:hadoop-yarn-server-tests:2.8.3
        +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-com.holdenkarau:spark-testing-base_2.11:2.4.0_0.14.0
    +-org.apache.hadoop:hadoop-minicluster:2.8.3
      +-org.apache.hadoop:hadoop-yarn-api:2.8.3
and
+-org.apache.pinot:pinot-spark:0.11.0-SNAPSHOT
  +-org.apache.hadoop:hadoop-yarn-api:2.10.1

[WARNING] Rule 0: org.apache.maven.plugins.enforcer.DependencyConvergence failed with message:
Failed while enforcing releasability. See above detailed error message.
Only change I see to jar versions is on April 12th, by PJ Fanning, where the Hadoop version was bumped to 2.10.1
k
not sure, how it passed the CI
k
Yes, exactly - so maybe my setup is borked? Now I’m wading through dependency graphs 😞
k
do you have the PR?
k
No, I was working on a different issue, so wanted to start fresh from current Pinot master, but that build failed
I’ll dig a bit more.
Looks like modifying the pom to exclude spark-yarn from spark-testing-base is sufficient. But I’m wondering why CI/original PR didn’t fail with the same issue.
2 Views
Open in Slack
PreviousNext
Powered by