Apache Pinot #general

Subbu Subramaniam

03/02/2019, 6:45 PM

@User agreed

linda

03/07/2019, 1:02 AM

👋 new bee to pinot. I was following instructions on https://pinot.readthedocs.io/en/latest/getting_started.html

./bin/quick-start-offline.sh

did start the server on 9000, but it also spit out warnings like following, and http://localhost:9000/query/ give me 404

Copy code

WARNING: The following warnings have been detected: WARNING: HK2 service reification failed for [org.glassfish.jersey.message.internal.DataSourceProvider] with an exception:
MultiException stack 1 of 2
java.lang.NoClassDefFoundError: javax/activation/DataSource

Copy code

MultiException stack 2 of 2
java.lang.IllegalArgumentException: Errors were discovered while reifying SystemDescriptor(

Did I do something wrong 🤔 ?

Kishore G

03/07/2019, 1:02 AM

whats the java version?

linda

03/07/2019, 1:05 AM

java version "1.8.0_161" Java(TM) SE Runtime Environment (build 1.8.0_161-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.161-b12, mixed mode)

Kishore G

03/07/2019, 4:13 AM

Any thing else in the logs?

linda

03/07/2019, 4:21 AM

the last error is

Copy code

Mar 06, 2019 5:03:24 PM org.glassfish.grizzly.http.server.NetworkListener start
INFO: Started listener bound to [0.0.0.0:9000]
Mar 06, 2019 5:03:24 PM org.glassfish.grizzly.http.server.HttpServer start
INFO: [HttpServer] Started.
Exception in thread "main" java.lang.NoClassDefFoundError: javax/xml/bind/annotation/XmlRootElement

linda

03/07/2019, 4:22 AM

and couple others like this

Copy code

MultiException stack 4 of 4
java.lang.IllegalArgumentException: Errors were discovered while reifying SystemDescriptor(
	implementation=org.glassfish.jersey.jaxb.internal.JaxbStringReaderProvider$RootElementProvider
	contracts={javax.ws.rs.ext.ParamConverterProvider}
	scope=javax.inject.Singleton
	qualifiers={}
	descriptorType=CLASS
	descriptorVisibility=NORMAL
	metadata=
	rank=0
	loader=null
	proxiable=null
	proxyForSameScope=null
	analysisName=null
	id=111
	locatorId=0
	identityHashCode=213383793
	reified=false)
	at org.jvnet.hk2.internal.SystemDescriptor.reify(SystemDescriptor.java:681)

Kishore G

03/07/2019, 4:25 AM

Let me try it. Looks like we might have multiple versions of same jar

Sunitha

03/07/2019, 4:26 AM

.Org.jvnet.hk2 seems wrong - we don’t pull that dependency

Sunitha

03/07/2019, 5:00 AM

Looking for jaxb dependencies, on my localhost, 2.2.2 version is being pulled:

Copy code

mvn dependency:tree -Dincludes=javax.xml.bind
...
[INFO] org.apache.pinot:pinot-common:jar:0.1.0-SNAPSHOT
[INFO] \- org.apache.hadoop:hadoop-client:jar:2.7.0:provided
[INFO]    \- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.7.0:provided
[INFO]       \- org.apache.hadoop:hadoop-yarn-common:jar:2.7.0:provided
[INFO]          \- javax.xml.bind:jaxb-api:jar:2.2.2:provided

@User what do you see?

Kishore G

03/07/2019, 5:17 AM

it will be good to get the classpath that was used

Kishore G

03/07/2019, 5:27 AM

@User we do have hk2 in our classpath

Kishore G

03/07/2019, 5:27 AM

1 /hk2-api-2.5.0.jar 1 /hk2-locator-2.5.0.jar 1 /hk2-utils-2.5.0.jar

Sunitha

03/07/2019, 5:27 AM

yes, it should be org.glassfish not org.jvnet

Seunghyun

03/07/2019, 5:28 AM

as @User mentioned, we are pulling

org.glassfish.hk2

Seunghyun

03/07/2019, 5:28 AM

https://docs.google.com/spreadsheets/d/1lMEEvrA8SqHe0Yy0yC2Nd-nN5lg5sPaNwihrj_--y8Q/edit#gid=631543215

Kishore G

03/07/2019, 5:31 AM

Nice.

Kishore G

03/07/2019, 5:43 AM

we do have org.jvnet.hk2 in the classpath

linda

03/07/2019, 5:43 AM

Copy code

[INFO] -------------------< org.apache.pinot:pinot-common >--------------------
[INFO] Building Pinot Common 0.1.0-SNAPSHOT                              [3/17]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO] 
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ pinot-common ---
[INFO] org.apache.pinot:pinot-common:jar:0.1.0-SNAPSHOT
[INFO] \- org.apache.hadoop:hadoop-client:jar:2.7.0:provided
[INFO]    \- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.7.0:provided
[INFO]       \- org.apache.hadoop:hadoop-yarn-common:jar:2.7.0:provided
[INFO]          \- javax.xml.bind:jaxb-api:jar:2.2.2:provided

linda

03/07/2019, 5:44 AM

I have the same as yours @User

Kishore G

03/07/2019, 5:49 AM

its this jar thats causing the problem

Kishore G

03/07/2019, 5:49 AM

/Users/kishoreg/projects/incubator-pinot/pinot-distribution/target/apache-pinot-incubating-0.1.0-SNAPSHOT-bin/apache-pinot-incubating-0.1.0-SNAPSHOT-bin/lib/mimepull-1.9.11.jar

Sunitha

03/07/2019, 5:58 AM

Its actually coming from hk2-locator/hk2-utils

Kishore G

03/07/2019, 6:01 AM

yes, target/apache-pinot-incubating-0.1.0-SNAPSHOT-bin/apache-pinot-incubating-0.1.0-SNAPSHOT-bin/lib/hk2-locator-2.5.0.jar

Kishore G

03/07/2019, 6:47 AM

update, this was because of jdk 9, jdk 9 removed activation jar and needs to be explicitly added. Linda change to java 8 and it worked.

Kishore G

03/07/2019, 6:47 AM

https://github.com/spotify/dockerfile-maven/issues/90 similar issue

Seunghyun

03/08/2019, 4:03 AM

Apache Pinot (incubating) 0.1.0 is now officially released! It can be downloaded at https://pinot.apache.org/download/

👏 7

Ravi

03/08/2019, 4:04 AM

Very nice! Great milestone. Congrats to everyone who helped in making this happen.

Kishore G

03/08/2019, 4:07 AM

Wow. This is amazing.

ssahay

03/12/2019, 7:34 PM

Pinot blog hot off the press https://engineering.linkedin.com/blog/2019/03/pinot-joins-apache-incubator

👏 3