Abhishek Tomar
01/12/2022, 8:16 PMMayank
Abhishek Tomar
01/13/2022, 2:14 PMMayank
Abhishek Tomar
01/13/2022, 5:14 PMJeff Moszuti
01/13/2022, 8:21 PMJeff Moszuti
01/13/2022, 8:28 PM./pinot-admin.sh AddSchema -schemaFile ../examples/batch/baseballStats/baseballStats_schema.json -controllerHost localhost -controllerPort 9000 -exec
Abhishek Tomar
01/14/2022, 9:40 PMAbhishek Tomar
01/17/2022, 10:10 AMJeff Moszuti
01/17/2022, 12:54 PMAbhishek Tomar
01/18/2022, 10:30 AMJeff Moszuti
01/18/2022, 3:43 PMdocker exec -it manual-pinot-controller sh
Starting from scratch, I setup Pinot using following steps and was able to add the baseball schema using pinot-admin.sh
$ docker network create -d bridge pinot-demo_default
$ docker run \
--network=pinot-demo_default \
--name manual-pinot-zookeeper \
--restart always \
-p 2181:2181 \
-d zookeeper:3.5.6
$ docker run --rm -ti \
--network=pinot-demo_default \
--name manual-pinot-controller \
-p 9000:9000 \
-e JAVA_OPTS="-Dplugins.dir=/opt/pinot/plugins -Xms1G -Xmx1G -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -Xloggc:gc-pinot-controller.log" \
-d apachepinot/pinot:0.9.3 StartController \
-zkAddress manual-pinot-zookeeper:2181
$ docker run --rm -ti \
--network=pinot-demo_default \
--name manual-pinot-broker \
-p 8099:8099 \
-e JAVA_OPTS="-Dplugins.dir=/opt/pinot/plugins -Xms1G -Xmx1G -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -Xloggc:gc-pinot-broker.log" \
-d apachepinot/pinot:0.9.3 StartBroker \
-zkAddress manual-pinot-zookeeper:2181
$ docker run --rm -ti \
--network=pinot-demo_default \
--name manual-pinot-server \
-e JAVA_OPTS="-Dplugins.dir=/opt/pinot/plugins -Xms1G -Xmx16G -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -Xloggc:gc-pinot-server.log" \
-d apachepinot/pinot:0.9.3 StartServer \
-zkAddress manual-pinot-zookeeper:2181
$ docker exec -it manual-pinot-controller sh
# cd /opt/pinot/bin/
# bash pinot-admin.sh AddSchema -schemaFile ../examples/batch/baseballStats/baseballStats_schema.json -controllerHost localhost -controllerPort 9000 -exec
[0.001s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:gc-pinot-controller.log instead.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/pinot/lib/pinot-all-0.9.3-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-file-system/pinot-s3/pinot-s3-0.9.3-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-metrics/pinot-dropwizard/pinot-dropwizard-0.9.3-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-metrics/pinot-yammer/pinot-yammer-0.9.3-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-environment/pinot-azure/pinot-azure-0.9.3-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/pinot/plugins/pinot-input-format/pinot-parquet/pinot-parquet-0.9.3-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See <http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.codehaus.groovy.reflection.CachedClass (file:/opt/pinot/lib/pinot-all-0.9.3-jar-with-dependencies.jar) to method java.lang.Object.finalize()
WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.reflection.CachedClass
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2022/01/18 15:27:12.941 INFO [AddSchemaCommand] [main] Executing command: AddSchema -controllerProtocol http -controllerHost localhost -controllerPort 9000 -schemaFile ../examples/batch/baseballStats/baseballStats_schema.json -user null -password [hidden] -exec
# curl -X GET "<http://localhost:9000/schemas>" -H "accept: application/json"
["baseballStats"]
Abhishek Tomar
01/18/2022, 5:37 PMAbhishek Tomar
01/19/2022, 11:06 AMAbhishek Tomar
01/19/2022, 11:07 AM