Hi pinot community, I'm new to pinot, we have a pi...
# general
m
Hi pinot community, I'm new to pinot, we have a pinot server version 0.12.1 and there are already tables and data, I want to upgrade to pinot version 1.1.0, how do I do it?
m
The recommended order is rolling deployment of controllers - brokers - servers - minions. Is this in production, are you running with replication or is downtime acceptable (if no replication)?
m
Thank you for the response, can you tell me the steps?, no replication, just 1 zookeeper, 1 controller, 1 broker and 1 server, this is development so downtime is acceptable.
I also want to ask, for the upgrade version of Apache Pinot, is the key in the jar file, I mean for version 1.1 using that version's jar file, but the other directories remain the same, I want to upgrade the version, can I copy it from the data directory which is in it? zookeeper, server and controller data, then the data directory is pasted in the new pinot version directory
I have tried copying the data directory from version 0.12.1 to version 1.1, when I start zoo, controller, broker it runs smoothly, the service is up, but when I start the server there is this error? I wonder why ? the error is below [apps@datastore-dev apache-pinot-1.1.0-bin]$ tail -f server.out WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.codehaus.groovy.reflection.CachedClass (file:/data/platform/apache-pinot-1.1.0-bin/lib/pinot-all-1.1.0-jar-with-dependencies.jar) to method java.lang.Object.finalize() WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.reflection.CachedClass WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2024/04/04 090105.443 INFO [StartServerCommand] [main] Executing command: StartServer -clusterName PinotCluster -serverHost null -serverPort 8098 -serverAdminPort 8097 -serverGrpcPort 8090 -serverMultistageServerPort 0 -serverMultistageRunnerPort 0 -configFileName conf/pinot-server.conf -zkAddress localhost:2181 2024/04/04 090105.634 INFO [StartServiceManagerCommand] [main] Executing command: StartServiceManager -clusterName pinot-datastore -zkAddress localhost:2181 -port -1 -bootstrapServices [] 2024/04/04 090105.635 INFO [StartServiceManagerCommand] [main] Starting a Pinot [SERVICE_MANAGER] at 1.573s since launch 2024/04/04 090105.640 INFO [StartServiceManagerCommand] [main] Started Pinot [SERVICE_MANAGER] instance [ServiceManager_datastore-dev.tritronik.com_-1] at 1.579s since launch 2024/04/04 090105.644 INFO [StartServiceManagerCommand] [Start a Pinot [SERVER]] Starting a Pinot [SERVER] at 1.583s since launch Apr 04, 2024 90158 AM org.glassfish.grizzly.http.server.NetworkListener start INFO: Started listener bound to [0.0.0.0:8097] Apr 04, 2024 90158 AM org.glassfish.grizzly.http.server.HttpServer start INFO: [HttpServer] Started. 2024/04/04 090210.969 ERROR [StartServiceManagerCommand] [Start a Pinot [SERVER]] Failed to start a Pinot [SERVER] at 66.907 since launch java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:8443 at org.apache.pinot.server.worker.WorkerQueryServer.start(WorkerQueryServer.java:92) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.server.starter.ServerInstance.startQueryServer(ServerInstance.java:222) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.server.starter.helix.BaseServerStarter.start(BaseServerStarter.java:640) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.tools.service.PinotServiceManager.startServer(PinotServiceManager.java:167) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.tools.service.PinotServiceManager.startRole(PinotServiceManager.java:97) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.tools.admin.command.StartServiceManagerCommand$1.lambda$run$0(StartServiceManagerCommand.java:279) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.tools.admin.command.StartServiceManagerCommand.startPinotService(StartServiceManagerCommand.java:305) [pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.tools.admin.command.StartServiceManagerCommand$1.run(StartServiceManagerCommand.java:279) [pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:8443 at org.apache.pinot.query.service.server.QueryServer.start(QueryServer.java:80) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.server.worker.WorkerQueryServer.start(WorkerQueryServer.java:90) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] ... 7 more Caused by: java.lang.RuntimeException: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:8443 at org.apache.pinot.query.mailbox.channel.GrpcMailboxServer.start(GrpcMailboxServer.java:57) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.mailbox.MailboxService.start(MailboxService.java:78) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.runtime.QueryRunner.start(QueryRunner.java:137) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.service.server.QueryServer.start(QueryServer.java:77) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.server.worker.WorkerQueryServer.start(WorkerQueryServer.java:90) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] ... 7 more Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:8443 at io.grpc.netty.shaded.io.grpc.netty.NettyServer.start(NettyServer.java:326) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at io.grpc.internal.ServerImpl.start(ServerImpl.java:185) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at io.grpc.internal.ServerImpl.start(ServerImpl.java:94) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.mailbox.channel.GrpcMailboxServer.start(GrpcMailboxServer.java:55) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.mailbox.MailboxService.start(MailboxService.java:78) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.runtime.QueryRunner.start(QueryRunner.java:137) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.query.service.server.QueryServer.start(QueryServer.java:77) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] at org.apache.pinot.server.worker.WorkerQueryServer.start(WorkerQueryServer.java:90) ~[pinot-all-1.1.0-jar-with-dependencies.jar:1.1.0-c2606742bbc4b15cff857eb0ffe7ec878ff181bb] ... 7 more Caused by: io.grpc.netty.shaded.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use ^C
Why is there an error when starting the server, port 8443 is already in use, why does the server require port 8443, instead of that port for the broker?