https://pinot.apache.org/ logo
Join Slack
Powered by
The issue seems like PinotFs has not been initiali...
# troubleshooting
m
The issue seems like PinotFs has not been initialized. Also, any reason to not use the latest release 0.10.0?
👍 1
f
Let me try...
I'm using v0.10.0 and fails for controller pod (server pods initializes S3). controller log:
Copy code
2022/04/11 18:03:39.543 ERROR [StartServiceManagerCommand] [main] Failed to start a Pinot [CONTROLLER] at 30.096 since launch
java.lang.RuntimeException: Caught exception while initializing ControllerFilePathProvider
	at org.apache.pinot.controller.BaseControllerStarter.initControllerFilePathProvider(BaseControllerStarter.java:541) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.BaseControllerStarter.setUpPinotController(BaseControllerStarter.java:365) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.BaseControllerStarter.start(BaseControllerStarter.java:313) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.service.PinotServiceManager.startController(PinotServiceManager.java:118) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.service.PinotServiceManager.startRole(PinotServiceManager.java:87) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.command.StartServiceManagerCommand.lambda$startBootstrapServices$0(StartServiceManagerCommand.java:249) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.command.StartServiceManagerCommand.startPinotService(StartServiceManagerCommand.java:302) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.command.StartServiceManagerCommand.startBootstrapServices(StartServiceManagerCommand.java:248) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.command.StartServiceManagerCommand.execute(StartServiceManagerCommand.java:195) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.command.StartControllerCommand.execute(StartControllerCommand.java:188) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.Command.call(Command.java:33) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.Command.call(Command.java:29) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine.executeUserObject(CommandLine.java:1953) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine.access$1300(CommandLine.java:145) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at picocli.CommandLine.execute(CommandLine.java:2078) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:161) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:192) [pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
Caused by: org.apache.pinot.controller.api.resources.InvalidControllerConfigException: Caught exception while initializing file upload path provider
	at org.apache.pinot.controller.api.resources.ControllerFilePathProvider.<init>(ControllerFilePathProvider.java:107) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.api.resources.ControllerFilePathProvider.init(ControllerFilePathProvider.java:49) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.BaseControllerStarter.initControllerFilePathProvider(BaseControllerStarter.java:539) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	... 20 more
Caused by: java.lang.IllegalStateException: PinotFS for scheme: s3 has not been initialized
	at shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:518) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.spi.filesystem.PinotFSFactory.create(PinotFSFactory.java:78) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.api.resources.ControllerFilePathProvider.<init>(ControllerFilePathProvider.java:70) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.api.resources.ControllerFilePathProvider.init(ControllerFilePathProvider.java:49) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	at org.apache.pinot.controller.BaseControllerStarter.initControllerFilePathProvider(BaseControllerStarter.java:539) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
	... 20 more
controller configuration
Copy code
controller:
      segment:
        fetcher:
          protocols: file,http,s3
          s3:
            class: org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher
      storage:
        factory:
          class:
            s3: org.apache.pinot.plugin.filesystem.S3PinotFS
          s3:
            region: us-east-1
      data:
        dir: <s3://mybucket/data/>
And server configuration (that works)
Copy code
server:
      segment:
        fetcher:
          protocols: file,http,s3
          s3:
            class: org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher
      instance:
        dataDir: /tmp/pinot-tmp/server/index
        segmentTarDir: /tmp/pinot-tmp/server/segmentTars
      storage:
        factory:
          class:
            s3: org.apache.pinot.plugin.filesystem.S3PinotFS
          s3:
            region: us-east-1
Do you have any YAML config example to compare?
m
@User ^^
👍 1
f
Even if I following the official doc I can't connect to ZooKeeper manager:
Copy code
2022/04/11 20:34:05.423 ERROR [StartServiceManagerCommand] [main] Failed to start a Pinot [CONTROLLER] at 30.595 since launch
java.lang.NullPointerException: null
	at org.apache.helix.manager.zk.client.ZkConnectionManager.cleanupInactiveWatchers(ZkConnectionManager.java:112) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-e7ea235a1e0e94da02b5a8b171bba0b00d0d6076]
And there is a open bug (5802) related to connect ZK.
If I add (under controller)
Copy code
zk:
        str: "localhost:2181"
Previous issue is solved but I got
Copy code
2022/04/11 21:09:05.999 ERROR [StartServiceManagerCommand] [main] Failed to start a Pinot [CONTROLLER] at 3.836 since launch
java.lang.RuntimeException: Caught exception while initializing ControllerFilePathProvider
	at org.apache.pinot.controller.BaseControllerStarter.initControllerFilePathProvider(BaseControllerStarter.java:543) ~[pinot-all-0.10.0-SNAPSHOT-jar-with-dependencies.jar:0.10.0-SNAPSHOT-078c711d35769be2dc4e4b7e235e06744cf0bba7]
What is your opinion about 
ControllerFilePathProvider
error message?
x
is this from helm chart values.yaml?
Open in Slack
PreviousNext
Powered by