Question : 1). Am keeping hdfs not in same server ...
# troubleshooting
m
Question : 1). Am keeping hdfs not in same server as pinot server. Hope this is possible.? a ) Followup question .If above option is possible. All I need to point pinot server.conf to have below values in controller and pinot server right? # HDFS Setups pinot.server.logger.root.dir=/var/log/pinot pinot.server.storage.factory.class.hdfs=org.apache.pinot.plugin.filesystem.HadoopPinotFS pinot.server.storage.factory.hdfs.hadoop.conf.path=/usr/odp/3.2.3.3-3/hadoop/conf pinot.server.segment.fetcher.protocols=hdfs pinot.server.segment.fetcher.hdfs.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher pinot.server.instance.enable.split.commit=true pinot.server.grpc.enable=true pinot.server.instance.segment.store.uri=hdfs://staging-pinotpoc101.rapid.ew:8020/pinotperf
x
HDFS can be used as a deep store
It cannot be on the critical path for querying
you need to configure a server data dir
m
Sorry dint get that one. My question is should hdfs needs to be co-hosted on same server as pinot server?
x
No
Deep store is designed to be a remote storage layer