This message was deleted.

you can put bookie config here. https://github.com/apache/pulsar-helm-chart/blob/b3c19fd7fc7067e67940244777dd4241c8295dd4/charts/pulsar/values.yaml#L559

Hello Yu Wei Sung, Thanks, i use the same config, you can see a bookkeeper.conf (part without comments)

## DB Ledger storage configuration
dbStorage_writeCacheMaxSizeMb=32
dbStorage_readAheadCacheMaxSizeMb=32
dbStorage_readAheadCacheBatchSize=1000
dbStorage_rocksDB_blockCacheSize=8388608

# Other RocksDB specific tunables
dbStorage_rocksDB_writeBufferSizeMB=8
dbStorage_rocksDB_sstSizeInMB=64
dbStorage_rocksDB_blockSize=65536
dbStorage_rocksDB_bloomFilterBitsPerKey=10
dbStorage_rocksDB_numLevels=-1
dbStorage_rocksDB_numFilesInLevel0=4
dbStorage_rocksDB_maxSizeInLevel1MB=256

# Settings below are used by stream/table service

extraServerComponents=org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent
storageserver.grpc.port=4181
dlog.bkcEnsembleSize=3
dlog.bkcWriteQuorumSize=2
dlog.bkcAckQuorumSize=2
storage.range.store.dirs=data/bookkeeper/ranges
storage.serve.readonly.tables=false

In fact, the only difference is that I had to add the variable "extraServerComponents=org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent" because otherwise port 4181 is never open.

access denied. can you shell into bookie pod and check the owner of /pullsar/data?

Thanks ! its ok when i add volume /pulsar/data/bookkeeper/ranges

$ bin/pulsar-admin functions querystate --tenant public --namespace default --name wordcount --key test --watch
{
  "key": "test",
  "stringValue": "hello pulsar",
  "version": 0
}

I don’t use helm chart because it is hard to control the version changes.

Apologies for hijacking this thread, but I'm also having trouble enabling stream/state storage on the bookie in k8s. @Yu Wei Sung - you commented that the bookie config can be included in the values.yml

configData

- would you mind providing an example of the format? I've tried the following (also tried replacing

.

with

_

in the property names). (I'm using a replica count of 1 to test on Minikube)

bookkeeper:
  replicaCount: 1 # default 4
  configData:
    extraServerComponents: "org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent"
    storageserver.grpc.port: "4181"
    dlog.bkcEnsembleSize: "1"
    dlog.bkcWriteQuorumSize: "1"
    dlog.bkcAckQuorumSize: "1"
    storage.range.store.dirs: "data/bookkeeper/ranges"
    storage.serve.readonly.tables: "false"
    <http://storage.cluster.controller.schedule.interval.ms|storage.cluster.controller.schedule.interval.ms>: "30000"

... but only

extraServerComponents

gets picked up. I had what I believe is a similar issue configuring it in Docker because

apply-config-from-env.py

only applies values which already have defaults in

bookkeeper.conf

and the various storage server properties are not in

bookkeeper.conf

. Running in Docker I had to 'add' them to the conf file as follows:

command: >
      bash -c "
        bin/apply-config-from-env.py conf/bookkeeper.conf &&
        echo 'storageserver.grpc.port=4181' >> conf/bookkeeper.conf &&
        echo 'dlog.bkcEnsembleSize=1' >> conf/bookkeeper.conf &&
        echo 'dlog.bkcWriteQuorumSize=1' >> conf/bookkeeper.conf &&
        echo 'dlog.bkcAckQuorumSize=1' >> conf/bookkeeper.conf &&
        echo 'storage.range.store.dirs=data/bookkeeper/ranges' >> conf/bookkeeper.conf &&
        echo 'storage.serve.readonly.tables=false' >> conf/bookkeeper.conf &&
        echo '<http://storage.cluster.controller.schedule.interval.ms|storage.cluster.controller.schedule.interval.ms>=30000' >> conf/bookkeeper.conf &&
        exec bin/pulsar bookie
      "

Many thanks (oh, and I'm using Pulsar 3.0.0 Docker images. So weird that Helm chart version 3.0.0 doesn't use image versions 3.0.0?!)

I think you need to add “PULSAR” as prefix to the new variables. like PULSAR_storageserver.grpc.port: “4181"

Thanks, I'll give that a try