Lari Hotari
01/16/2024, 10:02 PMDaniel
01/17/2024, 1:15 PMLari Hotari
01/18/2024, 6:15 AMDaniel
01/18/2024, 1:31 PMWill Drake
01/18/2024, 5:41 PMLari Hotari
01/21/2024, 8:50 AMAlex Palmatier
01/22/2024, 6:29 PMLars
01/22/2024, 6:54 PMnamespace: "pulsar"
namespaceCreate: false
clusterName: "cluster-a"
initialize: false
components:
pulsar_manager: true
#workaround, see <https://github.com/apache/pulsar-helm-chart/issues/427>
broker:
configData:
proxyRoles: 'proxy-admin'
#superUserRoles: 'proxy-admin'
tls:
enabled: true
proxy:
enabled: true
broker:
enabled: true
zookeeper:
enabled: true
# issue selfsigning certs
certs:
internal_issuer:
enabled: true
type: selfsigning
pulsar_manager:
configData:
ENV_SPRING_CONFIGURATION_FILE: "/pulsar-manager/pulsar-manager/application.properties"
SPRING_CONFIGURATION_FILE: "/pulsar-manager/pulsar-manager/application.properties"
PULSAR_MANAGER_OPTS: " -Dlog4j2.formatMsgNoLookups=true"
#####For JWT Auth to work, probably something like that???
JWT_TOKEN: <token>
PRIVATE_KEY: <file://pulsar-manager/keys/token/private.key>
PUBLIC_KEY: <file://pulsar-manager/keys/token/public.key>
volumeMounts:
- mountPath: "/pulsar-manager/keys"
name: token-keys
readOnly: true
volumes:
- name: token-keys
secret:
secretName: pulsar-token-asymmetric-key
items:
- key: PUBLICKEY
path: token/public.key
- key: PRIVATEKEY
path: token/private.key
####
auth:
authentication:
enabled: true
provider: "jwt"
jwt:
# Enable JWT authentication
# If the token is generated by a secret key, set the usingSecretKey as true.
# If the token is generated by a private key, set the usingSecretKey as false.
usingSecretKey: true
authorization:
enabled: true
superUsers:
# broker to broker communication
broker: "broker-admin"
# proxy to broker communication
proxy: "proxy-admin"
# pulsar-admin client to broker/proxy communication
client: "admin"
Lari Hotari
01/23/2024, 10:39 AMLari Hotari
01/25/2024, 3:43 PMSagar Kaushal
02/05/2024, 5:28 PMSagar Kaushal
02/08/2024, 8:54 AMLari Hotari
02/23/2024, 8:08 PMLari Hotari
02/27/2024, 2:08 PMLars
02/28/2024, 10:01 AMauth:
authentication:
enabled: true
jwt:
usingSecretKey: false
provider: jwt
authorization:
enabled: true
superUsers:
broker: broker-admin
client: admin
proxy: proxy-admin
broker:
configData:
proxyRoles: proxy-admin
certs:
internal_issuer:
enabled: true
type: selfsigning
clusterName: cluster-a
components:
pulsar_manager: false
initialize: false
namespace: pulsar
namespaceCreate: false
tls:
broker:
enabled: true
enabled: true
proxy:
enabled: true
zookeeper:
enabled: true
Thank you!Tal Glanzman
02/29/2024, 5:27 PMdata-pulsar-broker-1.data-pulsar-broker.data.svc.cluster.local
). Which makes sense, I guess (?) the client connects to the broker and it then gets the names for the rest of the brokers, which are returned with their cluster local names.
I did
• Connect to the cluster successfully using the pulsar-shell cli tool using port forwarding
• Tried to expose the k8s' DNS and use the dnsLookupBind
and dnsServerAddresses
builder functions when initializing the client
What are my options here? Can I connect to the brokers using port forwarding?
The specific error:
19:09:04 [WARN ] o.a.p.c.i.ConnectionHandler [test] [null] Could not get connection to broker: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.CompletionException: org.apache.pulsar.shade.io.netty.resolver.dns.DnsResolveContext$SearchDomainUnknownHostException: Failed to resolve 'data-pulsar-broker-1.data-pulsar-broker.data.svc.cluster.local' [A(1), AAAA(28)] and search domain query for configured domains failed as well: [home] -- Will try again in 11.805 s
Thanks!Lari Hotari
02/29/2024, 6:09 PMDaniel
03/04/2024, 9:06 AMLari Hotari
03/15/2024, 12:39 PMJayLiu
03/19/2024, 8:36 AMJayLiu
03/19/2024, 8:37 AMJayLiu
03/19/2024, 8:38 AMJayLiu
03/19/2024, 9:01 AMJayLiu
03/19/2024, 9:01 AMJayLiu
03/19/2024, 9:17 AMLari Hotari
03/21/2024, 9:39 AMLari Hotari
04/02/2024, 1:38 PMGergely Fábián
04/04/2024, 8:31 PMFatih
04/18/2024, 10:42 AM08:18:38.703 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.4.0:59042] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
2024-04-18 10:18:38.703 +02:00 pulsar-proxy-1
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:37.869 +02:00 pulsar-proxy-3
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:37.869 +02:00 pulsar-proxy-3
08:18:37.869 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.4.0:1895] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
2024-04-18 10:18:37.569 +02:00 pulsar-proxy-3
08:18:37.569 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.4.0:1443] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
2024-04-18 10:18:37.569 +02:00 pulsar-proxy-3
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:37.429 +02:00 pulsar-proxy-2
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:37.429 +02:00 pulsar-proxy-2
08:18:37.429 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.4.0:21857] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
2024-04-18 10:18:25.800 +02:00 pulsar-proxy-2
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:25.800 +02:00 pulsar-proxy-2
08:18:25.079 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.12.0:44329] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
2024-04-18 10:18:25.662 +02:00 pulsar-proxy-0
io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
2024-04-18 10:18:25.662 +02:00 pulsar-proxy-0
08:18:25.662 [pulsar-proxy-io-2-1] WARN org.apache.pulsar.proxy.server.ProxyConnection - [/10.42.12.0:31666] Got exception NativeIoException : readAddress(..) failed: Connection reset by peer null
Lari Hotari
04/20/2024, 2:02 PM