Hello everyone Do you have flink jobs helmchart repo which i Apache Flink #random

Hello everyone, Do you have flink-jobs helmchart r...

vasanth narala

07/03/2023, 4:36 PM

Hello everyone, Do you have flink-jobs helmchart repo which is compatible with this flink-kubernetes-operator or any example helmchart job deployment Please suggest it will be really helpful Thanks a lot

Gyula Fóra

07/05/2023, 8:19 AM

We don’t have helm charts for job examples, but you can find the example yamls here: https://github.com/apache/flink-kubernetes-operator/tree/main/examples

vasanth narala

07/09/2023, 3:51 PM

Thanks

Marquis C

07/12/2023, 1:01 PM

@vasanth narala right now on our team we're doing simple "template" flink deployment style helm charts simple ex from a previous POC

Copy code

apiVersion: <http://flink.apache.org/v1beta1|flink.apache.org/v1beta1>
kind: FlinkDeployment
metadata:
  name: {{ .Values.metadata.name }}
spec:
  image: {{ .Values.flink.container.image }}
  flinkVersion: {{ .Values.flink.version }}
  flinkConfiguration:
    taskmanager.numberOfTaskSlots: "{{ .Values.taskManager.numberOfTaskSlots }}"
  {{- if .Values.serviceAccount.create }}
  serviceAccount: {{ .Values.serviceAccount.name }}
  {{ end -}}
  jobManager:
    resource:
      memory: {{ .Values.jobManager.resource.memory }}
      cpu: {{ .Values.jobManager.resource.cpu }}
  taskManager:
    resource:
      memory: {{ .Values.taskManager.resource.memory }}
      cpu: {{ .Values.taskManager.resource.cpu }}
  job:
    jarURI: {{ .Values.job.jarURI }}
    parallelism: {{ .Values.job.parallelism }}
    upgradeMode: {{ .Values.job.upgradeMode }}

Marquis C

07/12/2023, 1:07 PM

It doesn't encompass all the scenarios (like the job uri isn't optional so this wouldn't work for a session cluster)

Copy code

metadata:
  name: "basic-flink-example"
flink:
  version: "v1_15"
  container:
    image: "flink:1.15"
jobManager:
  resource:
    memory: "2048m"
    cpu: 1
taskManager:
  numberOfTaskSlots: "2"
  resource:
    memory: "2048m"
    cpu: 1
job:
  jarURI: local:///opt/flink/examples/streaming/StateMachineExample.jar
  parallelism: 2
  upgradeMode: stateless

serviceAccount:
  create: true
  name: flink-basic-example-sa
  namespace: default

vasanth narala

07/17/2023, 6:26 AM

Thanks @Marquis C If you have Github repo can you please provide will track the changes

Gyula Fóra

07/17/2023, 6:31 AM

The value here I feel is very limited because you are making almost every spec field configurable essentially moving the entire FlinkDeployment schema to the values .yaml

Gyula Fóra

07/17/2023, 6:32 AM

It's basically the same as writing the entire FlinkDeployment yaml with placeholders but without the possibility of making changes

vasanth narala

07/17/2023, 6:51 AM

M C (Mac)

07/17/2023, 10:05 PM

I think it’s a net benefit to leverage helm to help with the “package management” aspects, but agreed the simple example isn’t really super valuable.

M C (Mac)

07/17/2023, 10:06 PM

Internally we couple this with, creating service accounts with perms to s3 roles and other ancillary tidbits that don’t come directly from the crd.

2 Views

Open in Slack

Previous Next