Hey guys, I’m a Flink newbie, it will be extremely...
# troubleshooting
m
Hey guys, I’m a Flink newbie, it will be extremely appreciated if anyone can assist: I have a kinesis source that is created by SQL API (
CREATE TABLE..
), then filtered twice by
SELECT x,y,z FROM KinesisSource WHERE ..
queries. Each of those
select
streams is inserted into a separate sink (also created with
CREATE TABLE...
). I run this setup in a
statementSet
.
Copy code
KinesisSource -> SELECT * where name = 'A' -> Sink 'A'
              -> SELECT * where name = 'B' -> Sink 'B'
1. Does anyone know why I see two tasks with the name “Sink: end”? It doesn’t seem that these are the two sinks I created because their bytes/records sent value is always the same (records sent of the first row divided by two) 2. “records sent” value keeps increasing although I don’t send anything. Can anyone explain why? (This happens in a
FlinkDeployment
but not in a local cluster setup) 3. Is there a way to configure the job so I can see the source, the filters, and the sinks in the graph + their correct data? 4. Am I doing this wrong?
5. the first image was running on a K8S
FlinkDeployment
. It looks different when running in a local cluster. Why? :(