Apache Flink

i don't suppose anyone knows of a flink fork that is fixed at version 1.13 with m1 support? :sweat_smile:

Well Flink currently still doesn't support M1 completely so I don't think it exists for any version :smirk:

what about with the m1 backwards compatible thing - rosetta i think it's called? has anyone had any success with that?

Yes there are users who are using Rosetta for local development

Biggest open item right now is that Flink's RocksDB doesn't support M1 yet

If you skip tests, it will compile at the moment

do you know of any documentation around getting things running locally with rosetta?

No unfortunately not. Still want to have a look myself but haven't gotten the time yet

ah no worries at all, appreciate the heads up, this has saved me probably a few hours to find this out anyhow :rolling_on_the_floor_laughing:

You can keep an eye out on <https://issues.apache.org/jira/browse/FLINK-26981|https://issues.apache.org/jira/browse/FLINK-26981>

I just use docker with intel emulation, I'm able to run it locally like that for running unit tests and such.

If your jvm is an x86 jvm on an m1 mac, rocksdb should work

And x86 jvms can only be executed via rosetta 

<@U03H7GR1QRW> do you also run x86 IntelliJ?

But you can select which JVM to use for launching tests / debuggers / apps in IntelliJ, so you can use an ARM IJ to launch x86(rosetta) JVMs

On my new work mac book I got a few months ago, I did intentionally not install Rosetta (because uninstalling is hard / close to impossible), and I wanted to keep my system energy efficient and fast :wink:

Good to know, I was just about to install it :sweat_smile:. Do I get it correctly that the limitations that you face with such setup are:
• only being able to run Flink jobs with HashMapStateBackend locally
• not being able to run any tests that interact with RocksDB
?

<@U03QMBT962C> would you mind putting together some setup and usage instructions for this dockerized setup?

Hey Alexander, it should be as simple as using `-- platform linux/amd64` when building or running the service with your Flink job. For more on that, see here: <https://docs.docker.com/desktop/mac/apple-silicon/>

Be careful though, as that uses QEMU emulation which can cause things to run slower.

Thanks Jimmy. I thought you meant building and testing the Flink project itself, not the Flink jobs.