Hello everyone, hope you’ve been enjoying Hackatho...
# arm64
h
Hello everyone, hope you’ve been enjoying Hackathon so far :) I have a known issue I’ve been dealing with for a while and figured I’d ask if anyone has a solution. When I run a pipeline, it sometimes gives me:
Copy code
Command error:
  WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
From searching in Slack, it seems this is due to running on macOS (ARM64) in combination with Docker. When I rerun the same command locally, it might run successfully, or it might fail with the same error. in Codespaces runs successfully every time. Command:
nextflow run . -profile test,docker --outdir results
r
I am using colima when running on my mac, works fine usually
p
That warning is harmless, it's just telling you that the docker image was built for a different CPU architecture and your mac is emulating it to make it run.
Whilst the warning itself is harmless, not all x86 containers work on mac - this is part of the reason why we're putting a big effort into getting native arm64 images for all packages
When they're available and configured and you use the right config profile, you will no longer get that warning (and it'll run faster and better)
h
Yes, the warning is harmless but it's a bit of a pain.Big pipelines such as taxprofiler can run for 10+ minutes and then suddenly fails. I was hoping there'd be a way to bypass it, but it seems the only options are spinning up a VM, using Colima, or codespaces. Thanks for the answers, really looking forward to the native arm64 images!
p
You can help by identifying any packages used by taxprofiler that don't have ARM builds on bioconda, and then adding them 🙂
h
aaa great i ddint know that. I will do so 🙂
🙌🏻 1
By the way @Phil Ewels, a related question: when I run nf-test --update-snapshot locally, some MultiQC fles most of the time disappears from the snapshot. I assume a process fails under emulation and the pipeline aborts before MultiQC runs. Is that right?do you think that when i make nf-tests with update snapshot, deleting muliqc is also because of the arm?
p
MultiQC should run fine on arm64, but yeah, if you feed it fewer inputs then it'll generate fewer outputs
🙌 1
h
aaa yeah indeed, makes sense!!Thanks:)
👍🏻 1