This message was deleted.

Could work, worth a try... This KB might give ideas for other options. (It says it's for Imply or Imply Cloud, but I don't think it's really specific to that.)

I think the option @Ben Krug linked is going to be better— using HTTP is going to be unwieldy and tougher to scale!

We evaluated both options. The http ingestion works if we put an nginx as proxy in between, which converts the GET requests into proper query POST requests. We then have the freedom to configure an endpoint with parameters, e.g. to query chunks of data. It requires some setup but it might be more error prone to migrate data between different druid versions or setups (local storage vs s3 storage). The deep storage migration works like a charm for our purposes as well, so we have our toolkit ready. Thanks!