:wave: at our company we'd like to add support for...
# dev
b
👋 at our company we'd like to add support for GCS-based warehouses in the iceberg extension. to make that work properly i think there are a couple changes needed: 1. add an implementation of an
InputSourceFactory
for GCS and make it available to the iceberg extension 2. bump iceberg internally to 1.7+ in order to pick up this credential vending change i'd like to put in patches for these, i assume it would be better to do them as two separate patches? i also saw there's an open issue for iceberg integration testing which i can try to tackle; is there a preferred integration testing approach that already exists (testcontainers, etc)?
🚀 1
opened a PR for part 1 here: https://github.com/apache/druid/pull/19137
a
i also saw there's an open issue for iceberg integration testing which i can try to tackle; is there a preferred integration testing approach that already exists (testcontainers, etc)
For integration tests, we've been using the embedded test framework: https://github.com/apache/druid/tree/master/embedded-tests/src/test/java/org/apache/druid/testing/embedded for example, there's embedded resources for minio, kinesis, etc: https://github.com/apache/druid/tree/master/embedded-tests/src/test/java/org/apache/druid/testing/embedded/minio
🙏 1
b
https://github.com/apache/druid/pull/19143 ok here's a small PR that introduces an IT around the rest catalog