Community for the Daft project and all things distributed data

Distributed Data Community

Hey guys, quick question - does daft support reading bloom filters on parquet files for iceberg reads and “where” condition clauses?

Assuming that writing of bloom filters at table level are already taken care of… 

Also a follow-up question on this… as far as I know arrow-rs has added support for bloom filters on parquet files. And since daft has completed migration to arrow-rs, does daft use those capabilities when using “write_iceberg” API?

Hey <@U09AG3TT021> currently neither read/write bloom filters are supported. This is a great issue to submit, though, because arrow-rs does indeed unblock the feature!