If I add a new DAFT custom data source, and I read...
# general
n
If I add a new DAFT custom data source, and I read from it, is it streaming in nature by default?
c
Yes! The DataSourceTask has a
Copy code
def get_micro_partitions(self) -> Iterator[MicroPartition]:
method that allows you to define an iterator, which daft will pull from in a streaming fashion
❤️ 1