Does anyone have a recommendation to allow multipl...
# ask-community-for-troubleshooting
a
Does anyone have a recommendation to allow multiple streams with the same format digested into one destination? https://github.com/airbytehq/airbyte/issues/2224
e
Hi. In this scenario what you need to do is to merge the data before you upload it i.e. I would create logic to save the data (only if it`s not more than 100GB of data) into some file format such as parquet (or what ever you want) and then read and push into 1 table. Other option is to use dask, pyspark etc.. to prepare the data before pushing into 1 table. so yes- it can be done. In any case you need to write some logic for that