Is there an item on the roadmap to implement the f...
# questions-and-troubleshooting
m
Is there an item on the roadmap to implement the functionality of the "merge" for the load API into the "insert" CLI function? This would be REALLY helpful. use case: we currently do backfill's and then sync operations using intermediate parquet files written to minIO, i.e.: 1. read from source 2. transform and write to parquet 3. use "insert+files" to insert data from parquet into a table. Problem is we may have multiple writers, especially during backfills, and streaming where it is possible that two versions of the a record from the source, with different versions (a column, lets just call it 'version') can be in the pipeline at the same time. we only want the record with the highest 'version' value written to the table. We'd prefer to keep using parquets and insert+files, but will change to API-based load with 'merge' if we have to. If the 'insert' function is modified to have the same 'merge' capability as load via API, that would be great. So, developers, anything you can tell me about a potential/planned cli update?