Hi! I hope this is the right place to start a question. I am very much a beginner, so I apologize if my approach is all wrong. However, this is what I want to do, and I am having trouble knowing if Starrocks is a good way to sink or store the data in. I want to build a pipeline from stripe webhooks into starrocks. I am currently receiving the webhooks with nodejs and storing them in couchdb as my temporary queue/buffer, and then listening to the change feed to drive storing of the data into some database. Is there a good pattern for this type of sporratic /real time ingestion that works well.

might want to checkout Estuary Flow, realtime connectors for stripe directly, or the HTTP inject webhook, and then data can be exposed as a kafka-compatible endpoint using the destination option dekaf. good solution for realtime. for non-realtime / batch, 1 option is Airbyte, which has a strip connector, but i'm not sure best way to get the data into starrocks, since they don't have a starrocks destination. it's possible to write data to iceberg tables, and then query thru starrocks. both these tools are open source, although estuary flow will be harder to setup locally, whereas airbyte is easy.