Hi community, i am using a lot the python api. Now...
# ingestion
b
Hi community, i am using a lot the python api. Now we encouter the probleme, that we want to emit a lot of events, but with the datahub emitter that needs time.. somebody has a solution to emit a list of mcp events to datahub or something similar? i thought about a mcp stack, which could be emitted parallel to creating events.
g
The rest emitter can be used in a multithreaded way to do this. In fact, the rest sink has a max_threads option to configure this behavior as well
You can generate the mcps to a file and then ingest them using the rest sink
b
Thanks, i also thought about that