@RunLLM I want to use Pulsar Functions to consume a partitioned topic in Key_Shared mode. Does Pulsar Function support (micro)batch read from a topic?

It seems likely that Pulsar Functions can consume from partitioned topics in Key_Shared mode, as Pulsar Functions support all subscription types, including Key_Shared, and can consume from one or more topics, including partitioned ones. Regarding (micro)batch reads, Pulsar Functions process messages one at a time by default, but there is ongoing work to support input topic batching in EFFECTIVELY_ONCE mode, as discussed in a recent pull request. However, full (micro)batch read support for Pulsar Functions is not explicitly documented as generally available yet, and batch processing is not the default behavior for Pulsar Functions today. Would you like more detail on how to configure batching or the current limitations for batch processing in Pulsar Functions? Sources: - https://github.com/apache/pulsar/blob/master/pulsar-client-api/src/main/java/org/apache/pulsar/client/api/Consumer.java - https://github.com/apache/pulsar/blob/master/pulsar-functions/worker/src/main/java/org/apache/pulsar/functions/worker/FunctionActioner.java 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.