<@U078Y59KC3B> We're working on a project that inv...
# ask-ai
j
@RunLLM We're working on a project that involves building new pipelines in Pulsar using Pulsar Functions, and we're currently using the Python SDK. We've noticed that support seems a bit uneven—some config options and methods (especially around batching) aren't exposed through the Function wrapper. The documentation sometimes references features that don’t appear to be fully supported in the Python SDK. Many of the example projects we've found on GitHub also seem to be a few years old, which makes us wonder about the current state of support for Python. We really like working with Pulsar, but we're trying to assess the long-term viability of committing to the Python SDK. Are there any updates or recommendations you can share? Would we be better off using Java or Go to avoid potential rewrites down the line? cc: @Sreenath Sasidharan
r
The Python SDK for Pulsar Functions does have some limitations compared to Java and Go, particularly in terms of feature support and documentation. According to the Pulsar Functions documentation, Java and Go are more robustly supported, with more comprehensive APIs and examples. The Python SDK, while functional, may not expose all configuration options and methods, especially for advanced features like batching. If your project requires features that are not fully supported in the Python SDK, or if you anticipate needing more advanced functionality in the future, it might be worth considering using Java or Go. These languages have more mature support within the Pulsar ecosystem, and you are less likely to encounter limitations that could necessitate a rewrite. Would you like more detailed information on specific features or guidance on transitioning to another language? Sources: - Pulsar Functions documentation 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.
j
@RunLLM We have workarounds for the current feature set and have been able to do what we need so far, but we are concerned with long-term support of the Python SDK.
r
The long-term support for the Python SDK in Pulsar is a valid concern, especially given the current limitations and the more robust support for Java and Go. According to the Pulsar Python client documentation, the Python client is maintained, but it may not receive the same level of updates or feature parity as Java or Go. If your project can manage with the current feature set and workarounds, continuing with Python might be feasible in the short term. However, for long-term projects, especially those that may require new features or optimizations, considering a transition to Java or Go could be beneficial. These languages are more likely to receive timely updates and comprehensive support from the Pulsar community. Would you like more detailed guidance on transitioning to another language or information on specific features? Sources: - Pulsar Python client documentation 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.