venice


<https://engineering.fb.com/2022/11/21/production-engineering/future-computing-ptp/>

Anybody game to write a JNI wrapper for KuzuDB and plug it inside Da Vinci :smile: ?
<https://kuzudb.com/>

Looks like it comed from Waterloo. <@U043VEPGYG5> / <@U044B7B0BPT> (which one is the real one?), do you know the authors :smile: ?

DuckDB seems like a pretty impressive projects. Would be really cool to wire it in as a storage engine in Venice. They added UPSERT support in this release so it seems realistic to integrate it.
<https://duckdb.org/2023/02/13/announcing-duckdb-070.html>


<https://github.com/rust-rocksdb/rust-rocksdb>


<https://github.com/diegopacheco/rust-playground/tree/master/jni-fun>


<https://medium.com/@brian_90925/llms-and-the-emerging-ml-tech-stack-6fa66ee4561a>


<https://github.com/facebookresearch/faiss>


<https://twitter.com/thetaph1/status/1662148334134476835?s=12&amp;t=m6BQM90Va2-_ZODxR6K7FQ>


<https://github.com/ozangunalp/kafka-native>


<https://twitter.com/criccomini/status/1669002835038728192?s=12&amp;t=m6BQM90Va2-_ZODxR6K7FQ>


<https://twitter.com/apachekafka/status/1669385613697769472?s=12&amp;t=m6BQM90Va2-_ZODxR6K7FQ>

What about <https://github.com/risingwavelabs/risingwave> ?


<https://twitter.com/stereosky/status/1671174970687250432?s=12&amp;t=m6BQM90Va2-_ZODxR6K7FQ>


<https://news.apache.org/foundation/entry/the-apache-software-foundation-announces-new-top-level-project-apache-kvrocks>

Today we have open sourced <http://LangStream.ai|LangStream.ai>

<https://github.com/LangStream/langstream|https://github.com/LangStream/langstream>

Looking forward to an integration with Venice!

Very cool and congratulations. Curious where exactly is Venice in this eco-system?

We could implement Sinks and Query agents to read/write on Venice.
It is a matter of just writing the adapter code (probably less than 1k lines of code).
Look at the Pinecone agents

This looks interesting... <https://github.com/lancedb/lancedb|https://github.com/lancedb/lancedb>

I think you might be interested in this, <@U048Z66EUA0>

Would it be valuable to support plugging LanceDB as the storage engine, as another option, alongside RocksDB?

yeah that would be awesome,  How easy is it to integrate? LanceDB is pretty interesting with its Lance data format an  innovative and new columnar data format for ML. Lot of bets on lanceDB

Thinking out more on this, I think having the embedded storage engine in a way like our DaVinci client seems to be a good use-case (still needs some validation from real users). They can still use avro based rocksDB Venice to store the features and vectors (float is good with avro). Have lanceDB serving their application which ingests the required vectors and metadata as an embedded vectorDB. I guess a niche usecase to start with.

This looks cool: <https://www.linkedin.com/posts/christina-lin-14a4b655_kafka-wasm-streamingdata-activity-7110291117094391808-BguY|https://www.linkedin.com/posts/christina-lin-14a4b655_kafka-wasm-streamingdata-activity-7110291117094391808-BguY>

I wonder if there would be use cases for WASM in Venice :thinking_face:

<https://www.linkedin.com/posts/timeplusinc_timeplus-open-sources-its-powerful-streaming-activity-7110669790360346625-Mm3M|https://www.linkedin.com/posts/timeplusinc_timeplus-open-sources-its-powerful-streaming-activity-7110669790360346625-Mm3M>

Happy for Timeplus! I worked closely with these founding people during my Splunk days!

<https://www.linkedin.com/posts/nikhilgarg28_key-architectural-ideas-powering-fennels-activity-7108203961689522176-pcuE|https://www.linkedin.com/posts/nikhilgarg28_key-architectural-ideas-powering-fennels-activity-7108203961689522176-pcuE>

Could be interesting…
<https://db.cs.cmu.edu/events/ml-db-2023-featureform-yeah-your-database-can-do-that-simba-khadder/>

This might be interesting…
<https://github.com/TileDB-Inc/TileDB>