Hi there, I'm experimenting a new paradigm for str...
# showcase
p
Hi there, I'm experimenting a new paradigm for streaming complex queries in real time to clients. afaik, Supabase can stream row level changes, Sangre would stream query level changes. Queries could be as complicated as you want, even with data coming from external webservices injected on the fly. If you are curious about it, I'd love to have a quick chat with you 🙂 https://github.com/pomarec/sangre PS: thanks for the great work on realtime ! PS2: I hesitated with #867348150741237790 should i move it there ?
d
This seems very fancy
a
Are you building the results of these complex queries using only data streamed from realtime? If so, if a user makes an insert that builds a FK relationship with a row that was inserted before streaming began, it wouldn't be captured.
Okay, I see you are loading the entire table into memory. That will probably have an effect on scalability.
p
Nothing is fancy enought for us developers 😉
You are very right. Not implemented atm. The next step is to parametrize nodes, this would enable the propagation of the fk of the new row to the relevant input node.
Definitely. Once again, just a PoC atm. The ultimate goal would be nodes streaming only diffs between each other (they stream their full result atm), this would keep a "low" (depending on usage) memory footprint
In an another reality where this project is production ready (reliable, scalable, monitorable), would you see a need for it ?
Do you mean classy or over engineered / useless ?
a
yeah, definitely I think it's useful. We had a usecase for something exactly like this where we wanted to combine related entities into a single document for indexing on elastic search. So this will do it.
p
Is the code public ?
a
No
o
Hi @User interesting project, good job! Also you needn't to go in #867348150741237790. This channel is more about Supabase intern stuff, like suggesting about the discord, a library implementation, an improvement about the dashboard and so on
p
Alright thanks. Actually this could be part of supabase at some point if it makes sense to supabase, with or without me, I don't have specific plan for this project.
o
This is a good suggestion. I think adding you in the supabase-community github could be what you're looking for
I'm gonna up your project and let's see what gonna happen
p
Sounds good 🙂
2 Views