Hey Saas-y devs 🙂 Happy Monday! 1. Any big audacious plans and goals for the week? Declare them in this thread, and let us know how it went! 2. I want to try a Follow Friday for this amazing community on Tweeter. Are you on twitter? Want your account mentioned as a SaaS development expert? Respond here with your twitter handle and I'll include you.

Goal: Release LittleHorse

0.1.0

to open-source with the Server-Side Public License on Wednesday, and get a successful implementation started at a certain insurance company.

Goal: Publish this fully automated demo on how ridiculously easy Confluent have made it to use Debezium to CDC from Postgres or MySQL RDS into systems like Tinybird.

Goal: figure out what went so wrong with my HTTP traffic mirroring that the NGINX and production exploded... 😭 (I think I know, but have to get my test harness to replicate the effect).

So, how did your week go?

A bad case of back pressure explosion - it appears I didn't understand NGINX Mirror module all the way, and one of those edges got us bad...

I got the first bit done fine - but I decided to get clever and implement the high volume version with a batch and speed layer in Clickhouse and ran into a bug, which led to a sidequest to fix said bug. And this week I'm on holiday in Portugal, so it's going to have to wait 😀

@Daniel Chaffelson I think we are living the same experience 🙂 (except I'm not on a holiday in Portugal. A bummer!)

As a benefit, we found that that naive implementation in Clickhouse was only 4x faster than processing everything ( 4.2s down to 1.5s), but adding a subquery to check a system table could reduce it to 41ms. Silver linings