So I'm working on a product recommendation system ...
# 🧶︱general
c
So I'm working on a product recommendation system where I sync products from my SQL database to Pinecone. The issue is when new products get added to SQL, I need to figure out which ones are new so I can push just those to Pinecone instead of re-syncing everything. Right now there's no way to ask Pinecone "what was the last item you received?" which would be a perfect flag for knowing where to start my sync from. Yeah I could track this in a separate SQL table with like a "last_synced_at" field, but honestly that feels like unnecessary overhead for what should be a pretty basic feature. Plus if I'm working with a team where other people are also pushing data to the same index, I'd have no visibility into what they last updated or when. Basically looking for something like a "get most recently upserted records" function or at least some metadata on the index itself showing the timestamp of the last write. Does something like this exist that I'm missing, or would this be worth a feature request?