hey friends, I asked this sometime ago, i’m my com...
# troubleshooting
l
hey friends, I asked this sometime ago, i’m my company we are trying to move to pinot from another data source, we are trying to validate whatever we are storing in pinot is equal to what we have in our separate data source, how can you do this kind of validations with pinot? last time i was suggested to treat the underlying topic that our table consume from as the source of truth, does this still hold true? so you would compare the contests on that topic vs biquery? thanks for your help!
k
use time based queries and give enough buffer for all sources to catch up..
for e.g. compare
Copy code
select count(*) from T where time between t1 and t2

select sum(metric) from T where time between t1 and t2

select distinctCount(dim) from T where time between t1 and t2
run this on both the big query and Pinot
l
thank you!