Hi, team. Is there a way to replace queries sectio...
# ingestion
m
Hi, team. Is there a way to replace queries section for dataset when ingesting it? When you ingest new query, it doesn't replace existing queries, but appends to them.
h
Hi @miniature-journalist-76345 Currently UI shows entire set of top sql queries reported in past month. So if top queries are ingested for everyday, you'll see all the top queries from past month.
How frequently do you ingest queries ? Were you hoping to see only the newest queries after every ingest ?
m
We're ingesting them every day, and if, for example, some columns get removed, queries may become invalid
So I'm looking for a way to replace queries. Guess I'll have to manually remove this aspect before ingesting new one?
h
Right. That would be easier.. you can do it before or after ingesting new one. or if you only need to remove sql queries only and keep other info (user count, etc), you can re-ingest the older aspect (aspect with invalid query) with exactly same timestamp and updated/empty sql queries.
m
Hmm, ingesting same timestamp will overwrite them?
That looks like a good workaround
h
yes
m
But if this timestamp is more than a month older, query will not be displayed?
h
yes, that's what I would expect.
m
Then I need a better workaround 😞
Guess I'll stick to deleting aspect