hello, I'm trying to count total number of user logins to the datahub. As I know .ds-datahub_usage_event-00000x file contains user activity events. I can get all events before 27th June 2022. However, events created after 27th June are not found in the elasticsearch db. Do new events stored into somewhere different place?

Did someone login into DataHub after that? They are not stored somewhere else. There is no such special logic like that. Can you list all indices? Maybe the number just increased?

@square-activity-64562 tnx. It seems elastic search not showing more than 10k rows as it's default number. So I have to do something like search_after or scroll api. Tried both of them with no luck. Still struggling to get total number of login.

perhaps add a filter by timestamp, make multiple calls and then add them up

yep, should try 🙂 thank for good idea