Hello. We are experiencing some issues with Graph API. We have around 6500 Redshift entities (datasets+containers) and experiencing some issues when trying to browse them in UI or thru Graph API, basically - api returns HTTP 503. Example: https://<hostname>/search?filter_platform=urn%3Ali%3AdataPlatform%3Aredshift&page=200&query= fails. Requesting very same from gms-restli api work flawlessly. Running gms-service in debug mode, I can see that all records are successfully retrieved from opensearch. This issue also reproduceable in demo instance (in graphiql)

Can you share the logs from gms’ console?

Hi. I would be happy to provide logs, but they likely would be redacted. Also, there seems to be an issue with logging in 0.9.3 (at least) due to removed dependencies (https://github.com/datahub-project/datahub/pull/6577/files#diff-49a96e7eea8a94af862798a45174e6ac43eb4f8b4bd40759b5da63ba31ec3ef7L183). I’ve been able to rebuild frontend and gms locally to get logging back, though.

Yes, 0.9.4+ has the logging fix. The number of deep pagination requests are somewhat cumulative as they are not cancelled. I suspect the restli api to have issues with deep pagination as well after some point.