We keep getting issues where Permit can't access o...
# permit-saas
s
We keep getting issues where Permit can't access our PDP. It keeps returning 500s until we restart it, when it starts working again for a couple minutes and then stops. It doesn't fully stop it's just on users that are newly added.
a
Hi @Stephen Morrison, I'm an AI assistant for Permit.io. I'll analyze available sources and get back to you shortly.
p
Hey, thanks for reaching out ! It seems our team is a little busy right now, a human will be with you within the next hour or so. In the meantime, can I help you ?
a
This sounds like a data synchronization issue where new users aren't being propagated to your PDP properly. The PDP uses OPAL to stream policy and data changes in real-time (1) , and when this connection is interrupted, new user data won't be available for authorization decisions. Common causes for this behavior include: • WebSocket connection drops between the PDP and OPAL server (2) • Network/DNS resolution issues preventing the PDP from reaching the control plane (3) • The PDP's cache not updating with new user data To help our engineers investigate this issue, please provide: 1. Which Workspace / Project / Env you are using 2. What calls are you performing (as SDK code or CURL examples) 3. Which PDP version you are running 4. Relevant logs from your PDP, especially: • Any connection errors to
<http://api.permit.io|api.permit.io>
or
<http://opal-v2.permit.io|opal-v2.permit.io>
• WebSocket disconnection messages • Errors related to data updates or OPAL synchronization The logs will help identify if this is a streaming update issue or a connection problem with the control plane.
s
You can see the latest logs here
a
To learn more, see the sources I considered: [[1] Permit's PDP (Policy Decision Point)](https://docs.permit.io/concepts/pdp/overview) [[2] Unable to push the policy data since OPA is not ready yet in sidecar pattern](https://github.com/permitio/PDP/issues/266) [[3] Docker image errors out - cannot get config from control plane](https://github.com/permitio/PDP/issues/251)
s
This just started happening in the last couple hours
Now it's totally broken
o
Hi @Stephen Morrison, thanks for reaching out. 1. Can you clarify "Permit can't access our PDP" - The connection is usually the otherway around 2. Does this replicate on PDPs running elsewhere (e.g. on your local machine) - as to try and eliminate networking issues from the list of suspects 3. Please answer the questions provided by the AI agent
s
So I'm guessing it has to do with the current outage
Just saw the statuspage update
o
Sorry just got the update from the team. it seems our OPAL server is down because GitHub is down https://www.githubstatus.com/
🤔 1
s
Got it
o
Things should be back to normal now or very shortly