Morning! Yesterday we enabled onbservability in pr...
# agents
p
Morning! Yesterday we enabled onbservability in production, and today most of our sessions don't show any data yet. Some of them do, but I would say they are like 10% of our total. Any ideas why? We are in 1.0.20 + 1.3.6
d
Following! We are also facing same issue
w
we are experiencing the same issues
l
Assuming observability is enabled at the project level, and your agents are >=1.0.18
js
and >= 1.3.0
python
, then the only things that should prevent observability being uploaded are: • Recording disabled at the session level with
record=False
, https://docs.livekit.io/deploy/observability/insights/#disabling-at-the-session-level • Agent shutting down prematurely, before it is able to upload telemetry data. If none of those apply, could you please provide some session IDs where you would expect to see observability data? Also would like to know if this was working fine before, and recently started showing issues.
p
None of those apply to us, a couple of them: RM_eQzdAR7r5r8c, RM_cKsaVqs9uBEG
l
@prehistoric-lion-61312 thanks, and you DO see observability data for the other sessions, correct? e.g. in the 11 sessions between those times? Apologies if that sounds like a silly question, but I don't have access to see your observability data for privacy reasons.
p
Just on a couple of them, I have many of them that don't have observability data, and a few that do, for example RM_zuWV5mmKdMQ4 has data
d
@lively-winter-88668 - We are also facing same issue below is the session id RM_mNc4LJaomv9c
l
Thank you both - I have reported this internally as I'm not sure what's happening.
Our internal database has data for all of
RM_eQzdAR7r5r8c
,
RM_cKsaVqs9uBEG
and
RM_mNc4LJaomv9c
. Couple of requests: • Could you let me know if there is still no data there? In case there was some delay in processing it? • Could you see if there are JS console errors when you load the dashboard? Thanks.
p
I still don't see data, here RM_eQzdAR7r5r8c
m
RM_mNc4LJaomv9c
l
👀 thank you both
Just to update, the team are working on this - there is a fix on staging, but it hasn't been pushed to production yet.
🙌 1