Hi Team, I tried upgrading to the latest version a...
# troubleshoot
t
Hi Team, I tried upgrading to the latest version and the permissions broke. I use to ingest Azure groups and assign permissions to these groups. The
groups
is blank now. I tried using datahub user to assign my user Admin and then login using my user. I still did not have admin privileges.
šŸ‘€ 1
Any idea why this might be happening?
a
HI @thankful-morning-85093, what version did you update from? Were those permissions created in 0.9.6?
t
I updated from 0.8.45
no, those permissions were created in the version which was released 4-5 months back
b
Hi @thankful-morning-85093. Between 0.8.45 and 0.9.6 we have introduced the concept of roles. These should not impact any existing policies or privileges that your users have. Perhaps you can share a concrete examples of the Policies that you have created to grant permissions to your Azure Groups? Did you manage a set of Policies on your own, or change the default policies provided by DataHub (e.g. all users policy)
t
I have groups which are ingested from Azure SAML groups
These have Policies assigned to them manually
We are not using roles. Ideally introduction of roles should not have impacted this, right?
In dev the groups got completely wiped off
I tried ingesting manually as well
b
Groups absolutely should not have been removed. Are you able to access your MySQL to do some checks for whether the aspects exist for your groups? • corpGroupInfo
There is nothing I can think of between versions that would remove groups. Only thing i may consider is that a reindexing failed (you would be able to see this in datahub-gms logs)
One thing you can attempt is to perform a restore indices on your cluster, which will basically refresh elasticsearch
t
I used the minor subversion
.1
and I can see the groups now
we don't have option to remove users from Roles?
Having Roles and Policies both can be conflicting?
We just added roles for 4 people to test the feature
The issue now is Admins are getting 404 on profile page
b
Okay please go to Users tab, there's where you can change roles.
t
Yes, I am already admin there
I restored indexes as well
Copy code
19:33:34.663 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener:47 - Successfully fed bulk request. Number of events: 3 Took time ms: -1
19:33:35.461 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.t.DataHubUsageEventTransformer:74 - Invalid event type: HomePageViewEvent
19:33:35.462 [ThreadPoolTaskExecutor-1] WARN  c.l.m.k.DataHubUsageEventsProcessor:56 - Failed to apply usage events transform to record: {"type":"HomePageViewEvent","actorUrn":"urn:li:corpuser:AThorat@xxx.com","timestamp":1674848014687,"date":"Fri Jan 27 2023 11:33:34 GMT-0800 (Pacific Standard Time)","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36","browserId":"4a6fdcb4-019c-4055-b2ff-6981f795f305"}
19:33:35.598 [pool-12-thread-6] INFO  c.l.m.filter.RestliLoggingFilter:55 - GET /entitiesV2?ids=List(urn%3Ali%3Acorpuser%3AAThorat@xxx.com) - batchGet - 200 - 132ms
19:33:35.599 [ThreadPoolTaskExecutor-1] INFO  c.l.m.k.t.DataHubUsageEventTransformer:74 - Invalid event type: HomePageViewEvent
19:33:35.599 [ThreadPoolTaskExecutor-1] WARN  c.l.m.k.DataHubUsageEventsProcessor:56 - Failed to apply usage events transform to record: {"type":"HomePageViewEvent","actorUrn":"urn:li:corpuser:AThorat@xxx.com","timestamp":1674848014606,"date":"Fri Jan 27 2023 11:33:34 GMT-0800 (Pacific Standard Time)","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36","browserId":"4a6fdcb4-019c-4055-b2ff-6981f795f305"}
This is the only things that seems fishy
no errors when I get unauthorized
I even tried deleting and recreating the policies
Any idea why this might be happening? I even ran the
restore-indices-job
@big-carpet-38439 I might have found the issue. When I login with the newer Datahub version and se my profile, I can see this
urn:li:corpuser:<mailto:AThorat@roku.com|AThorat@roku.com>
in the URL. In the older version (production one) of Datahub I see
urn:li:corpuser:<mailto:athorat@roku.com|athorat@roku.com>
is there a way I can desensitize Datahub of the case in email?