Hi guys! I saw that we have “Data privacy manageme...
# getting-startedh
high-hospital-85984
02/03/2021, 7:06 PMHi guys! I saw that we have “Data privacy management for datasets” on the roadmap. Do we have any concrete plans for this yet? We would be interested in helping with the implementation
high-hospital-85984
02/03/2021, 7:08 PMAnd hopefully we could expand this to dataset fields
g
green-football-43791
02/03/2021, 7:12 PMOut of curiosity, what would you be looking for specifically?
m
mammoth-bear-12532
02/03/2021, 7:14 PM
@high-hospital-85984: are you imagining data field level compliance tagging here?
h
high-hospital-85984
02/03/2021, 7:14 PMTo start with we want to add “sensitivity” tags to tables, more specifically to columns.
m
mammoth-bear-12532
02/03/2021, 7:14 PM
Yeah that is something we have built and use heavily at LinkedIn ..
h
high-hospital-85984
02/03/2021, 7:15 PMyep, super simple to start. Tags would preferable be quite customizable, as they might differ between companies (we use a colour based scheme)
m
mammoth-bear-12532
02/03/2021, 7:16 PM
The way we did it was two-level ... first create a "taxonomy" of data types (e.g. email / phone-num / ... ) and then allow fields to be tagged with them... and separately have a relnship between the data types -> (is this a sensitive type or not?)
h
high-hospital-85984
02/03/2021, 7:16 PMCool, any chance of getting that into the open source code? 😉
m
mammoth-bear-12532
02/03/2021, 7:17 PM
if you're offering help, I'll take you up on it 🙂
h
high-hospital-85984
02/03/2021, 7:17 PMBut we wouldn’t mind adding some functionality to tag dataset fields, if the community sees some value in it.
✅ 1
high-hospital-85984
02/03/2021, 7:18 PMIf you can point us in the right direction, we can take it from there. BaseFieldMapping sort of looks promising, but seems to be tightly tied to transformations?
g
green-football-43791
02/03/2021, 7:28 PMOut of curiosity, what set of sensitivity tags are you interested in? Would it be a binary of sensitive/sensitive or will you have a scale?
green-football-43791
02/03/2021, 7:29 PMI've been thinking about creating an alternative table view that would allow for different types of tags, this is a mock I'm working on:
green-football-43791
02/03/2021, 7:29 PMgreen-football-43791
02/03/2021, 7:29 PMDoes this presentation align w/ your vision?
h
high-hospital-85984
02/03/2021, 7:40 PMOur scale (currently) is green, yellow, orange, and red.
high-hospital-85984
02/03/2021, 7:41 PMSo what you’re showing seems quite aligned, yes. I’m assuming that the
PIIFinancialhigh-hospital-85984
02/03/2021, 7:42 PMI’m secretly hoping for a tag-propagation feature, like in Apache Atlas, so hopefully we can find a solution that takes us closer to that 🙂
m
mammoth-bear-12532
02/03/2021, 7:45 PM
Yeah tag-propagation would be the next step for sure. This is just making sure that the tags render well for human consumption.
☝️ 2
h
high-hospital-85984
02/03/2021, 8:00 PMBut how do you suggest we get the ball rolling with this?
m
mammoth-bear-12532
02/03/2021, 8:08 PM
I would say, providing feedback on the metadata models ... what is working and what needs to change .. would be high leverage
2 Views