What ways is there to remove the sample data for some of our sensitive redshift tables?
b
better-orange-49102
08/17/2022, 9:11 AM
There shd be a profiling.allow_deny_patterns.deny to block off certain columns from being profiled. Believe you can go down to table.column level
s
square-solstice-69079
08/18/2022, 6:34 AM
Thanks @better-orange-49102, I will try to do that. @big-carpet-38439 that would probably helpful in some cases for sure.
c
careful-insurance-60247
08/19/2022, 1:43 PM
It would be nice to control which users could see those sample rows and/or columns.
b
big-carpet-38439
08/23/2022, 4:53 PM
That's a critical requirement for the feature, in other words?
c
careful-insurance-60247
08/24/2022, 1:09 PM
I would say yes. We have Data processing agreements with some of our customers to comply with gdpr and other data privacy frameworks. The ability to 1) not profile or grab the data from those columns and/or 2) be able to pseudonymize the data before storing it in datahub would be a requirement. Disabling profiling those datasets is problematic as they would be often referenced.