I have a question about Profiling. I can see that ...
# uie
elegant-salesmen-99143
09/01/2022, 1:40 PMI have a question about Profiling. I can see that the field 'sub_type' here has 6 distinct values, but in samples I see three of the same values, Is it possible to see all 6 distinct values?
Or the field 'platfrom' has 8 distinct values, but I see none of them in samples - why is that?
d
dazzling-judge-80093
09/01/2022, 2:35 PMOn which platform did you run the profiling?
e
elegant-salesmen-99143
09/01/2022, 2:36 PM@dazzling-judge-80093 Hive
d
dazzling-judge-80093
09/01/2022, 4:18 PMThanks, I will have to check it but we use Great Expectation under the hood currently which, normally, I think, gets distinct values but it seems like for Hive it’s not 😞
e
elegant-salesmen-99143
09/01/2022, 4:33 PMThank you, I'll be waiting for you reply
elegant-salesmen-99143
09/06/2022, 9:57 AM@dazzling-judge-80093 Hello. Is there any update on this case?
elegant-salesmen-99143
10/05/2022, 4:00 PMhi @dazzling-judge-80093 do you have any new info on this one? I'm still interested in this question
d
dazzling-judge-80093
10/06/2022, 10:26 AMsorry, not really 😞
e
elegant-salesmen-99143
10/06/2022, 10:35 AM@dazzling-judge-80093 is there a way to research and solve this, what can I do to make it happen?
d
dazzling-judge-80093
10/06/2022, 10:37 AMI would check what query Great expectation runs for distinct count and check if it returns the correct distinct or not.
If not then we should either monkey patch in datahub or open a pr for GE
e
elegant-salesmen-99143
10/06/2022, 10:38 AMCool. Keep me updated on it please:)
elegant-salesmen-99143
10/27/2022, 3:39 PM@dazzling-judge-80093 sorry to bother you, but I'm still interested in resolving this issue. What's current status on it?