Join Slack
Powered by
After profiling a hive dataset the mean, max, medi...
# ingestion
r
rich-policeman-92383
01/27/2022, 5:20 PM
After profiling a hive dataset the mean, max, median and other values are unknown. The pipeline finished with no errors. What could be the cause of this. only Row count and column count are reported correctly.
w
witty-butcher-82399
01/27/2022, 7:07 PM
This happened to me yesterday
https://datahubspace.slack.com/archives/C029A3M079U/p1643211290327800
In my case the problem was max/min/mean/median/etc are skipped for
number
columns
l
little-megabyte-1074
01/27/2022, 7:49 PM
Hi
@rich-policeman-92383
! It might be related to this known issue when tables have fewer than 60 rows — we’re working on a fix!
https://datahubspace.slack.com/archives/C029A3M079U/p1643137816302600
r
rich-policeman-92383
01/27/2022, 7:50 PM
The table in question has 600billion rows
l
little-megabyte-1074
01/27/2022, 7:53 PM
🤦🏼♀️ ok, so certainly not the issue here! I’ll escalate to the team - let’s see what we can find out
r
rich-policeman-92383
01/27/2022, 8:00 PM
I will try with the debug flag enabled to see if i missed something.
l
little-megabyte-1074
02/01/2022, 7:46 PM
Hi
@rich-policeman-92383
! Checking in on this thread - are you still hitting the same issue with simple stats not showing up in the UI?
Open in Slack
Previous
Next