We’re trying to get an understanding of the storag...
# getting-startedh
high-hospital-85984
10/08/2020, 9:58 AMWe’re trying to get an understanding of the storage volume needs on ES and Neo4J. Is anyone willing to share some numbers, for example Gb in Neo4J, ES versus number of elements in Datahub?
b
bumpy-keyboard-50565
10/08/2020, 11:41 AMLet me check with our SRE on the numbers
h
high-hospital-85984
10/08/2020, 1:49 PMThanks! 🙇
b
bumpy-keyboard-50565
10/08/2020, 9:13 PMAvg ~150KB/document in ES and ~3KB/(node or edge) in Neo4j. Of course this depends largely on how complex the documents, nodes, and edges are.
h
high-hospital-85984
10/09/2020, 3:07 AMPerfect, Thanks @bumpy-keyboard-50565 🙏
m
microscopic-receptionist-23548
10/09/2020, 8:46 PMJust to follow up here it really depends on the data 🙂
microscopic-receptionist-23548
10/09/2020, 8:47 PMour corp user index seems to average ~1 kb per document, and in total is well less than 100 mb. However, our dataset index is by far the largest in terms of number of document and disk size, and the average document size is much larger
microscopic-receptionist-23548
10/09/2020, 8:48 PM(we have indexed millions of datasets)
3 Views