What all possible ways to save on data transfer co...
# generall
Lalit Pagaria
03/21/2023, 1:47 PMWhat all possible ways to save on data transfer cost while migrating TBs of data away from AWS?
Sorry AWS folks, asking for a friend who like to move to Azure.
f
Felix GV
03/21/2023, 1:50 PMCompression 😄 ?
l
Lalit Pagaria
03/21/2023, 1:54 PMYeah good answer 🙂
Lalit Pagaria
03/21/2023, 1:54 PMData is mix of logs and media (image, audio and video).
m
Mitch
03/21/2023, 1:55 PMdefine TBs....https://docs.aws.amazon.com/snowball/latest/ug/whatissnowball.html might work out to be cheaper
f
Felix GV
03/21/2023, 1:55 PMColumnar formats for tabular data (ORC, Parquet) shrink data quite a bit.
In some cases, we have found that ZSTD provides terrific compression ratios as well.
Felix GV
03/21/2023, 1:56 PMFor image/audio/video, there aren’t miracles… most are already in compact codecs, so shrinking further means lossy compression, which may or may not be acceptable.
l
Lalit Pagaria
03/21/2023, 1:59 PMMitch, it is around 25TB.
Felix, yes that is the main problem regarding video (approx 15TB). Need to maintain quality of data hence asking.
m
Mitch
03/21/2023, 2:01 PM15Tb of video you're sorta stuck, pay the transfer toll.
f
Felix GV
03/21/2023, 2:03 PMJeez I’m glad we’re not in the cloud… we transfer many times that across regions every day in Venice 😅
l
Lalit Pagaria
03/21/2023, 2:05 PMCloud tax 😢
g
Gwen Shapira
03/21/2023, 8:10 PMso what is the cost of 15TB of videos out of AWS cloud?
Gwen Shapira
03/21/2023, 8:14 PMoh, looks like $900 for the first 10TB and $85 for each additional TB until 40... not cheap.
l
Lalit Pagaria
03/22/2023, 8:10 AMThis thread is great https://twitter.com/QuinnyPig/status/1443369346672168961. But this meme is my fav about data out.
💯 1
🤣 1