Don’t eat my data - 30+ years of storage war stories
Arena | Mon 13 Jan | 4:55 p.m.–5:25 p.m.
Presented by
-
Steven Ellis
@StevensHat
http://people.redhat.com/sellis
Steve's is an Open Source Technology Evangelist in the APAC Office of Technology team at Red Hat. In the last 25+ years he worked as a developer and transitioned to an infrastructure and operations architect across a broad range of Unix and Linux technologies. For most of that period he’s used Open Source technologies to solve business problems, and on many occasions recover lost data. He freely admits that there have been occasions of data loss, and recovery during that career and really hopes some of the session attendees can avoid his past mis-steps.
In his spare time he still hacks on the MythTV project and debugs Open Source on random bits of hardware that really should know better.
Steven Ellis
@StevensHat
http://people.redhat.com/sellis
Abstract
We are in an era of explosive data growth, with everything from cat pictures to NASA’s incredible archive of space photography, and this all needs to be stored and catalogued in a reliable and easily accessible form. How can we safely store/backup/manage this data across a diverse range personal devices, never mind the challenges of enterprise class scale out storage, with the occasional (rain) cloud along the way?
We’ll start off with a bit of history on data storage formats to set the scene, and then dig into some stories from the last 35+ years of Steven’s own journey in IT, with some names changed to protect the “innocent”.
Themes covered will include
Getting physical
Bits, Bytes, Blocks and Blobs, with a file or three
Performance sanity tests
Hardware Raid - pain or pleasure?
File-system selection and why checksums matter
Going mad with MDADM (part 2)
DRBDont
HA NFS aren't the droids you're looking for
Vacuum Cleaners and Dehumidifiers
Raid is not a backup, and erasure coding isn’t about data deletion
The cloud is just someone else’s SAN
When physical disks trump flash storage
Linux Australia: http://mirror.linux.org.au/pub/linux.conf.au/2020/arena/Monday/Dont_eat_my_data_30_years_of_storage_war_stories.webm
YouTube: https://www.youtube.com/watch?v=PUuTUxnqX0g
We are in an era of explosive data growth, with everything from cat pictures to NASA’s incredible archive of space photography, and this all needs to be stored and catalogued in a reliable and easily accessible form. How can we safely store/backup/manage this data across a diverse range personal devices, never mind the challenges of enterprise class scale out storage, with the occasional (rain) cloud along the way? We’ll start off with a bit of history on data storage formats to set the scene, and then dig into some stories from the last 35+ years of Steven’s own journey in IT, with some names changed to protect the “innocent”. Themes covered will include Getting physical Bits, Bytes, Blocks and Blobs, with a file or three Performance sanity tests Hardware Raid - pain or pleasure? File-system selection and why checksums matter Going mad with MDADM (part 2) DRBDont HA NFS aren't the droids you're looking for Vacuum Cleaners and Dehumidifiers Raid is not a backup, and erasure coding isn’t about data deletion The cloud is just someone else’s SAN When physical disks trump flash storage Linux Australia: http://mirror.linux.org.au/pub/linux.conf.au/2020/arena/Monday/Dont_eat_my_data_30_years_of_storage_war_stories.webm YouTube: https://www.youtube.com/watch?v=PUuTUxnqX0g