MySQL at FacebookInternet Company
Menlo Park, CA, CA 94025
- Software Company
- Education
- Science, Technology & Engineering
- Google DevelopersInterest
- See Moretriangle-down
MyRocks paper at VLDB
We published a paper "MyRocks: LSM-Tree Database Storage Engine Serving Facebook's Social Graph" at VLDB this year. You can download the paper from http://www.vldb.org/pvldb/vol13/p3217-matsunobu.pdf . Our MyRocks paper received Honorable Mention Award at the VLDB Industry Track.
The paper covers collections of our development, deployment and improvement of MyRocks in our social database (UDB). The following topics are covered.
... - UDB overview, challenges with B-Tree indexes and why we thought LSM-tree database optimized for flash storage was suitable (Section 2).
- How we optimized MyRocks for various read workloads and compactions (Section 3).
- How we migrated to MyRocks in production (Section 4).
- Then we show migration results in Section 5, followed by lessons learned in Section 6. Finally, we show related work in Section 7, and concluding remarks in Section 8.
I'm confident that it is a good paper, and is worth reading for MySQL and Database communities.
In our quest for service quality we're great fans of new inspection techniques in Linux - like BPF, and all the work Brendan Gregg did popularize them.
One neat trick is to figure out longest stalls per each stack trace in the system and see if they correlate with system outages.
Some gnarly stuff was uncovered in various components just by reviewing information provided by the top-waits inspection.
