…even if none of my friends seem to think so.
I’ve been off on a bit of a tangent recently. Its a slow burn tangent, that I am pretty sure was kicked off by this Geek Narrator podcast episode about the design of Turbo Puffer with Simon Eskildsen:
The basic idea is that you can build very large scale database systems using only the primitives provided by an object store such as Amazon S3. Now, the performance might also suck, but you can alleviate some of that with a good caching layer and in return you get massive scale. This first video caused me to discover the work of Andy Pavlo, who was interviewed by the same podcast:
Andy is hilarious, and then I had to go and watch the videos from his CMU Introduction to Databases course, which were excellent:
But none of this gets me to the point of being able to convince my friends that I am not insane. Perhaps sqlite adding support for this very thing will improve my credibility.
Honestly, I think there are a lot of interesting systems that can be built on top of an immutable object store such as S3, and that we should be talking more about that.