Towards A Community Of Distributed Systems Developers

August 31, 2012

Pat Helland's 2007 position paper Life beyond Distributed Transactions: an Apostate's Opinion includes the following paragraph in the abstract (in reference to the purpose of the paper):

The reason for starting this discussion is to raise awareness of new patterns for two reasons. First, it is my belief that this awareness can ease the challenges of people hand-crafting very large scalable applications. Second, by observing the patterns, hopefully the industry can work towards the creation of platforms that make it easier to build these very large applications.

This closely parallels what Basho is attempting to build with developers writing and deploying scalable systems. If you have more than one machine, you have a distributed system, and this changes things. The Basho team lives and breathes distributed systems - both at the software and company level - and though Riak is our preferred method for storage, retrieval, and querying of data over N machines, we have a passion for sound distributed fundamentals at the lowest level possible. There are many good technologies in the realm of data storage. Riak is just one of them.

For the past three years or so we've been using Riak as the binary embodiment of our beliefs in how distributed data storage should function. In addition to actual software, we've used other methods like blogs, meetups [ 1 2 ], and presentations to get this message across. We now have the opportunity to do so with a proper conference: RICON2012

In that vein, I recently had an exchange with Marco Gallotta in which he asked if it would be valuable for him to attend even though he wasn't using Riak:

My response (pardon the typo I just discovered) sums up what we're trying to do with RICON. There are no silver-bullet, physics-defying databases. There are only tradeoffs and the design decisions you need to make when taking them into account. Most (if not all) of the talks from the presenting community members (be they Riak users or otherwise) will not be 100% positive. No one at Basho is reviewing slides or censoring talks. Speakers will be giving honest accounts of the good and bad aspects of using distributed systems in production. This is why we've asked awesome speakers like Selena Deckelmann to come talk about PostgreSQL; and Dana Contreras to talk about how Twitter rebuilt itself on the fly; and Joseph Hellerstein to talk about new, powerful tools like BLOOM and CALM that could (and will) open up new doors for developers.

Come to RICON if you love HBase and want to tell the world why it's the best column store available today; if you think Cassandra is the future of databases; if you have 1TB of data in Redis and are considering writing your own sharding logic. As my colleague jtuple pointed out yesterday, there will be plenty of content on the future of Riak, but on the whole we're doing our part to convene a community of developers and architects who want to apply what academia and a relatively small group of developers have been excited about for years. Come to RICON to be a part of this. It's our first opportunity to bring the community together in the flesh, and we're damn excited about it.

Mark