Apache Cassandra
Apache Cassandra is a free and open-source, distributed, wide column store, NoSQL database management system designed to handle large amounts of data across many commodity servers, providing high availability with no single point of failure. Cassandra offers robust support for clusters spanning multiple datacenters, with asynchronous masterless replication allowing low latency operations for all clients. Cassandra offers the distribution design of Amazon Dynamo with the data model of Google's Bigtable.
History
Avinash Lakshman, one of the authors of Amazon's Dynamo, and Prashant Malik initially developed Cassandra at Facebook to power the Facebook inbox search feature. Facebook released Cassandra as an open-source project on Google code in July 2008. In March 2009 it became an Apache Incubator project. On February 17, 2010 it graduated to a top-level project.Facebook developers named their database after the Trojan mythological prophet Cassandra, with classical allusions to a curse on an oracle.
Releases
Releases after graduation include- 0.6, released Apr 12 2010, added support for integrated caching, and Apache Hadoop MapReduce
- 0.7, released Jan 08 2011, added secondary indexes and online schema changes
- 0.8, released Jun 2 2011, added the Cassandra Query Language, self-tuning memtables, and support for zero-downtime upgrades
- 1.0, released Oct 17 2011, added integrated compression, leveled compaction, and improved read-performance
- 1.1, released Apr 23 2012, added self-tuning caches, row-level isolation, and support for mixed ssd/spinning disk deployments
- 1.2, released Jan 2 2013, added clustering across virtual nodes, inter-node communication, atomic batches, and request tracing
- 2.0, released Sep 4 2013, added lightweight transactions, triggers, improved compactions
- 2.1 released Sep 10 2014
- 2.2 released July 20, 2015
- 3.0 released November 11, 2015
- 3.1 through 3.10 releases were monthly releases using a tick-tock-like release model, with even-numbered releases providing both new features and bug fixes while odd-numbered releases will include bug fixes only.
- 3.11 released June 23, 2017 as a stable 3.11 release series and bug fix from the last tick-tock feature release.
Main features
; Supports replication and multi data center replication
; Scalability
; Fault-tolerant
; Tunable consistency
; MapReduce support
; Query language
; Eventual Consistency
Cassandra Query Language
Cassandra introduced the Cassandra Query Language. CQL is a simple interface for accessing Cassandra, as an alternative to the traditional Structured Query Language. CQL adds an abstraction layer that hides implementation details of this structure and provides native syntaxes for collections and other common encodings. Language drivers are available for Java, Python, Node.JS, Go and C++.Below an example of keyspace creation, including a column family in CQL 3.0:
CREATE KEYSPACE MyKeySpace
WITH REPLICATION = ;
USE MyKeySpace;
CREATE COLUMNFAMILY MyColumns ;
INSERT INTO MyColumns VALUES ;
SELECT * FROM MyColumns;
Which gives:
id | Last | First
----+------+------
1 | Doe | John
Known issues
Up to Cassandra 1.0, Cassandra was not row level consistent, meaning that inserts and updates into the table that affect the same row that are processed at approximately the same time may affect the non-key columns in inconsistent ways. One update may affect one column while another affects the other, resulting in sets of values within the row that were never specified or intended. Cassandra 1.1 solved this issue by introducing row-level isolation.Tombstones
Deletion markers called "Tombstones" are known to cause severe performance degradation.Data model
Cassandra is wide column store, and, as such, essentially a hybrid between a key-value and a tabular database management system. Its data model is a partitioned row store with tunable consistency. Rows are organized into tables; the first component of a table's primary key is the partition key; within a partition, rows are clustered by the remaining columns of the key. Other columns may be indexed separately from the primary key.Tables may be created, dropped, and altered at run-time without blocking updates and queries.
Cassandra cannot do joins or subqueries. Rather, Cassandra emphasizes denormalization through features like collections.
A column family resembles a table in an RDBMS. Column families contain rows and columns. Each row is uniquely identified by a row key. Each row has multiple columns, each of which has a name, value, and a timestamp. Unlike a table in an RDBMS, different rows in the same column family do not have to share the same set of columns, and a column may be added to one or multiple rows at any time.
Each key in Cassandra corresponds to a value which is an object. Each key has values as columns, and columns are grouped together into sets called column families. Thus, each key identifies a row of a variable number of elements. These column families could be considered then as tables. A table in Cassandra is a distributed multi dimensional map indexed by a key. Furthermore, applications can specify the sort order of columns within a Super Column or Simple Column family.
Management and monitoring
Cassandra is a Java-based system that can be managed and monitored via Java Management Extensions. The JMX-compliant nodetool utility, for instance, can be used to manage a Cassandra cluster. Nodetool also offers a number of commands to return Cassandra metrics pertaining to disk usage, latency, compaction, garbage collection, and more.Since Cassandra 2.0.2 in 2013, measures of several metrics are produced via the Dropwizard metrics framework, and may be queried via JMX using tools such as JConsole or passed to external monitoring systems via Dropwizard-compatible reporter plugins.
Notable applications
According to DB-Engines ranking, Cassandra is the most popular wide column store, and in September 2014 became the 9th most popular database.- Apple uses 100,000 Cassandra nodes, as revealed at Cassandra Summit San Francisco 2015, although it has not elaborated for which products, services or features.
- AppScale uses Cassandra as a back-end for Google App Engine applications
- BlackRock uses Cassandra in their Aladdin investment management platform
- CERN used Cassandra-based prototype for its ATLAS experiment to archive the online DAQ system's monitoring information
- Cisco's WebEx uses Cassandra to store user feed and activity in near real time.
- Constant Contact uses Cassandra in their email and social media marketing applications. Over 200 nodes are deployed.
- Digg, a social news website, announced on Sep 9th, 2009 that it is rolling out its use of Cassandra and confirmed this on March 8, 2010. TechCrunch has since linked Cassandra to Digg v4 reliability criticisms and recent company struggles. Lead engineers at Digg later rebuked these criticisms as red herring and blamed a lack of load testing.
- Discord switched to Cassandra to store billions of messages from MongoDB in November, 2015
- Formspring uses Cassandra to count responses, as well as store social graph data for 26 Million accounts with 10 million responses a day
- Globo.com uses Cassandra as a back-end database for their streaming services
- Grubhub uses Cassandra as their primary persistent data store for their backend services.
- Mahalo.com used Cassandra to record user activity logs and topics for their Q&A website
- Netflix uses Cassandra as their back-end database for their streaming services
- Nutanix appliances use Cassandra to store metadata and stats.
- Ooyala built a real-time analytics engine using Cassandra
- Openwave uses Cassandra as a distributed database and as a distributed storage mechanism for their messaging platform
- OpenX is running over 130 nodes on Cassandra for their OpenX Enterprise product to store and replicate advertisements and targeting data for ad delivery
- Rackspace uses Cassandra internally.
- Reddit switched to Cassandra from memcacheDB on March 12, 2010 and experienced some problems in May of that year due to insufficient nodes in their cluster.
- RockYou uses Cassandra to record every single click for 50 million Monthly Active Users in real-time for their online games
- SoundCloud uses Cassandra to store the dashboard of their users
- Uber uses Cassandra to store around 10,000 features in their daily updated company-wide Feature Store for low-latency access during live model predictions
- Urban Airship uses Cassandra with the mobile service hosting for over 160 million application installs across 80 million unique devices