Google Cloud/Bigtable: Difference between revisions
From charlesreid1
| Line 10: | Line 10: | ||
* fully managed - design your schema and you're done | * fully managed - design your schema and you're done | ||
* example applications: marketing data, financial data, IoT data, time series data | * example applications: marketing data, financial data, IoT data, time series data | ||
* empty cells don't take up any space | |||
From the original white paper: "A Bigtable is a sparse, distributed, persistent multidimensional sorted map. The map is indexed by a row key, a column key, and a timestamp; each value in the map is an uninterrupted array of bytes." | From the original white paper: "A Bigtable is a sparse, distributed, persistent multidimensional sorted map. The map is indexed by a row key, a column key, and a timestamp; each value in the map is an uninterrupted array of bytes." | ||
Revision as of 19:14, 24 October 2017
Overview
Bigtable features:
- sparsely populated table
- billions of rows, thousands of columns
- ideal data source for MapReduce operations
- TB to PB of data
- large amounts of single-keyed data with low latency
- fast read write throughput, low latency
- fully managed - design your schema and you're done
- example applications: marketing data, financial data, IoT data, time series data
- empty cells don't take up any space
From the original white paper: "A Bigtable is a sparse, distributed, persistent multidimensional sorted map. The map is indexed by a row key, a column key, and a timestamp; each value in the map is an uninterrupted array of bytes."
From the documentation: "A Cloud Bigtable table is sharded into blocks of contiguous rows, called tablets, to help balance the workload of queries. (Tablets are similar to HBase regions.) Tablets are stored on Colossus, Google's file system, in SSTable format."
This means that Bigtable nodes don't store the data - it's all in cloud storage. So moving data is fast, because you just move pointers - no need to copy data around.
Resources
Bigtable paper (2006): http://static.googleusercontent.com/media/research.google.com/en/us/archive/bigtable-osdi06.pdf