1. 程式人生 > >How do I decide between Redshift, Postgres, and BigQuery? Documentation

How do I decide between Redshift, Postgres, and BigQuery? Documentation

Comparing Redshift and Postgres

In most cases, you will get a much better price-to-performance ratio with Redshift for typical analyses.

Redshift lacks some features, datatypes, and functions supported by Postgres and also implements some features differently. If you absolutely need any of the features or functions missing in Redshift and BigQuery, choose Postgres. If not (or you’re not sure), we recommend Redshift.

Comparing Redshift and BigQuery

Both Redshift and BigQuery are attractive cloud-hosted, relatively cheap, and performant analytical databases. The differences between the two are largely around their architecture and pricing.

Architecture

When you provision a Redshift cluster, you’re renting a server from Amazon Web Services. Your cluster is comprised of

nodes, each with dedicated memory, CPU, and disk storage. These nodes handle data storage, query execution, and - if your cluster contains multiple nodes - a leader node will handle coordination across the cluster.

Redshift performance and storage capacity is a function of cluster size and cluster type. As your storage or performance requirements change, you can scale up or down your cluster as needed.

With BigQuery, you’re not constrained by the storage capacity or compute resources of a given cluster. Instead, you can load large amounts of data into BigQuery without running out of memory, and execute complex queries without maxing out CPU.

This is possible because BigQuery takes advantage of distributed storage and networking to separate data storage from compute power. Data is distributed across many servers in the Google cloud using their Colossus distributed file system. When you execute a query, the Dremel query engine splits the query into smaller sub-tasks, distributes the sub-tasks to many computers across Google data centers, and then re-assembles them into your results.

Pricing

The difference in architecture translates into differences in pricing.

Redshift prices based on an hourly rate determined by the number and types of nodes in your cluster. They offer dense storage - optimized for storage - and dense compute nodes - optimized for query performance.

BigQuery has two pricing options: variable and fixed pricing. With the variable, pay-as-you-go plan, you pay for the data you load into BigQuery, and then pay only for the amount of data you query. BigQuery allows you to setup Cost Controls and Alerts to help control and monitor costs.

Fixed-price plans are geared toward high-volume customers and allow you to rent a fixed amount of compute power.

Resource Management

Redshift does require you to create a cluster, schedule vacuums, choose sort and distribution keys, and resize your cluster as storage and performance needs change over time.

BigQuery is “fully-managed”, which means that you’ll never have to resize, vacuum, or adjust distribution or sort keys. All of that is handled by BigQuery.

If you have any questions, or see anywhere we can improve our documentation, please let us know!

相關推薦

How do I decide between Redshift, Postgres, and BigQuery? Documentation

Comparing Redshift and PostgresIn most cases, you will get a much better price-to-performance ratio with Redshift for typical analyses.Redshift lacks some

How do I delete my HN account and history?

Not that I particularly wish to at all...but, given recent issues across social networks...I would like to know what steps it would take to remove my ident

How do I resize an image using PIL and maintain its aspect ratio?

我有一個資料夾,裡的圖檔是 96×96, 我希望在這一個資料夾下的檔案被異動時,會自動產生縮圖(64×64)到其他的資料夾下。 PIL 是 Python 下最有名的影像處理套件。 這個套件,似乎在升級改版本,把一些比較少人用的屬性或方法在新版本裡拿掉,新版本也加入了更多新的功能。一般人應該都只會使用基本

Ask HN: How do I relocate to USA and get company to sponsor working visa

Hi HN,I'm a European Citizen with 5 years of professional development experience.Within Europe, it's quite easy to open up your profile on LinkedIn by the

Ask HN: How do i prevent Facebook and Instagram from tracking me across devices?

Phone #1: Installed Facebook app on iOS, added PhoneNumberX to 2FA.Phone #2: PhoneNumberX was never used on this phone apart from WhatsApp that had PhoneNu

iPhone開發:如何阻止檔案被iTunes和iCloud同步 How do I prevent files from being backed up to iCloud and iTunes?

先閱讀官方說明: 使用方法: #import “sys/xattr.h” - (BOOL)addSkipBackupAttributeToItemAtURL:(NSURL *)URL { const char* filePath = [[URL path] fi

How do I find what queries were executing in a SQL memory dump?-----stack

been sea under lba bject ecif tool data- mil https://blogs.msdn.microsoft.com/askjay/2010/10/03/how-do-i-find-what-queries-were-execu

ubuntu How do I configure proxies without GUI?

cli pri art lar open config user settings 修改 想法: 我的想法是想是一臺國內的 ubuntu 雲主機可以通過另外一臺在國外(新加坡)的服務器 ,來實現可以訪問 google ,哈哈,比較好查資料:) 下面的做法 去修改 /et

How do I clone a generic list in C#?

code sele listt list ati class ocl list() () static class Extensions { public static IList<T> Clone<T>(this IList<T>

how do I access the EC Embedded Controller firmware level with wmi win32?

Imports System Imports System.Management Imports System.Windows.Forms Namespace WMISample Public Class MyWMIQuery Public Overloads Shar

How do I add a Foreign Key Field to a ModelForm in Django?

What I would like to do is to display a single form that lets the user: Enter a document title (from Document model

Dlib how do I save image

解決c++ - In Dlib how do I save image with overlay?   推薦:how to save a c++ object in java object and use it http://blog.csdn.net/luoshen

How do I interpret scsi status messages in RHEL like "sd 2:0:0:243: SCSI error: return code = 0x0800

Issue What does "return code = 0xNNNNNNNN" mean, for example 0x08000002 within the following: Raw Oct 23 14:56:25 uname kernel: sdas: C

【轉】How do I set the real time scheduling priority of a process?

In the event that a process is not achieving the desired performance performance benchmarks, it can be helpful to set CPU affinity, real

Dissecting the Disruptor: How do I read from the ring buffer?

作者:Trisha The next in the series of understanding the Disruptor pattern developed at LMAX. After the last post we all understand ring buffers and

[Android] How do I make a splash screen?

This answers shows you how to display a splash screen for a fixed amount of time when your app starts for e.g. branding reasons. E.g. you might choose to

How do I create browsable intent

接著上一篇 Android Intents with Chrome,我要寫一個功能,讓其他的程式或從 webview 開啟我的程式。這篇文章的重要在建立一個 browsable 的 activity。 相關文章: 在 AndroidManifest.xm 加入 activity 和 filter <

怎樣通過程式碼開啟或者關閉瀏覽器控制檯?-How do I close the browser console with code in the console

see:https://stackoverflow.com/questions/25515697/how-do-i-close-the-browser-console-with-code-in-the-console?r=SearchResults 據我所知,沒有一個瀏覽器允許通過程式碼

How do I enable IP-forwarding in MacOS X?

解法是: You’re doing two things there. Enabling IP forwarding. The OS X equivalent might be: sysctl -w net.inet.ip.forwarding=1 …but since I don’t know ex

[java] How do I send an HTML email?

As per the Javadoc, the MimeMessage#setText() sets a default mime type of text/plain, while you need text/html. Rather use MimeMessage#setContent() instea