Google Cloud/Review: Difference between revisions
From charlesreid1
No edit summary |
|||
| Line 20: | Line 20: | ||
Notes review: GCDEC | Notes review: GCDEC | ||
* Case study - [[Google Cloud/Case Study]] | * Case study - [[Google Cloud/Case Study]] | ||
* 1 - | * 1 - [[GCDEC/Fundamentals/Notes]] | ||
* 2 - | * 2 - [[GCDEC/Unstructured_Data/Notes]] | ||
* 3a - | * 3a - [[GCDEC/BigQuery/Notes]] | ||
* 3b - | * 3b - [[GCDEC/Dataflow/Notes]] | ||
* 4a - | * 4a - [[GCDEC/Building_Tensorflow/Notes]] | ||
* 4b - | * 4b - [[GCDEC/Deploying_Tensorflow/Notes]] | ||
* 4c - | * 4c - [[GCDEC/Engineering_Tensorflow/Notes]] | ||
* 5 - | * 5 - [[GCDEC/Streaming/Notes]] | ||
Google Codelabs: | Google Codelabs: | ||
* https://codelabs.developers.google.com/ | * Main link - https://codelabs.developers.google.com/ | ||
* Kubernetes and Container Engine - https://codelabs.developers.google.com/codelabs/cloud-compute-kubernetes/index.html?index=..%2F..%2Findex#0 | * Kubernetes and Container Engine - https://codelabs.developers.google.com/codelabs/cloud-compute-kubernetes/index.html?index=..%2F..%2Findex#0 | ||
* Process Astronomy Data to Generate Images - https://codelabs.developers.google.com/codelabs/cloud-compute-the-cosmos/index.html?index=..%2F..%2Findex#0 | * Process Astronomy Data to Generate Images - https://codelabs.developers.google.com/codelabs/cloud-compute-the-cosmos/index.html?index=..%2F..%2Findex#0 | ||
| Line 42: | Line 42: | ||
* Translate Text - https://codelabs.developers.google.com/codelabs/cloud-translation-intro/index.html?index=..%2F..%2Findex#0 | * Translate Text - https://codelabs.developers.google.com/codelabs/cloud-translation-intro/index.html?index=..%2F..%2Findex#0 | ||
Google | Google Qwiklabs: | ||
* Google Cloud Platform essentials - https://google.qwiklabs.com/quests/23?locale=en | * Google Cloud Platform essentials - https://google.qwiklabs.com/quests/23?locale=en | ||
* Scientific data processing - https://google.qwiklabs.com/quests/28?locale=en | * Scientific data processing - https://google.qwiklabs.com/quests/28?locale=en | ||
* Data engineering - https://google.qwiklabs.com/quests/25?locale=en | * Data engineering - https://google.qwiklabs.com/quests/25?locale=en | ||
==Review Notes Pages== | |||
[[Google Cloud/Scientific Data Processing]] - doing the scientific data processing qwiklab | |||
[[Category:Google Cloud]] | [[Category:Google Cloud]] | ||
[[Category:Data Engineering]] | [[Category:Data Engineering]] | ||
Revision as of 22:09, 8 January 2018
Review of Google Cloud and Data Engineering
Review in preparation for interview:
- Components of workflow in cloud, analogies
- Open source tools used at each "step"
- Highlighting different workflows using repositories
- Quick/easy example: why so many database solutions? How to do basics?
- Specific challenges, software, workflow for genomics research
Procedure
Software tools list, (abstract) example for each: Google Cloud
- Storage/database/computation/GPUs vs CPUs/containerization
Software quality assurance:
- Github page - 10 things
- Apply style of later points to earlier points
- Clear out lorem ipsum (7-10)
Notes review: GCDEC
- Case study - Google Cloud/Case Study
- 1 - GCDEC/Fundamentals/Notes
- 2 - GCDEC/Unstructured_Data/Notes
- 3a - GCDEC/BigQuery/Notes
- 3b - GCDEC/Dataflow/Notes
- 4a - GCDEC/Building_Tensorflow/Notes
- 4b - GCDEC/Deploying_Tensorflow/Notes
- 4c - GCDEC/Engineering_Tensorflow/Notes
- 5 - GCDEC/Streaming/Notes
Google Codelabs:
- Main link - https://codelabs.developers.google.com/
- Kubernetes and Container Engine - https://codelabs.developers.google.com/codelabs/cloud-compute-kubernetes/index.html?index=..%2F..%2Findex#0
- Process Astronomy Data to Generate Images - https://codelabs.developers.google.com/codelabs/cloud-compute-the-cosmos/index.html?index=..%2F..%2Findex#0
- Kubernetes for Java apps - https://codelabs.developers.google.com/codelabs/cloud-springboot-kubernetes/index.html?index=..%2F..%2Findex#0
- Google Cloud Storage - https://codelabs.developers.google.com/codelabs/es003l-storage/index.html?index=..%2F..%2Findex
- Campaign finance with bigquery - https://codelabs.developers.google.com/codelabs/cloud-bq-campaign-finance/index.html?index=..%2F..%2Findex#0
- Text processing with big data - https://codelabs.developers.google.com/codelabs/cloud-dataflow-starter/index.html?index=..%2F..%2Findex#0
- Recommendations ML - https://codelabs.developers.google.com/codelabs/cloud-accelerate-dataproc/index.html?index=..%2F..%2Findex#0
- Spark + OpenCV - https://codelabs.developers.google.com/codelabs/cloud-dataproc-opencv/index.html?index=..%2F..%2Findex
- Speech to Text - https://codelabs.developers.google.com/codelabs/cloud-speech-intro/index.html?index=..%2F..%2Findex#0
- Translate Text - https://codelabs.developers.google.com/codelabs/cloud-translation-intro/index.html?index=..%2F..%2Findex#0
Google Qwiklabs:
- Google Cloud Platform essentials - https://google.qwiklabs.com/quests/23?locale=en
- Scientific data processing - https://google.qwiklabs.com/quests/28?locale=en
- Data engineering - https://google.qwiklabs.com/quests/25?locale=en
Review Notes Pages
Google Cloud/Scientific Data Processing - doing the scientific data processing qwiklab