From charlesreid1

No edit summary
Line 20: Line 20:
Notes review: GCDEC
Notes review: GCDEC
* Case study - [[Google Cloud/Case Study]]
* Case study - [[Google Cloud/Case Study]]
* 1 - https://charlesreid1.com/wiki/GCDEC/Fundamentals/Notes
* 1 - [[GCDEC/Fundamentals/Notes]]
* 2 - https://charlesreid1.com/wiki/GCDEC/Unstructured_Data/Notes
* 2 - [[GCDEC/Unstructured_Data/Notes]]
* 3a - https://charlesreid1.com/wiki/GCDEC/BigQuery/Notes
* 3a - [[GCDEC/BigQuery/Notes]]
* 3b - https://charlesreid1.com/wiki/GCDEC/Dataflow/Notes
* 3b - [[GCDEC/Dataflow/Notes]]
* 4a - https://charlesreid1.com/wiki/GCDEC/Building_Tensorflow/Notes
* 4a - [[GCDEC/Building_Tensorflow/Notes]]
* 4b - https://charlesreid1.com/wiki/GCDEC/Deploying_Tensorflow/Notes
* 4b - [[GCDEC/Deploying_Tensorflow/Notes]]
* 4c - https://charlesreid1.com/wiki/GCDEC/Engineering_Tensorflow/Notes
* 4c - [[GCDEC/Engineering_Tensorflow/Notes]]
* 5 - https://charlesreid1.com/w/index.php?title=GCDEC/Streaming/Notes&action=edit&redlink=1
* 5 - [[GCDEC/Streaming/Notes]]


Google Codelabs:
Google Codelabs:
* https://codelabs.developers.google.com/
* Main link - https://codelabs.developers.google.com/
* Kubernetes and Container Engine - https://codelabs.developers.google.com/codelabs/cloud-compute-kubernetes/index.html?index=..%2F..%2Findex#0
* Kubernetes and Container Engine - https://codelabs.developers.google.com/codelabs/cloud-compute-kubernetes/index.html?index=..%2F..%2Findex#0
* Process Astronomy Data to Generate Images - https://codelabs.developers.google.com/codelabs/cloud-compute-the-cosmos/index.html?index=..%2F..%2Findex#0
* Process Astronomy Data to Generate Images - https://codelabs.developers.google.com/codelabs/cloud-compute-the-cosmos/index.html?index=..%2F..%2Findex#0
Line 42: Line 42:
* Translate Text - https://codelabs.developers.google.com/codelabs/cloud-translation-intro/index.html?index=..%2F..%2Findex#0
* Translate Text - https://codelabs.developers.google.com/codelabs/cloud-translation-intro/index.html?index=..%2F..%2Findex#0


Google Quiklabs:
Google Qwiklabs:
* Google Cloud Platform essentials - https://google.qwiklabs.com/quests/23?locale=en
* Google Cloud Platform essentials - https://google.qwiklabs.com/quests/23?locale=en
* Scientific data processing - https://google.qwiklabs.com/quests/28?locale=en
* Scientific data processing - https://google.qwiklabs.com/quests/28?locale=en
* Data engineering - https://google.qwiklabs.com/quests/25?locale=en
* Data engineering - https://google.qwiklabs.com/quests/25?locale=en
==Review Notes Pages==
[[Google Cloud/Scientific Data Processing]] - doing the scientific data processing qwiklab




[[Category:Google Cloud]]
[[Category:Google Cloud]]
[[Category:Data Engineering]]
[[Category:Data Engineering]]

Revision as of 22:09, 8 January 2018

Review of Google Cloud and Data Engineering

Review in preparation for interview:

  • Components of workflow in cloud, analogies
  • Open source tools used at each "step"
  • Highlighting different workflows using repositories
  • Quick/easy example: why so many database solutions? How to do basics?
  • Specific challenges, software, workflow for genomics research

Procedure

Software tools list, (abstract) example for each: Google Cloud

  • Storage/database/computation/GPUs vs CPUs/containerization

Software quality assurance:

  • Github page - 10 things
  • Apply style of later points to earlier points
  • Clear out lorem ipsum (7-10)

Notes review: GCDEC

Google Codelabs:

Google Qwiklabs:

Review Notes Pages

Google Cloud/Scientific Data Processing - doing the scientific data processing qwiklab