2018/January

Task list for January:

notes

• Shore up notes:
  • Experiment design: https://charlesreid1.com:3000/notes/experiment-design
  • Linear models: https://charlesreid1.com:3000/notes/linear-models
  • Rubiks cube: https://charlesreid1.com:3000/notes/rubiks-notes

2018/January/Notes Repositories

data engineering

Data engineering scenarios

• Basic workflow, dealing with large amounts of data and doing machine learning on it
• See also: Google Cloud/Review

Network data

• Overarching goal
• Gather data
• Analyze trends
• Create data sets
• Data engineering: gathering data process, analysis process, modeling process

2018/January/Data Engineering

kali

Network testbed:

• Analyzing network traffic
• Creating data capture workflow
• MITM
• Windows exploits

Git repos:

• Setting up network testbed and instrumentation (W?)
• Dropbear scripts - new org? kali?

raspberry pi

FlightAware

master git repos

Create master repo for each organization - each repo in org as a submodule

rubiks cube

• Rubiks Cube:
  • Calculating the order of a permutation (see https://math.stackexchange.com/questions/332146/efficient-method-to-determine-the-order-of-a-permutation-in-s-n)

2018/January/Rubiks Cube

• Rubiks Cube/Numbers
• Rubiks Cube/Tuple
• Rubiks Cube/Permutations

project euler

• Project Euler:
  • Project Euler: Problem 172
  • Clean up problems 52-67

Project Euler/172

desk reorg

Reorganize and rearrange desk

• Move book boxes to room, move table from room to main area
• Consolidate plastic tubs
• Computer lab - 2 laptops + desktop
• Switch to dropbear as the main router

blog posts

• Blog posts:
  • Knuth permutation generation
  • 4x4 Rubik's Cube: Part 1: Representations
  • 4x4 Rubik's Cube: Part 2: Permutations
  • 4x4 Rubik's Cube: Part 3: Cycles
  • Google Data Engineering Certification blog post and notes highlights
  • Concepts: data engineering vs. data science
  • Elevator pitch: what is data engineering
  • Data engineering scenario rollouts

genealogy

• Genealogy
  • Photos cropped and organized by family
  • Pauline and Bruce chapters
  • Historical research planning

bots

• Tripos Bot
  • Work out small page latex
  • Get questions into latex format
  • Script to compile latex to pdf, Imagemagick latex to jpg
  • Create Rainbow Mind Machine bot
  • Create Twitter account
  • Authenticate
  • Set up and run on Rojo
  • Debug - it's just not tweeting.

• Apollo Bot
  • Fix lengths of dialogue per speaker
  • Make lengths of dialogue per speaker a parameter/variable for function/library in rainbow mind machine

• Milton Bot
  • Seems okay... but still having some permission problem

• Ginsberg Bot
  • Seems okay, but permission problem

• Debugging:
  • Having trouble with the permissions
  • Don't know what a 403 permissions problem is caused by
  • Test suite 1 - not tweeting (offline tweet generation)
  • Test suite 2 - tweeting tests (test hello world for Milton and Ginsberg)
  • Test suite 3 - tweeting real McCoy

Tripos Bot