2018/February: Difference between revisions
From charlesreid1
| Line 25: | Line 25: | ||
* build and design a monitoring system for a complex, live, evolving system | * build and design a monitoring system for a complex, live, evolving system | ||
* minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE | * minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE | ||
data engineering: | |||
* continuing with data logging and creating data sets | |||
* [[Google Cloud/Review]] | |||
* master plan with elasticserch, logrotate, etc. | |||
==rollover== | ==rollover== | ||
Revision as of 03:28, 3 February 2018
overarching goal
data store (db)
the database is the central thread for everything.
get a database solution up and running over the management lan.
minimize friction and time to bring up/explore/check new collection.
data streams
diversity of data sources:
- Sensor data from physical sensor
- Website status and historical evolution data from wiki
- Log data from server
- Network log info from bro
- Netdata and collectd hardware info
monitoring
dashboards:
- building visualizations and graph dashboards with Grafana
- dashboards for arbitrary streams
- build and design a monitoring system for a complex, live, evolving system
- minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE
data engineering:
- continuing with data logging and creating data sets
- Google Cloud/Review
- master plan with elasticserch, logrotate, etc.
rollover
blog posts
- Project Euler 172
- Bots
- bootstrap table presenting results of Rubik's Cube investigation - Rubiks Cube/Bootstrap
bots
charlesreid1 bot:
- build spreadsheet, parse to build awesome list and bot
bot instrumentation:
- dashboard, monitoring, statistics, status
- bot dashboard with grafana
apollo bots:
- 14/15/16/17
- incorporate lunar surface dialogue
- link to apollo 11 audio: https://www.nasa.gov/mission_pages/apollo/40th/a11_audio_db.html
- Spacelog (mercury, gemini, pre-11 apollo missions): http://spacelog.org/
genealogy
Genealogy photos:
- Photos cropped/organized by family
20112017Rename schemeNotes - A2k11- Notes - R2k11
- Notes - A2k17
- Notes - K2k17
- Notes - R2k17
- Send email to fam with link on Dropbox
Writing:
- Pauline and Bruce chapters
- Historical research planning