From charlesreid1

Line 25: Line 25:
* build and design a monitoring system for a complex, live, evolving system
* build and design a monitoring system for a complex, live, evolving system
* minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE
* minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE
data engineering:
* continuing with data logging and creating data sets
* [[Google Cloud/Review]]
* master plan with elasticserch, logrotate, etc.


==rollover==
==rollover==

Revision as of 03:28, 3 February 2018

overarching goal

data store (db)

the database is the central thread for everything.

get a database solution up and running over the management lan.

minimize friction and time to bring up/explore/check new collection.

data streams

diversity of data sources:

  • Sensor data from physical sensor
  • Website status and historical evolution data from wiki
  • Log data from server
  • Network log info from bro
  • Netdata and collectd hardware info

monitoring

dashboards:

  • building visualizations and graph dashboards with Grafana
  • dashboards for arbitrary streams
  • build and design a monitoring system for a complex, live, evolving system
  • minimize the time to set everything up, add metrics, gain insight, visualize, repeat, BRING IT TO LIFE

data engineering:

  • continuing with data logging and creating data sets
  • Google Cloud/Review
  • master plan with elasticserch, logrotate, etc.

rollover

blog posts

  • Project Euler 172
  • Bots
  • bootstrap table presenting results of Rubik's Cube investigation - Rubiks Cube/Bootstrap

bots

charlesreid1 bot:

  • build spreadsheet, parse to build awesome list and bot

Bots/Charlesreid1

bot instrumentation:

  • dashboard, monitoring, statistics, status
  • bot dashboard with grafana

apollo bots:

genealogy

Genealogy photos:

  • Photos cropped/organized by family
    • 2011
    • 2017
    • Rename scheme
    • Notes - A2k11
    • Notes - R2k11
    • Notes - A2k17
    • Notes - K2k17
    • Notes - R2k17
  • Send email to fam with link on Dropbox

Writing:

  • Pauline and Bruce chapters
  • Historical research planning


flags