Welcome to my field notes!
Field notes are notes I leave myself as I go through my day to day work. The hope is that other people will also find these notes useful. Note that these notes are unfiltered and unverified.
Data Infrastructure Curation
Motivation
As more and more companies try to leverage data to improve business outcomes, there will be more and more data teams created in industry. While one aspect is hiring the right people, there is also the infrastructure that you set up in order to support your team.
This evolving field note is designed to contain the tools that I have battle tested in real business use cases and my thoughts on them. The hope is that I can help someone who is also in a similar situation.
- Cloud66 Maestro
- Cloudflare DNS
- Airflow
- PostgreSQL
- Metabase
- Superset
- JupyterHub
- JupyterLab
- RStudio Server
- ShinyProxy
- Keycloak
- PGAdmin
- Distill Web Framework and R Package
- NGINX
- OAuth2 Proxy
- Kubernetes
- Docker