Infrastructure tutorials

Production-grade guides for Linux, servers, security and performance. Copy-paste commands, multi-distro support, written by engineers who run this in production.

devops Intermediate

Setup advanced Airflow alerting with Slack integration and custom notification rules

Configure Apache Airflow to send intelligent alerts to Slack channels when DAGs fail, with custom notification rules based on task importance and execution context. Includes automated retry logic and escalation workflows.

45 min 4 distros 35 views
devops Advanced

Implement Airflow load balancing with Celery executor for high availability workflows

Set up Apache Airflow with Celery executor, Redis cluster backend, HAProxy load balancing, and auto-scaling workers for production-grade workflow orchestration with high availability.

45 min 4 distros 171 views
security Intermediate

Implement Airflow DAG security scanning with Bandit and safety checks

Set up automated security scanning for Apache Airflow DAGs using Bandit for Python code analysis and Safety for vulnerability detection. Configure pre-commit hooks and CI/CD integration for continuous security monitoring.

45 min 4 distros 107 views
devops Advanced

Configure Apache Airflow data lineage tracking with OpenLineage for comprehensive workflow observability

Set up OpenLineage with Apache Airflow to track data lineage across workflows, providing comprehensive observability into data transformations, dependencies, and quality issues in production environments.

45 min 4 distros 105 views
security Advanced

Set up Apache Airflow DAG security policies and data governance with RBAC and audit logging

Configure comprehensive security for Apache Airflow with role-based access control, DAG-level permissions, data lineage tracking, and audit logging for compliance monitoring in production environments.

45 min 4 distros 181 views
devops Intermediate

Configure Apache Airflow DAG version control with Git and CI/CD pipelines

Set up Git-based version control for Apache Airflow DAGs with automated CI/CD pipelines for testing and deployment. Implement DAG synchronization, validation workflows, and production-ready deployment strategies.

45 min 4 distros 173 views
monitoring Intermediate

Implement Airflow DAG monitoring with DataDog integration for production workflows

Set up comprehensive monitoring for Apache Airflow DAGs using DataDog integration. This tutorial covers DataDog agent installation, metrics collection configuration, custom dashboard creation, and alerting rules for production workflow observability.

45 min 4 distros 440 views
performance Advanced

Set up Apache Airflow DAG performance testing with Locust load testing framework

Learn to configure Locust for comprehensive Apache Airflow DAG performance testing, including automated load testing scenarios, metrics collection, and CI/CD integration for production-grade workflow optimization.

45 min 4 distros 475 views
devops Intermediate

Setup SonarQube scanner for multiple programming languages with automated code quality analysis

Configure SonarQube Scanner CLI to analyze Java, Python, JavaScript, and C# projects with automated quality gates and CI/CD integration. Streamline code quality analysis across your entire development pipeline with Docker and Jenkins automation.

45 min 4 distros 596 views
monitoring Intermediate

Configure Apache Airflow monitoring with Prometheus alerts and Grafana dashboards

Set up comprehensive monitoring for Apache Airflow with Prometheus metrics collection, StatsD integration, and custom Grafana dashboards. Configure automated alerting for DAG failures, task timeouts, and system health issues.

45 min 4 distros 924 views

Need help?

Don't want to manage this yourself?

We handle infrastructure for businesses that depend on uptime. From initial setup to ongoing operations.

Talk to an engineer