Infrastructure tutorials

Production-grade guides for Linux, servers, security and performance. Copy-paste commands, multi-distro support, written by engineers who run this in production.

devops Advanced

Set up Apache Airflow high availability with CeleryExecutor and Redis clustering

Deploy Apache Airflow in high availability mode using CeleryExecutor with Redis clustering for task distribution, PostgreSQL connection pooling, and load-balanced webservers for production-grade workflow orchestration.

45 min 4 distros 33 views
devops Advanced

Setup Apache Airflow cluster with Kubernetes Executor for auto-scaling workflows

Deploy production-grade Apache Airflow with Kubernetes Executor for dynamic workflow scaling. Configure PostgreSQL backend, RBAC authentication, and auto-scaling policies with Prometheus monitoring integration.

45 min 4 distros 76 views
monitoring Intermediate

Implement Airflow DAG monitoring with DataDog integration for production workflows

Set up comprehensive monitoring for Apache Airflow DAGs using DataDog integration. This tutorial covers DataDog agent installation, metrics collection configuration, custom dashboard creation, and alerting rules for production workflow observability.

45 min 4 distros 87 views
databases Beginner

Install and configure DuckDB for analytical workloads with Python integration

Set up DuckDB, the high-performance analytical database, with CLI tools and Python integration for fast OLAP queries and data analytics workloads.

25 min 6 distros 164 views
performance Advanced

Set up Apache Airflow DAG performance testing with Locust load testing framework

Learn to configure Locust for comprehensive Apache Airflow DAG performance testing, including automated load testing scenarios, metrics collection, and CI/CD integration for production-grade workflow optimization.

45 min 4 distros 97 views
security Intermediate

Configure GitLab LDAP authentication and user management with Active Directory integration

Set up GitLab LDAP authentication with Active Directory to centralize user management, enable automatic user provisioning, and implement group-based access control for your GitLab instance.

45 min 4 distros 100 views
monitoring Intermediate

Configure Grafana dashboards for InfluxDB collectd metrics with advanced visualization and alerting

Build comprehensive Grafana dashboards to visualize collectd system metrics stored in InfluxDB with custom panels, advanced queries, and automated alerting rules for production monitoring.

45 min 4 distros 132 views
devops Intermediate

Setup SonarQube scanner for multiple programming languages with automated code quality analysis

Configure SonarQube Scanner CLI to analyze Java, Python, JavaScript, and C# projects with automated quality gates and CI/CD integration. Streamline code quality analysis across your entire development pipeline with Docker and Jenkins automation.

45 min 4 distros 158 views
devops Advanced

Implement comprehensive Apache Airflow DAG testing and validation strategies with pytest and best practices

Learn to implement production-grade testing for Apache Airflow DAGs using pytest, including unit tests for DAG structure validation, integration testing with test databases, and automated validation pipelines with CI/CD integration.

45 min 4 distros 282 views
devops Intermediate

Configure MinIO with Apache Spark 3.5 for big data analytics and object storage integration

Set up Apache Spark 3.5 with MinIO S3-compatible object storage for scalable big data analytics. Configure distributed storage, implement data lake patterns, and run production analytics workflows on your cluster infrastructure.

45 min 4 distros 253 views
monitoring Intermediate

Configure Apache Airflow monitoring with Prometheus alerts and Grafana dashboards

Set up comprehensive monitoring for Apache Airflow with Prometheus metrics collection, StatsD integration, and custom Grafana dashboards. Configure automated alerting for DAG failures, task timeouts, and system health issues.

45 min 4 distros 301 views
devops Advanced

Integrate Apache Airflow with Kubernetes RBAC and service accounts for secure workflow orchestration

Configure Apache Airflow KubernetesExecutor with proper RBAC permissions, service accounts, and role bindings to securely orchestrate workflows in Kubernetes environments with least-privilege access controls.

45 min 4 distros 207 views

Need help?

Don't want to manage this yourself?

We handle infrastructure for businesses that depend on uptime. From initial setup to ongoing operations.

Talk to an engineer