What is Apache Airflow stack
Is a web stack of applications built with Docker Compose containing preconfigured Apache Airflow, RabbitMQ, Redis, and SMTP server. Apache Airflow is difficult to set up manually, so the main goal of TryDirect here is to streamline the deployment process to the most famous clouds.
What does Apache Airflow stack include
- Airflow docker container
- Nginx docker container
- PostgreSQL docker container
- Redis docker container
- RabbitMQ docker container
Currently, following versions are supported:
Who is using Apache Airflow
- Data Engineers
- Data Scientists
- Software developers
- DevOps Engineers
What is Apache Airflow
Apache Airflow is an open-source platform for creating Python workflows, scheduling and monitoring them. The platform supports REST API, WebHDFS, allows progress monitoring, release management, and production optimization. Apache Airflow supports Jinja templating engine and Apache Pig integration. It was built by an Airbnb developer and has grown from an internal product to a widely-spread workflow management solution.
What are the benefits of using Apache Airflow stack
- Automatic deployment of the Airflow suite to the prefered cloud
- Straightforward upgrade to a new business apps suite version
- The accurate stack configuration
- Smooth app migration to another cloud provider
- Fast startup and better performance of the app
- Lower system overhead
