Syneru -- Airflow (Wrap up / final) - michael.mill@syneru.com - 04/11/2021
// --------------------------------------------------------------------------------------------;

Following, is the compilation of scripts and configuration written at Syneru :

1. src-syneru
2. cfg-syneru

Syneru -- Airflow (Screen-shots) - michael.mill@syneru.com - 22/10/2021
// --------------------------------------------------------------------------------------------;

Following, are some Airflow screen shots using the latest Python scripts :

1. 1st.jpg
2. 2nd.jpg

Syneru -- Airflow (Some recent Python scripts) - michael.mill@syneru.com - 21/10/2021
// --------------------------------------------------------------------------------------------;

Following, are some Airflow Python scripts using the BashOperator operator.

These are all essentially DAG objects.

1. exec-0.py
2. exec-1.py
3. exec-2.py
4. command.sh (A basic shell script)

The next additional feature is to compile a shell script for the PHP execution phase.
I have tested these in a Linux environment.

Syneru -- Airflow (Some Airflow Python background) - michael.mill@syneru.com - 20/10/2021
// --------------------------------------------------------------------------------------------;

The goal here is to focus on the BASH and PostgreSQL functionality. Where this ties into the existing project is still vague.
A key aspect here is to integrate the existing PHP functionality with Airflow.

These are Airflow/DAG based scripts.

1. dag_bash_operator.py
2. dag_postgres_create_table.py
3. dag_postgres_operator.py
4. dag_postgres_file.py

Some external references :

BashOperator : https://airflow.apache.org/docs/apache-airflow/stable/howto/operator/bash.html
How-to Guide for PostgresOperator : https://airflow.apache.org/docs/apache-airflow-providers-postgres/stable/operators/postgres_operator_howto_guide.html
Running Airflow in Docker : https://airflow.apache.org/docs/apache-airflow/stable/start/docker.html
ETL principles : https://gtoonstra.github.io/etl-with-airflow/principles.html