feat: airflow pipelines integration
Showing
- .gitignore 1 addition, 1 deletion.gitignore
- Dockerfile 4 additions, 1 deletionDockerfile
- dags/__pycache__/spark_dag.cpython-311.pyc 0 additions, 0 deletionsdags/__pycache__/spark_dag.cpython-311.pyc
- dags/drift_retrain_dag.py 46 additions, 14 deletionsdags/drift_retrain_dag.py
- dags/initialize_dag.py 62 additions, 0 deletionsdags/initialize_dag.py
- dags/maintenance_dag.py 60 additions, 0 deletionsdags/maintenance_dag.py
- dags/model_dag.py 10 additions, 2 deletionsdags/model_dag.py
- dags/spark_dag.py 14 additions, 11 deletionsdags/spark_dag.py
- data/drifted_churn.csv 7044 additions, 0 deletionsdata/drifted_churn.csv
- docker-compose.yml 13 additions, 3 deletionsdocker-compose.yml
- jobs/data/data.csv 0 additions, 11 deletionsjobs/data/data.csv
- jobs/data_processor.py 31 additions, 8 deletionsjobs/data_processor.py
- model/train_model.py 16 additions, 10 deletionsmodel/train_model.py
- spark/analyser/Dockerfile 0 additions, 15 deletionsspark/analyser/Dockerfile
- spark/analyser/data/churn.csv 0 additions, 7044 deletionsspark/analyser/data/churn.csv
- spark/analyser/data_analyser.py 0 additions, 57 deletionsspark/analyser/data_analyser.py
- spark/analyser/docker-compose.yaml 0 additions, 12 deletionsspark/analyser/docker-compose.yaml
- spark/processor/Dockerfile 0 additions, 15 deletionsspark/processor/Dockerfile
- spark/processor/data/churn.csv 0 additions, 7044 deletionsspark/processor/data/churn.csv
- spark/processor/data_processor.py 0 additions, 52 deletionsspark/processor/data_processor.py
Please register or sign in to comment