Skip to content Skip to sidebar Skip to footer
Showing posts with the label Luigi

Luigi Pipeline Beginning In S3

My initial files are in AWS S3. Could someone point me how I need to setup this in a Luigi Task? I … Read more Luigi Pipeline Beginning In S3

Running Hadoop Jar Using Luigi Python

I need to run a Hadoop jar job using Luigi from python. I searched and found examples of writing ma… Read more Running Hadoop Jar Using Luigi Python

Recurrent Machine Learning Etl Using Luigi

Today, running the machine learning job I've written is done by hand. I download the needed inp… Read more Recurrent Machine Learning Etl Using Luigi