How to Cut Your AWS ECS Costs with Fargate Spot and Prefect
Nov. 1, 2021

Creating serverless data engineering pipelines using Python.

Anna Geller
Anna GellerLead Community Engineer

Prefect is a flexible tool to orchestrate the modern data stack. In contrast to many other solutions on the market, it doesn't tie you to any specific execution framework or cloud provider — whether you want to use Kubernetes on GCP, AWS ECS, a bare-metal server, or an on-demand distributed Dask cluster such as Coiled, Prefect got you covered. As with any flexible platform, there are some things you need to configure to let Prefect know where your data workflows should run. In this article, we'll look at how to leverage spot instances on AWS ECS Fargate as your cost-effective execution layer.

Posted on Nov 1, 2021
Community Post
DevOps & CI/CD

Love your workflows again

Orchestrate your stack to gain confidence in your data