> For the complete documentation index, see [llms.txt](https://fall2019.fullstackdeeplearning.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://fall2019.fullstackdeeplearning.com/course-content/data-management/processing.md).

# Processing

{% embed url="<https://www.youtube.com/watch?v=foD8r33JM_8>" %}
Processing - Data Management
{% endembed %}

## Summary

* The simplest thing we can do is a **Makefile** to specify what action(s) depend on.
* You will probably need a workflow management system. **Airflow** is the current winner of this space.
* Try to keep things simple and don't over-engineer your processing pipeline.