The rise in data collection over the past decade—through legacy systems, apps, analytics tools, CRMs and more—has created the need for a rise in people who can manage all that data. After all, it needs to be connected, routed and usually cleaned, enriched or otherwise organized before it can be analyzed. These capabilities all fall into the category of data engineering which has led to the creation of a new role: the data engineer.
Astronomer is built by data engineers, for data engineers. CEO Ry Walker explains why in this video: