<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=293842391037690&amp;ev=PageView&amp;noscript=1">

Astronomer Blog

Culture / Data Science / Dev / Growth

Why Every Data Scientist Needs A Data Engineer

*Image cred: Eunice Lituanas; estimated reading time: 3 minutes, 32 seconds

The data scientist was deemed the “sexiest job of the 21st century.” The Harvard Business Review reasons that this “hybrid of data hacker, analyst, communicator and trusted adviser” is a rare combination of skills, worth a high paycheck.

Too good to be true? Yes, according to Forbes. Turns out, data scientists spend most of their time (up to 79%!) on the part of their job they hate most.

Topics: big data data science data engineering

Why Are Data Scientists Frustrated?


In this video, Aaron Brongersma (data engineer) asks Viraj Parekh (data analyst/scientist) about the most frustrating part of his job and talks about a how the Astronomer platform has changed the game for one customer's data scientist.  

Topics: big data data science data engineering

Ask RBK: Tell me more about getting the right data pipelines.

Getting data from point A to point B requires data pipelines, whether that's putting Facebook ad data into Redshift or adding a third party data set to a data lake. Considering the fact that popular sources like Salesforce or GitHub house a LOT of data—not all of which is necessary to answer a company's business questions—moving all of it without intentionality can create a lot of "noise." Our answer to getting focused, valuable data is recommending reusable "recipes."

Topics: big data data engineering data pipelines

Data Engineers Talk Data Engineering: A Webinar

Topics: big data data science dev data engineering

Normalizing Data for Warehouse Centralization

*Image thanks to William Bout

*Estimated reading time: 8 minutes and 46 seconds

A very common initiative these days is data warehouse centralization across an organization. DWaaS (data warehouse as a service) has become commoditized to the point that organizations of every size can begin setting up a reporting infrastructure starting at only a couple hundred dollars a month. This is really exciting and, when copying data from other structured databases, a relatively simple process.

Topics: big data data science

Why In-Depth Analytics Are Easier Than You Think

Estimated reading time: 7 minutes and 9 seconds

From the aqueducts to supercomputers to SpaceX, innovation creates a wave of new technology, suddenly available to the masses and exposing them to a foundation upon which to further iterate. The aqueducts made it possible to carry clean water long distances, which instigated the creation of storm water gutters, irrigation systems and, ultimately, indo

Topics: big data analytics growth

Press Release: Astronomer Announces Seed Financing

Astronomer Closes $1.9M in Seed Financing

As enterprises become more data driven, Astronomer’s tools make capturing and managing data from multiple sources easy

CINCINNATI--Astronomer, a scalable platform for enterprise-scale big data integration, has closed $1.9M in seed stage financing. CincyTech led the round, with participation from west coast investors AngelPad, 500 Startups and First Ascent, and midwestern funds Connetic Ventures, Drummond Road Capital and CoreNetwork.

Topics: big data Angelpad growth startups culture

A Crisis of Confidence

For the last nine years, I’ve observed a serious challenge in the startup world. I’ve experienced it firsthand in my own ventures, discussed it at length with my entrepreneur friends and even co-launched a couple of organizations with the goal of addressing it head on. It’s a challenge faced more intensely in startups than almost anywhere else, one that far too often leads to serious depression, burnout and even suicide. It’s the challenge of confidence—a challenge so serious, we're calling it a crisis.

Topics: big data growth culture

Are You Ready for A Data Breach?

***Disclaimer: The content, data, and claims in this article are for informational purposes only and not for the purpose of providing legal advice. You should contact your attorney to obtain advice with respect to any particular issue or problem you may be facing.***

We at Astronomer have an optimistic—even idealistic—view about the future of data, its handling, and the role it will play in both technological advancement and our personal lives for years to come.

Topics: big data growth

Why We Built Our Data Platform on AWS, and Why We Rebuilt It with Open Source

Astronomer is a modern platform built to outfit organizations with a solid data infrastructure to support machine learning and analytical workloads. In other words, we help you organize, centralize and clean your data through a personalized data engineering experience. We exist because we believe the internet age is just a precursor to something much larger, something with the potential to push the world forward in the same ways the Agricultural and Industrial Revolutions did: the Data Revolution.

Topics: big data startups dev