Senior Back-end Engineer | Data Observability

Engineering | Full-time

Astronomer is the commercial developer of Apache Airflow, a community-driven open-source tool that’s leading the market in data orchestration. We’re a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators. Our mission is to build an Enterprise-grade product that makes it easy for data teams at Fortune 500’s and startups alike to adopt Apache Airflow. As a member of our team, you will be at the forefront of the industry as we strive to make Apache Airflow the de-facto standard in data orchestration.

We are looking for an Engineer to help scale our self service SaaS Platform in the cloud. You will collaborate with a cross-functional team, quickly iterating on a product that directly makes our customers’ life better. Your primary focus will be to contribute to a scalable, secure, multi-tenant and reliable platform for our customers. We thrive to build software incrementally with a state of the art CI/CD pipeline.You will also improve our abilities to enrich and mine our data lineage graph to enable quick troubleshooting across organisational boundaries. You will have a substantial impact on the future direction and success of the company. 

Responsibilities

  • Own improvement to data lineage collection and analysis services.
  • Collaborate with other team members to find coherent solutions.
  • Contribute to open source as needed to improve standardisation of metadata/lineage collection.
  • Ensure we follow the lean startup principles of building our product incrementally and measure the value that our customers get from our product to make better decisions.

Requirements and qualifications

  • Proficiency in at least one JVM language (Java, Scala, ...).
  • Familiarity with RESTful APIs. (Jax-RS, OpenAPI)
  • Experience with CI/CDFamiliarity with Postgres databases and cloud storage services.
  • Experience with cloud services and Kubernetes.Collaborative, used to receive and deliver constructive feedbackExperience with building products incrementally

Bonus Points

  • Familiarity with open source collaboration.
  • Open source contributions are a plus but not a requirement.
  • Familiarity with PythonUnderstanding of Spark, Hive, SQL and similar data processing engines.


At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.  Astronomer is a remote-first company.
Apply Now