Principal Data Engineer - PDE Team

Principal Data Engineer - PDE Team

This job is no longer open

Working at Atlassian

Atlassian can hire people in any country where we have a legal entity. Assuming you have eligible working rights and a sufficient time zone overlap with your team, you can choose to work remotely or from an office (unless it’s necessary for your role to be performed in the office). Interviews and onboarding are conducted virtually, a part of being a distributed-first company.

To help our teams work together effectively, this role requires you to be located in the Australia / New Zealand.

Your future team

Atlassian is looking for a Principal Data Engineer to join our Product Data Engineering (PDE) team and build world-class data solutions and applications that power crucial decisions throughout the organisation. We are looking for someone who is passionate about building data services that scale. Our team typically works with data scientists, business analysts, and other partners to ensure that data is available, accurate, and usable for decision-making purposes. In this role as a Principal Data Engineer, you will report into the Senior Engineering Manager for Product Data Engineering.

On your first day, we'll expect you to have

  • 7+ years of experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
  • 5+ years of experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.
  • 5+ years of experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
  • Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset to lead Atlassian's business growth and improve the product experience.

We'd be super excited if you have

  • Designed and implemented OLAP (Online Analytical Processing) to power real-time analytics.
  • Built real-time data processing pipelines using Apache Spark Streaming/ Databricks and is well-versed with their APIs.
  • Develop and implement data governance procedures to ensure data security, privacy, and compliance.
  • Above all else, as a Principal Data Engineer, you will lead large programs, driving architectural decisions, and incorporating business and technology strategies. You will mentor junior members of the team and help onboard and grow the team.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.