Senior Data Engineer

Senior Data Engineer

This job is no longer open

Working at Atlassian

Atlassian can hire people in any country where we have a legal entity. Assuming you have eligible working rights and a sufficient time zone overlap with your team, you can choose to work remotely or from an office (unless it’s necessary for your role to be performed in the office). Interviews and onboarding are conducted virtually, a part of being a distributed-first company.

Your future team

Data engineering team at Atlassian is a group of professionals responsible for developing databases, data pipelines, and data marts, and ensuring that data is structured and formatted for use by downstream applications. Members of the data engineering team typically have a background in computer science, software engineering, and database design. These teams typically work with data scientists, business analysts, and other partners to ensure that data is available, accurate, and usable for decision-making purposes. In this role as a Senior Data Engineer, you will report into the Engineering Manager - Product Data Engineering.

Role

A successful Senior Data Engineer has technical skills in data modeling, database design, and programming languages such as Python, Java, or Scala. You should also have experience working with Big Data technologies such as Hadoop, and Spark. You will need to work with other teams to understand their data needs and develop solutions. Additionally, experience with streaming data sources and sinks, such as Apache Kafka or AWS Kinesis, would be valuable.

What you'll do

  • Design and implement data pipelines to ETL data from multiple sources into a central data warehouse.
  • Design and implement real-time data processing pipelines using Apache Spark Streaming.
  • Maintain data processing infrastructure, including databases, data lakes, and data warehouses.
  • Ensure data quality and consistency across all data systems.
  • Develop and implement data governance procedures to ensure data security, privacy, and compliance.
  • Collaborate with other teams, such as software engineers, product managers, and business analysts, to understand data needs and develop solutions to meet those needs.
  • Implement new technologies to improve data processing and analysis.
  • Coach junior data engineers to improve their skills.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.