Big Data Engineer

Big Data Engineer

Overview

The position

Do you want a highly impactful role within fast growing team? Are you passionate about driving business value with products that deliver an awesome customer experience? The APFM technology team is looking for a Big Data Engineer who will focus on building company’s data lake using Databricks and AWS. In this role you will work with a team of developers, scrum masters, and business analysts in an agile environment. You will create and enhance user-friendly, highly available Big Data Platform. You will participate in the entire software development lifecycle, including: working with various departments on requirements gathering, translating business requirements into detailed system and technical requirements, functional and technical design, development, testing, deployment, and support. You will contribute to all data management aspects, including data governance, data quality management, master data management, enterprise data integration by analyzing raw data, writing ETL pipelines in SQL, Python, and Spark, and solving data issues as they arise during development and after deployment.

Who you are

  • Bachelor’s degree or an equivalent working experience.
  • 1+ Years of Apache Spark development experience (PySpark, Python, SQL).
  • Share a strong passion for new technologies and driving innovation.
  • Deliver high quality, production ready code, this is a high priority for you.
  • Eager to always learn new technologies and expand your skillset.
  • A creative and inventive software development expert.

Responsibilities

What you will do

  • Hands-on software development in Python, SQL, Apache Spark.
  • Design and build high scale, near real time and batch data processing pipelines.
  • Partner with your peers in Product, Design, Scrum framework, and technology to develop our next generation data platform.
  • Create and maintain technical documentation.
  • Guide and deliver meaningful and thorough code reviews.
  • Ensure performance, quality, and accuracy of our data.

Qualifications

Required skills and competencies

  • Strong hands on experience in Python, SQL, and Spark
  • Experience in Databricks, Delta Lake, Parquet, Hive, PySpark, and Spark SQL
  • Proficient in one or more environments: Linux, Windows, and/or iOS
  • Experience in AWS: S3 / EMR / Lambda

About A Place For Mom

We’re the leading online platform connecting families searching for senior care with a team of experienced local advisors providing insight-driven, personalized solutions. As the nation’s most trusted senior advisory service, we are a mission-based organization that enables caregivers to make the best senior living decisions for their loved ones. With hundreds of senior living experts nationwide, A Place for Mom helps hundreds of thousands of families each year simplify the process of finding the right senior care solution across home care, independent living, memory care, assisted living, and more.  Our services are offered at no cost to families as we’re paid by the 14K+ communities and 3K+ providers in our network.

Recently awarded one of the 2022 Best Places to work in NY and Best HR teams by Comparably, the leading workplace culture and brand reputation platform,  A Place for Mom is committed to fostering, cultivating, and preserving a culture of diversity, equity, and inclusion.

Employees who thrive at A Place for Mom live our values every day:

  • Focus on Excellence
  • Act with Integrity & Assume Positive Intent
  • Drive Outcomes Every Day with Passion and A Sense of Mission
  • Make the Lives of our Families and Customers Better, Easier and More Successful
  • Realize the Full Potential in Each Team Member.  Work as a Single Supportive Team

#LI-KT1

#LI-REMOTE

#LI-KT1

Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.