Sr. Big Data Engineer

Sr. Big Data Engineer

This job is no longer open
Build the future!

Come join our growing Digital Platform Group (DPG) with McGraw-Hill. You’ll create innovative, digital learning solutions in an environment that feels like a startup, but has the foundation of a successful EdTech company. Contributing to this group means you’ll utilize state-of-the-art technologies to deliver intuitive learning experiences. We build big data-driven digital products that are used by millions of students around the globe. As both our business and the EdTech space quickly evolve, we need hard-working, passionate people to be a part of our dynamic team. 
 
As a part of our Analytics and Reporting team, the role of Senior Big Data Engineer provides technical expertise and leadership in developing our core data ingestion, processing, and API platform built using big data technologies Spark/Scala and will contribute to shaping the future of education technology by enabling advanced analytical insights across all McGraw-Hill products. Join our team of data scientists, data engineers, and software engineers, and help us positively impact the next generation of learners with innovative, new learning technologies!
 
Your contribution to the team includes:
·   Developing applications in Scala and Spark which ingest and process millions of behavioral events from products and components in the McGraw-Hill ecosystem, in real-time.
·   Creating highly efficient and scalable structured streaming workloads which can handle complex joins and aggregations across multiple streams, while handling data issues such as out of order data and late/missing data, on large in-memory dataframes.
·     Developing solutions and contributing to architectural decisions across the entire data infrastructure, from event ingestion (Kafka) to data modeling/warehousing (Postgres, Neo4J)
·               Technical leadership across several teams with a focus on strong engineering discipline, including data-driven planning, automated testing, code reviews, continuous integration, and building the right thing, the right way, at the right time. 
·               Full stack support of legacy applications using (node.js, lambda functions, elastic search) serving MHE customers.
·               Researching production issues and working with colleagues to quickly resolve them.
·               Work on ingesting data and building data-lake that can store/process all MHE product events being generated daily
 
·               Prototyping with emerging technologies to continuously improve data freshness, accuracy, and value for our customer teams.
 
 
What you’ll need to be successful:
·              Master’s degree in Computer Science or equivalent experience in software engineering.
·              Experience with various Big Data technologies in one or more ecosystems Open Source, Microsft or AWS
·               4-5 years of experience in developing applications with Apache Spark, microservices in AWS ecosystem.
·               Strong experience with programming languages (Scala, Java).
·               Strong understanding of database architectures, including row and column stores, data lake topologies.
·               Strong hands-on work ethos, including ability to jump into multiple areas and help engineers get things done.
·               Experience implementing software systems for applications developed with cloud technologies (preferably AWS)
·               Familiarity with the Agile methodology and tracking tools (Jira).
·               Excellent interpersonal skills, the ability to collaborate with teams, as well as excellent verbal and written communications. 
 
This position can be filled in Boston, MA or New York City, NY or remote-US locations.
 
When you join our team, you become part of a company that impacts millions of students and teachers every day. As a leader in the EdTech space, McGraw-Hill offers flexibility and collaboration while creating innovative products that positively impact learning. Our mission is to unlock the potential of every learner and every employee. 
 
Join us for a career where you’ll grow both personally and professionally in a welcoming, diverse, and inclusive environment. 
 
 
 
 
 
As an education innovation company, we're proud to play our part by inspiring learners around the world. If you bring your curiosity, we'll help you grow in a collaborative environment where everyone shares a passion for success.

Are you ready for a new challenge? Apply for a career at McGraw Hill and together, we'll impact the world.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.