Senior Data Engineer

Moz

Senior Data Engineer

This job is no longer open

Description

Moz is growing its Data Platform team under the Data Engineering org. This team is focused on all aspects of managing data. We build systems to acquire, extract, transform, score, and serve terabytes of SEO data from a large variety of sources.  We are undergoing a transformation of our workloads to fully cloud-based services, migrating our data center big data stores, Mesos container platform and services to AWS.

If you like the challenge of streamlining data collection processes, managing and improving Big Data related infrastructure, and wrangling hundreds of millions of data points, consider joining us as we build our next-generation data procurement platform to produce the foundational data that fuels Moz’s product, services, and research.

Responsibilities:

  • Build, maintain, and support large-scale collections and processing systems.
  • Assist in the migration of our Hadoop/HBase infrastructure to AWS EMR managed services that serves our keywords relationship metrics plus keywords suggestions and corpus.
  • Be part of a Scrum team that designs, swarms, and pairs together
  • Implement and improve deployment, monitoring, testing, operational and foundational tools.
  • Mentor junior developers
  • Be an excellent problem solver and be willing to roll up sleeves to tackle any issue thrown your way

Required Experience/Skills:

  • 5+ years experience architecting and developing large-scale distributed systems
  • B.S. or higher in Computer Science or equivalent training and experience
  • Experience on Amazon EMR using EMRFS and S3 or HBase cluster using Hadoop’s HDFS and MapReduce infrastructure
  • Familiarity with Python, Java, Spark, Ruby and/or Node.js
  • Familiarity with source control. Github is preferred.
  • Experience with Linux and cloud-based environments
  • Experience with Infrastructure as Code such as Terraform or CloudFormation
  • Ability to communicate with management, software architects, and developers about project status, APIs and overall system health.
  • Work in an agile process – be able to break down work into bite-size chunks and communicate this to the team
  • Working knowledge of modern web technologies including cloud based APIs and protocols (REST, JSON)

Preferred Experience/Skills:

  • Data Science background or experience
  • Amazon Web Services (AWS) experience with EC2, ECS and S3
  • Infrastructure as code provisioning tools such as Terraform/CloudFormation, etc.
  • Participation in a technical community is a major plus: e.g., contributions to open-source projects, published works, presentations in academic conferences or industry circles
  • AWS networking such as VPC and security groups
  • AWS Analytics such as Athena, Glue, Sagemaker, Kinesis

Technologies you will be working with! 

  • Python
  • Node.js ES6
  • Ruby
  • Java, Scala
  • HBase/EMR clusters, Riak, Redis/Elasticache, MySQL 
  • AWS Services
  • 1000's of servers

About Moz Group

The Moz Group, a subsidiary of Ziff Davis, Inc (NASDAQ: ZD), is a leading provider of marketing technology solutions primarily for small and medium-sized enterprises that empowers businesses to engage their customers digitally and grow their revenue by leveraging the power of online search, email, voice, and text communications.

About Ziff Davis

At Ziff Davis, we work in a culture of collaboration and welcome those who desire to join our growing global community. We seek enthusiastic individuals with an entrepreneurial spirit looking for and environment that rewards your best work.

Ziff Davis offers competitive salaries, health benefits, and company-sponsored events. If you are seeking a dynamic work environment where you can see the direct impact of your performance, then Ziff Davis is the place for you. We offer a fun and friendly working environment where individuals are given the opportunity to learn, grown and build on their skills.

#Moz

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.