Senior Data Engineer - Streaming

Senior Data Engineer - Streaming

This job is no longer open

We are revolutionizing technical hiring by giving companies a skills-based hiring platform that enables our customers to assess technical skills effectively. We are growing fast and looking to add to our Engineering team. This position is Full-Time and Remote within the United States.

As a Senior Data Engineer, you will play a pivotal part in HackerRank’s mission to “Accelerate the World’s Innovation”. You are excited to make an impact and enjoy building robust, scalable data-backed solutions, thinking creatively, solving problems, building something users would appreciate.

You will be working on:

  • Design, Build and Maintain real-time and batch ETL pipeline that can scale
  • Architect, Develop and maintain our data warehouse and analytics database
  • Collaborate on critical technology decisions concerning architecture and toolset
  • Production machine learning models by exposing APIs
  • Take ownership of scaling, performance, security, and reliability of our data infrastructure
  • Establish, mentor and advice on data engineering best practices

We are looking for:

  • 3+ years of experience with designing, developing, and maintaining robust Python ETL Pipelines
  • 3+ years of experience with database technologies - MySQL, Postgres, AWS Aurora, Redshift, etc.
  • Experience with Data Streaming Architecture
  • Experience with the Hadoop ecosystem - PySpark, AWS EMR, etc.
  • Experience with Python coding language
  • Experience with Apache Airflow.
  • Experience querying massive datasets using Spark, Presto, etc.
  • Experience with SQL performance tuning.
  • Deployed ML models in a production environment
  • You have built business intelligence applications
  • Able to solve problems of scale, performance, security, and reliabilit

Nice to have:

  • Modern Microservices based architectures with Serverless systems
  • Git and deployment tools
  • Machine Learning
  • Web Backend and API development
  • DevOps and Server Management on AWS or GCP
  • Experience working on Kafka

Benefits & Perks:

We have a full package of competitive benefits and perks which include:

  • Medical, dental, and vision insurance for you and your dependents
  • Unlimited paid time off, paid leave for new parents, and flexible work hours
  • Employee stock options, 401(k) options, commuter benefits, and cell phone stipend

About HackerRank:

HackerRank is a Y Combinator alumnus backed by tier-one Silicon Valley VCs with total funding of over $58 million. The HackerRank Developer Skills Platform is the standard for assessing developer skills for 2,000+ companies across industries and 7M+ developers around the world. Companies like LinkedIn, Stripe, and Peloton rely on HackerRank to objectively evaluate skills against millions of developers at every step of the hiring process, allowing teams to hire the best and reduce engineering time. Developers rely on HackerRank to turn their skills into great jobs. We’re data-driven givers who take full ownership of our work and love delighting our customers!

HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment on the basis of individual performance and qualification. We never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

#LI-Remote

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.