Position Summary:

The Data Engineer II designs and develops systems that collect, transform, store, and manage data for end users. They perform coding, debugging, testing, and troubleshooting throughout the development process. The Engineer mentors junior level Engineers. They collaborate with other functional groups to conduct software design reviews.

Meet the team and hear what they have to say about our Product & Engineering group: Meet the Team

Essential Responsibilities:

• Builds pipelines to ingest new data sources
• Transforms data to support varied use cases
• Optimizes existing data pipelines and improves existing code quality
• Includes testing in all aspects of the development process
• Mentors junior level Engineers
• Analyzes potential problems and finds solutions to pressing data issues
• Participates in on-call rotation

Ideal Skills, Experience, and Competencies:

• At least two (2) to six (6) years of relevant data engineering experience
• Intermediate experience with Python
• Advanced experience with SQL
• Experience with Data Modeling
• Moderate experience with a JVM language
• Intermediate experience with Apache Spark or other distributed processing engines
• Intermediate experience with Apache Kafka or other stream processing frameworks
• Moderate experience with Terraform, Docker, Kubernetes, or other similar infrastructure tooling
• Intermediate experience with cloud data tools such as S3, Glue, and Athena
• Exposure to building CI/CD pipelines
• Effective problem solving and troubleshooting abilities
• Ability to consistently achieve results, even under tough circumstances

Required Education & Certifications:

• B.A./B.S. in related field or equivalent work experience

Compensation:

#LI-Remote #LI-JF1 #dice-J #BI-Remote