Position Summary:

The Sr. Data Engineer I designs, develops, tests, deploys, maintains, and improves systems that collect, transform, store, and manage data for end users. They deliver individual projects based upon deadlines and required deliverables. The Sr. Engineer builds complex features independently and collaborates with other teams to conduct design and code reviews. They develop and/or provide technical leadership in the development of data systems involving the application of new technologies with significant technical risk. The Sr. Engineer prepares detailed plans, which may span over a year for complex projects. They determine test philosophy, goals, and objectives, and participate in the formation of project goals, scope, and schedule.

Essential Responsibilities:

• Builds pipelines to ingest new data sources
• Transforms data to support varied use cases
• Includes testing in all aspects of the development process
• Mentors junior and mid-level Engineers
• Optimizes existing data pipelines and improves existing code quality
• Makes updates and improvements to deployment processes
• Participates in project planning and architecture discussions
• Analyzes potential problems and finds solutions to pressing data issues
• Participates in on-call rotation

Ideal Skills, Experience, and Competencies:

• At least Four (4) years of relevant data engineering experience
• Advanced experience with Python
• Expert experience with SQL
• Intermediate experience with a JVM language
• Exposure to other software development languages
• Advanced experience with Apache Spark or other distributed processing engines
• Advanced experience with Apache Kafka or other stream processing frameworks
• Intermediate experience with Terraform, Docker, Kubernetes, or other similar infrastructure tooling
• Advanced experience with cloud data tools such as S3, Glue, and Athena
• Intermediate experience with building CI/CD pipelines
• Effective problem solving and troubleshooting abilities
• Ability to consistently achieve results, even under tough circumstances
• Effective technical leadership abilities
• Excellent verbal and written communication skills
• Experience with innovative application design and implementation
• Ability to make sense of complex, high quantity, and sometimes contradictory information to effectively solve problems

Required Education & Certifications:

• B.A./B.S. in related field or equivalent work experience

• M.S./M.A. in related field or equivalent work experience

Compensation:

#LI-Remote #LI-JF1 #Dice-J