The Role

We are looking for a Lead Data Engineer that will work on collecting, storing, and analyzing data across all of Wizard’s services. 

• Build a scalable and highly performant infrastructure to process batch and real-time workloads
• Work with the data science team to monitor and extract insights from business processes
• Implement ETL data pipelines
• Architect backend data solutions to support various microservices
• Develop third-party integrations with various e-commerce platforms

You

• Bachelor’s degree in computer science or similar discipline
• 10-15 years experience in software development
• Managed teams of 3-5 data engineers
• Hiring and mentoring engineers
• Writing detailed specifications for data processing projects
• Proficient in Python or Java
• Familiarity with the basic principles of distributed computing and data modeling
• Experience building ETL pipelines using Apache Spark, Databricks, or Hadoop
• Experience with NoSQL databases such as MongoDB, Cassandra, DynamoDB, or CosmosDB
• Experience with real-time stream processing systems like Kafka, AWS Kinesis, GCP Data Flow
• Experience with Redis, Elasticsearch, Solr
• Experience with messaging systems like RabbitMQ, AWS SQS, GCP Cloud Tasks
• Familiarity with Delta Lake and Parquet files
• Familiarity with one or more cloud providers: AWS, GCP, or Azure
• Proficiency with Test Driven Development (TDD)
• Proficiency with Git using services such as Github or Bitbucket

Additional Preferred Qualifications

• Great written and verbal communication skills
• Team player hungry to learn from and teach fellow team members

The expected salary for this role is $193,000-$208,000 depending on skills and experiences.