As a Data Engineer, you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and be someone who loves to bring data together to answer business questions at speed. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with analysts, data scientists and business stakeholders.

Responsibilities:

Design and build mission critical data pipelines with a highly scalable distributed systems architecture - including data ingestion (streaming, events and batch), data integration, data curation
Help continually improve ongoing reporting and analysis processes, simplifying self-service support for business stakeholders
Automation of end to end data pipeline with metadata, data quality checks and audits
Optimize the data pipelines to support BI and ML use cases
Support mission critical applications and near real time data needs from the data platform
Capture and publish metadata and new data to subscribed users
Work collaboratively with business analysts, product managers, data scientists as well as business partners and actively participate in design thinking session
Participate in design and code reviews

Qualifications:

3+ years’ experience  years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets

1+ years' of experience in programming language like Python, Scala

1+ years' experience building with AWS or other cloud environments
Strong familiarity with batch processing and workflow tools such as AirFlow, NiFi
Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
BS/BA degree in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines

Nice to have:
Masters in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines
Experience with data visualization tools such as Tableau, Looker, PowerBI