Job Summary
This role can be based at 433 W Van Buren Street, Chicago or as a remote work from home arrangement.
The Sr. Data Engineer (WH) builds and maintains big data pipelines to support advanced analytics and data science solutions. The role also identifies valuable internal and external data, and collaborates closely with data scientists to define data for the design, development, and deployment of new solutions that support strategic business priorities.
Job Responsibilities
- Develops software that processes, stores and serves data for use by others.
- Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs.
- Writes ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processing.
- Develops and maintains optimal data pipelines into the advanced analytics platform, including design of data flows, procedures, and schedules. Ensures that optimal data pipelines are scalable, repeatable and secure.
- Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
- Anticipates and prevents problems and roadblocks before they occur.
- Interacts with internal and external peers and managers to exchange complex information related to areas of specialization.
- Collaborates with data scientists to prepare data for model development.