Sr. Data Engineer

Sr. Data Engineer

This job is no longer open

The world isn’t standing still, and neither is Allstate. We’re moving quickly, looking across our businesses and brands and taking bold steps to better serve customers’ evolving needs. That’s why now is an exciting time to join our team. As a leader in a corporation with 83,000 employees and agency force members, you’ll have a hand in transforming not only Allstate but a dynamic industry. You’ll have opportunities to take risks, challenge the status quo and shape the future for the greater good.

You’ll do all this in an environment of excellence and the highest ethical standards – a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities.

Everything we do at Allstate is driven by a shared purpose: to protect people from life’s uncertainties so they can realize their hopes and dreams. For 89 years we’ve thrived by staying a step ahead of whatever’s coming next – to give customers peace of mind no matter what changes they face. We acted with conviction to advocate for seat belts, air bags and graduated driving laws. We help give survivors of domestic violence a voice through financial empowerment. We’ve been an industry leader in pricing sophistication, telematics, digital photo claims and, more recently, device and identity protection. We are the Good Hands. We don’t follow the trends. We set them.

Job Description

Avail (affiliate company of Allstate) is a new car sharing platform focused on improving mobility and reducing the cost of car ownership. We give car owners a way to earn extra income from their idle cars and connect drivers with a convenient, affordable way to drive a car when they want. As part of the Avail Data Engineering team, you will be working to manage our ever-growing collection of vehicle sharing and usage data. We support our business analytics and marketing teams by performing data integration and ETL between an increasingly diverse set of data sources and our data warehouse. We will also build big-data applications leveraging techniques from operations research and machine learning to directly enrich, personalize and optimize the Avail car-sharing product. This is a green field opportunity to contribute to the design and implementation of a flexible, scalable data framework for an exciting new sector of the sharing economy.   This position can be based in either of two Avail HQ offices at San Francisco or Chicago, or fully remote with semi-regular travel to SF HQ.

Key Responsibilities

  • Design and implement scalable data workflows and pipelines, and integrate diverse data sources and sinks 
  • Design appropriate database schemas and optimize database deployment architectures for analytics query loads 
  • Implement data transforms and organization for various data stores (data lakes and warehouses) 
  • Design and implement new platform architectures for building and serving machine learning models 
  • Work with the platform operations team to monitor and maintain live production systems 
  • Provide tooling and automation for infrastructure, continuous testing, and continuous deploy of data systems 
     

Job Qualifications

Requirements: 

  • Various experience levels considered. Junior candidates must have a strong background of coursework or academic projects around data engineering or machine learning at scale or have appropriate industry experience contributing to such projects. 
  • Senior candidates must demonstrate a track record of successful technical leadership in the execution of large-scale data projects. 
  • Software Engineering – Level-appropriate experience in software engineering and SDLC (our stack may include Python, Golang and Scala). Must consider code readability, reuse, and extensibility a priority when developing solutions. 
  • Big Data Engineering – Experience in building scalable data pipelines involving machine learning, optimization or prediction 
  • Big Data Devops – Experience in performing operations and automation of various big-data ecosystems in production environments on AWS or a related cloud service 
  • Ability to thrive in a fast paced, cross regional, diverse, and dynamic work environment  

Nice to have:

  • Experience with AWS data stack – Redshift, Athena, EMR, Kinesis, DocumentDB, DynamoDB 
  • Experience with establishing well-organized data lakes 
  • Experience setting up and optimizing data warehouses 
  • Background in data modeling and performance tuning in relational and no-SQL databases 
  • Experience with data practices (security, data management and governance) 
  • Experience in operations research, machine learning or optimization

The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.

Good Work. Good Life. Good Hands®.

As a Fortune 100 company and industry leader, we provide a competitive salary – but that’s just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, you’ll have access to a wide variety of programs to help you balance your work and personal life — including a generous paid time off policy.

Learn more about life at Allstate. Connect with us on Twitter, Facebook, Instagram and LinkedIn or watch a video.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click “here” for information regarding the San Francisco Fair Chance Ordinance.

For jobs in Los Angeles, please click “here” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

It is the policy of Allstate to employ the best qualified individuals available for all jobs without regard to race, color, religion, sex, age, national origin, sexual orientation, gender identity/gender expression, disability, and citizenship status as a veteran with a disability or veteran of the Vietnam Era.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.