Job Details

Level

Experienced

Job Location

REMOTE - Philadelphia, PA

Position Type

Full Time

Job Category

Information Technology

Description

Job Title: Lead Data Engineer

Location: Remote or Philadelphia, PA Headquarters

Overview:

We are looking for a Lead Data Engineer to join our growing team of analytics experts. You will lead a small team responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Lead Data Engineer will partner with our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. If you are excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives, we would be thrilled to have you apply!

What You Do:

• Manage and optimize core data infrastructure
  • Develop custom data infrastructure not available off-the-shelf
  • Build monitoring infrastructure to give visibility into the pipeline’s status
  • Monitor all jobs for impact on cluster performance
  • Run maintenance routines regularly
  • Tune table schemas to minimize costs and maximize performance
• Build and maintaining custom ingestion pipelines
• Support data team resources with design and performance optimization
  • Work with data and analytics experts to strive for greater functionality in our data systems
• Build non-SQL transformation pipelines
• Build processes supporting data transformation, data structures, metadata, dependency and workload management

Qualifications

What You Bring:

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Experience building and optimizing data pipelines, architectures and data sets
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• Strong analytic skills related to working with unstructured datasets
• Experience supporting and working with cross-functional teams
• Preference for individuals with advertising technology experience including data integrations with ad exchange(s) and identity partners such as Crossix, ComScore, LiveRamp, Google Ad Manager or others

Our Technologies:

• AWS: SES, RDS (MySQL), EC2, Elasticsearch Service, Route 53, VPC, etc
• Snowflake
• Fivetran
• DBT
• Airflow

HEALTH UNION REALLY IS THE BEST PLACE TO WORK

Health Union is a dynamic company that’s growing at a fast pace. To us, the most important part of managing fast growth is maintaining our culture. But don’t just take our word for it: Philly.com, Philadelphia Business Journal, and MM&M have all named Health Union a “best place to work”--and we take pride in living up to that hype every day. At Health Union:

• We cultivate a fun, family-friendly work environment that values inclusion, community, excellence, and transparency.
• We work hard, play hard and in the process, form close-knit relationships that breed an authentic, respectful culture of teaching and learning.
• All team members - from executives to managers to people in entry-level positions - sit together in an open office and enjoy a fully integrated, collaborative and supportive work environment.
• Full-time team members are immediately eligible for comprehensive health benefits, FSA for transit, parking, and dependent care, as well as PTO, paid parental leave, Summer Fridays, and paid holidays.

Health Union is the only digital health company that continuously works to bring people together by evolving social interactions into meaningful health conversations through a growing portfolio of online health communities. Every day, Health Union encourages engagement that helps millions of people with chronic conditions find the information, connection and validation they seek. Learn more at www.health-union.com.

EEO Statement:  We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, disability status, age, protected veteran status or any other characteristic protected by law.

To comply with federal law, Health Union participates in E-Verify. Successful candidates must pass the E-Verify process after hire.

Applicants must be legally eligible to work in the U.S for any employer.

This is a full-time position, located at Health Union offices in Philadelphia (Center City). Relocation assistance is not available for this position.

*Candidates only. No direct calls or emails. No recruiters/agencies, please.