Job Summary:

At Disney Streaming, data is a key strategic priority. The Data, Algorithms, Tech, Analytics (D.A.T.A.) organization within Disney Streaming builds trusted datasets, algorithms and actionable insights to empower Disney to delight our customers.

The Compute and Orchestration team within D.A.T.A.'s Data Foundation Platform group is looking for a Manager, Data Engineering to oversee all things data lake. You will be tasked with overseeing and directing platform offerings related to big data compute, cloud storage, and job deployment. You will be responsible for leading the team that ensures these platform offerings scale with our growing business; this includes aligning our offerings with the broader platform group and innovating on newer initiatives around metastores and simplifying data access rules.

At Disney Streaming we feel strongly that teams should own their own processes, decide their own technologies, and design solutions for the long term. If you're interested in working in a highly collaborative team environment like this, please get in touch - we'd love to hear from you! 
 
Responsibilities:

•  Lead a cross-functional team of engineers; drive process improvement, recruitment, professional development, and effective team culture

• Ensure current tools operate effectively and scalably, while also collaborating with product management to set a long-term strategy and roadmap to meet Disney Streaming’s expanding needs for big data job orchestration

• Build tools and services to support lineage, data governance, and real time notifications across the data platform

• Influence and drive software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation

• Work with other teams: evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption

Basic Qualifications:

• 5+ years of relevant professional experience; 2+ years of leadership experience running projects

• Proficient with Spark; proven experience managing a Spark-based data platform (we’re a Databricks shop; we also have EMR)

Preferred Qualifications:

• Excellent with Python or Scala

• Experience building robust CI/CD systems and working with infrastructure-as-code

• Ability to dive deep into any technical component as well as understand and drive the overall systems architecture.

• Excellent written and verbal communication skills

• Experience with job scheduling with Airflow or data warehousing with Redshift/Snowflake

• Familiarity with metadata management, data lineage, and principles of data governance
   

Required Education:

•  Bachelor’s degree in Computer Science or related field or equivalent work

Just like the best ensemble casts of our favorite shows, Disney Streaming embraces diversity and is an inclusive environment. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, genetic information, or other applicable legally protected characteristics. We are proud to be an Equal Opportunity Employer.