Senior Data Engineer – Ad Platform BI

Location: Bristol, CT

Disney’s Media & Entertainment Distribution (DMED) division is a newly formed technology epicenter which combines Disney’s tradition of bold innovation and creativity to directly deliver compelling content to hundreds of millions of people all around the world. Comprised of Disney’s media businesses and the Company’s various streaming services, the DMED segment aligns technology, content, and distribution platforms to expand the Company’s global footprint and deliver world-class, personalized entertainment experiences to consumers around the world. Our employees are leading, creating, innovating, and making bold moves in unexpected directions that redefine not just what a mass media entertainment company does, but what it can do.

Within DMED, the Advertising Platforms team is responsible for creating and scaling innovative global advertising solutions by building mission-critical tools and workflows to support digital & linear ad sales, traffic, marketing and parts of broadcast operations. Being part of the DMED team is a once-in-a-career opportunity to be a part of what’s next.

Job Summary:

Using the latest cloud database technologies, the Sr. Data Engineer will design multiple data initiatives applying innovative architecture that will eventually scale to the cloud. You will work to future-proof the Enterprise Data Warehouse to support BI/Analytics for the Linear Ad Sales Unified Platform.  In addition, you will design best-practice solutions to share and absorb linear and non-linear Ad Sales data from other departments. You will be architecting the different stages of the data pipeline, including acquisition, integration, ODS, and Real Time data marts. You will leverage CDC and utilize data integration tools such as Qlik Replicate, Informatica, SAP Data Services, Oracle GoldenGate, to deliver real time data for the Ad Sales BI initiative. You will advise and guide senior engineers, scrum teams and the COE to deliver data through an Agile philosophy.

We are looking for a creative and talented individual who has mastered scalable platforms which scale at peta-byte level and extract value from both structured and unstructured real-time data.  Specifically, we are looking for a technology expert with proven experience on highly scalable and extensible data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels. You must be self-driven to continuously evaluate new technologies, innovate and deliver solutions for business-critical applications with little to no oversight from management team. You must also evangelize successful technical patterns across the company and educate your team members in order to develop highly motivated and skilled data engineers.

Responsibilities and Duties of the Role:

• The Sr. Data Engineer will help develop the next generation of enterprise data warehouses (EDW) to deliver batch and real time data for analytics and reporting capabilities to the Linear Ad Sales business unit.
• Design and implement the different stages of the EDW data pipeline, using tools such as Qlik Replicate, Informatica, Oracle ExaCC Exadata, SAP Data Services, Oracle GoldenGate, Oracle BigData Extension, and Kalido DIW
• Experience developing with a mix of languages (Java, Python, SQL, etc.) and frameworks to implement data processing pipelines.
• Experience with real-time and scalable systems development using Kafka, Apache Flink or Kafka Streams.
• Experience building robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
• Have a technology toolbox – Hands on experience with newer technologies relevant to the data space such as Kafka, Spark, and Snowflake. You'll have plenty of experience with developing in a cloud native environment with many different technologies.
• Problem solver – Enjoy new and meaningful technology or business challenges which require you to think and respond quickly.
• Passion and creativity – Are passionate about data, technology, & creative innovation.

Required Education Experience/Skills/Training:

• Bachelor’s degree or better in Computer Science or a related technical field or equivalent job experience.

• Experience with open-source tools such as Kafka, Flink, Spark, and Kubernetes.
• Experience working in AWS cloud environment.
• Prior experience building scalable platforms – handling large scale data, operationalizing clusters in cloud environment.
• Practical Knowledge of Linux or Unix shell scripting.
• Strong sense of ownership, urgency, and drive
• Proficiency with agile development methodologies shipping features every two weeks.
• 5+ years as a Sr. Data Engineer or Data Engineer Architect.
• 5+ years of experience working with SQL Server, Redshift, Aurora,  Oracle and Snowflake databases or similar technologies
• At least 5+ years development experience in a data warehousing/ Data Mart or big data environment
• At least 3+ years with data warehouse / Data Mart design experience
• Experience with PL/SQL, SQL, database performance Tuning and optimization
• Experience with Python
• Experience with ML/AI
• Experience with ETL and other data integration tools such as Informatica, SAP Data Services, Oracle GoldenGate and Tidal Enterprise scheduler
• Robust data analysis and root cause analysis skills
• Ability to multi-task and prioritize multiple distinct projects
• Ability to manage working across different time zones effectively
• Ability to anticipate technical challenges and develop contingency plans
• Self-motivated independent thinker and collaborative team member

Preferred Skills

• Media Ad Sales in Linear & Digital experience preferred
• Experience with Qlik Replicate
• Experience with AWS, Azure, Kafka, Snowflake, Airflow or other cloud technologies