The importance of hiring a Director of Data Engineering

We are seeking a visionary Director of Data Engineering, reporting to the CTO, to spearhead the development and optimization of our data infrastructure. This strategic role entails overseeing the design of data architecture, safeguarding data quality, and managing data platforms with a strong focus on event-based architectures and pipelines, including pub-sub systems and event-driven microservices. The candidate should demonstrate a rich background in ETL processes, programming with Python, expertise in SQL, experience with Redis, NoSQL databases, PostgreSQL, and analytics platforms. This leadership position requires an expert in software development, agile frameworks, project management, software architecture, cloud-native development, and best practices in Data-Ops and Dev-Ops.

What you’ll do:

• Architect and lead the development of complex data ecosystems, ensuring seamless data flow and integration across event-based architectures and microservices.
• Design and implement robust event-driven pipelines utilizing pub-sub mechanisms to facilitate real-time data processing and distribution.
• Ensure high data quality and implement processes for data accuracy, validity, reliability, timeliness, relevance, and completeness.
• Build, scale, and maintain ETL processes to support efficient data extraction, transformation, and loading across various sources and destinations.
• Lead the selection and management of a variety of data storage solutions, including Redis, NoSQL databases (e.g., MongoDB, Cassandra), S3/Buckets, and PostgreSQL.
• Develop strategies for integrating analytics platforms with existing and new data structures to support business intelligence and analytics initiatives.
• Champion agile methodologies and project management to ensure timely delivery of data solutions.
• Advocate for data-first development practices across all development teams
• Drive the implementation of Data-Ops and Dev-Ops methodologies to enhance collaboration between data professionals and operational teams.
• Recruit, mentor, and provide thought leadership to a talented team of data engineers, data analysts, and software developers, fostering an environment of innovation and continuous improvement.
• Collaborate with IT, product, and business teams to align data engineering initiatives with enterprise goals and deliver value-driven data solutions.
• Keep abreast of emerging technologies and trends in data engineering, event-driven architecture, and related fields.
• Establish a culture of continuous learning and improvement, encouraging innovation and keeping the team updated with the latest industry trends.

KPIs:

• Data Quality Score
• Data Infrastructure Uptime and Reliability
• Data Processing Latency
• ETL Success Rate
• Compliance and Security Standards Adherence
• Team Performance and Growth
• Analytics and Reporting Capabilities
• Stakeholder Satisfaction
• Cost Optimization
• Data Accessibility and Usability

What you’ll need:

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related technical field.
• Minimum of 10 years’ experience in data engineering with at least 5 years in a leadership role overseeing data operations.
• Strong coding skills in Python and SQL, with experience working with Redis, NoSQL databases, and PostgreSQL.
• Demonstrated experience with designing and implementing event-based systems, pub-sub models, and event-driven microservices.
• Expert knowledge of ETL tools, techniques, and data integration challenges.
• Proven track record of managing analytics platforms and integrating them with various data sources.
• Deep understanding of the software development lifecycle, agile practices, project management disciplines, and software architecture fundamentals.
• Familiarity with cloud-native development and extensive experience with major cloud service providers (AWS, Azure, Google Cloud).
• In-depth knowledge of Data-Ops and Dev-Ops practices, including CI/CD pipelines.
• Exceptional leadership capabilities, communication skills, and the ability to drive strategic data initiatives across the organization.

What we offer:

• Competitive compensation
• Health, dental, vision, life, and short-term disability insurance
• 401(k)
• 100% remote
• Generous PTO and federal holidays off
• Employee discount