Principal Engineer - Data Engineering

Principal Engineer - Data Engineering

This job is no longer open
 
Responsibilities:
  • You lead the conceptualization, design, development, testing, deployment, and optimization of complex data solutions for the ingestion, processing, and transformation of large volumes of structured/unstructured data, setting the standard for best practices and high-quality coding.
  • You establish, influence, and ensure policies and procedures for developing extensible, reusable, and maintainable code. You create and apply metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices. You optimize data solutions for performance, scalability, and cost-efficiency.
  • You lead platform & product development and scaling to customer requirements and apply best practices for meeting scaling needs and performance expectations and hold accountability for products that do not meet expectations. You establish, enforce, and improve data quality standards, governance policies, and compliance with relevant regulations to ensure data accuracy, consistency, and security
  • You oversee overall data architecture for critically important and high-impact spaces. You hold accountability for incorporating critical product strategy components into the data architecture. You create a strategic roadmap for the data architecture by considering how related operational and analytics needs will evolve in the near future. You demonstrate business domain expertise in shaping technical solutions aligned with strong engineering principles and direct business value.
  • You are actively engaged in experimentation for highly complex, ambiguous, or otherwise valuable technological spaces. You provide technical leadership for problem solving and/or efficiently building software developer tools. Your mentorship to engineers across all levels, empowers their growth and promotes technical excellence throughout the group.
  • You collaborate and coordinate with other senior leaders in engineering, product, analytics, data science, and business domains to align on policies and procedures to negotiate and align on cross-function dependency roadmaps. You lead and manage high-impact data engineering projects, ensuring successful delivery within defined timelines and budget constraints.

 

Qualifications:
  • Master of Science or advanced Degree in Computer Science, Information Systems, or other related field, or equivalent work experience
  • Track record as a highly successful, hands-on engineer in SaaS environments and a champion of best practices
  • 6+ years of experience developing and scaling engineering teams.
  • 10+ years of experience in software development/coding
  • Strong understanding of coding languages Python & SQL.
  • Expert in Modern Data Platforms and AI/ML ecosystems (Databricks strongly preferred)
  • Strong practical skill in Relational data modeling and batch processing on SQL databases
  • Expert with Distributed processing framework like Spark
  • Expert with Streaming data platforms like Kafka or AWS Kinesis
  • Strong practical skill with Realtime stream processing frameworks like Flink, Spark Streaming or Kafka Stream
  • Strong practical skill with Cloud computing systems like Amazon Web Services
  • Strong practical skill with Big Data analytics tools like Hive or Spark SQL
  • Ability to seamlessly toggle between the strategic and the tactical. Ability to develop vision, strategic plans, product roadmaps as well as tactical priorities, processes, procedures, and issue resolution.
  • Strong communication and organisational skills
  • Strong product sense coupled with an ability to take a developer perspective.
  • Very strong analytical skills – including requirements analysis, detailed planning, and risk assessment.
  • Fluent in good architecture design
  • Strong ability to build relationships with internal leadership at all levels, along with effective interpersonal, presentation and communication skills.
  • Ensures budgets and schedules meet corporate requirements.
  • Experience with financial systems, payment systems and/or credit decisioning systems, preferably in loans or similar products.

 

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.