Senior Data Engineer

Senior Data Engineer

This job is no longer open

The Analytics Team is responsible for building and maintaining analytics tools and workflows to support the PrizePicks business across all departments — at the core of these operations is data. As a Senior Data Engineer, you will develop, maintain, test, and lead data infrastructure projects and help PrizePicks offer a Scalable, Reliable, and Smarter data ecosystem for faster data-driven decisions.

What you’ll do:

  • Enhance the capabilities of our existing Core Data platforms and develop new integrations with both internal and external APIs within the Data organization.
  • Demonstrated expertise in developing real-time and batch frameworks for data ingestion pipelines, utilizing best practices in data modeling, ETL/ELT processes, and ensuring data reliability.
  • Design and implement complex data pipelines and transformation logic in Python, GO and build and maintain dbt models to ensure high-quality data processing.
  • Work closely with DevOps, architects, and engineers to ensure the success of the Core Data platform.
  • Guide teams in implementing and maintaining comprehensive monitoring, alerting, and documentation practices, and coordinate with Engineering teams to ensure continuous feature availability.
  • Design and oversee Infrastructure as Code (IaC) solutions to automate and enhance the deployment and management of data infrastructure. Ensure that configurations are consistent, scalable, and adhere to data engineering best practices.
  • Develop and manage CI/CD pipelines to automate and streamline the deployment of data solutions. Ensure that data workflows are thoroughly tested, integrated, and deployed efficiently, following best practices for version control, automation, and quality assurance.
  • Experience in designing and automating data governance processes and tool integrations across complex technical environments, ensuring data protection and integrity throughout the product lifecycle and data flows.
  • Serve as a Data Engineer within the broader PrizePicks technology organization by staying current with emerging technologies, implementing innovative solutions, and sharing knowledge and best practices with junior team members and collaborators.

What you have: 

  • 5+ years of experience in a data Engineering, or data-oriented software engineering role creating and pushing end-to-end data engineering pipelines.
  • 2+ years of experience acting as technical lead and providing mentorship and feedback to junior engineers.
  • Extensive experience building and optimizing cloud-based data streaming pipelines and infrastructure.
  • Extensive experience exposing real-time predictive model outputs to production-grade systems leveraging large-scale distributed data processing and model training.
  • Experience in most of the following:
    • SQL/NoSQL databases/warehouses: Postgres, BigQuery, BigTable, Materialise etc
    • Replication Services: Data Stream, Hevo, Data Proc etc.
    • Scripting languages: SQL, Python, Go, Rust.
    • Cloud platform services in GCP and analogous systems: Cloud Storage, Cloud Compute Engine, Cloud Functions, Kubernetes Engine etc.
    • Code version control: Git
    • Data pipeline and workflow tools: Prefect, Airflow, Cloud Composer, Serverless Framework.
    • Monitoring and Observability platforms: Datadog, ELK stack.
    • Infrastructure as Code platforms: Terraform, Google Cloud Deployment Manager, Ansible.
    • Other platform tools such as Redis, FastAPI, and Streamlit.
  • Excellent organizational, communication, presentation, and collaboration experience with organizational technical and non-technical teams

What makes you stand out:

  • Experience building real-time production data engineering pipelines in a daily fantasy sports platform
  • Graduate degree in Computer Science,  Mathematics, Informatics, Information Systems or other quantitative field

Where you’ll live:

  • Anywhere in the US is fine but Atlanta would be preferred. 

Benefits you’ll receive:

In addition to your great compensation package, we’ll shower you with perks including: 

  • Company-subsidized medical, dental, & vision plans 
  • 401(k) plan with company match
  • Long-term incentives and bi-annual bonus
  • Uncapped PTO to encourage a healthy work/life balance (2-week MINIMUM required!)
  • Generous paid leave programs, including 16-week paid parental leave and disability benefits
  • Workplace flexibility and modern work schedules focused on getting the job done, not hours clocked
  • Company-wide in-person events and team outings
  • Lifestyle enhancement program
  • Company equipment provided (Windows & Mac options)
  • Annual performance reviews with opportunities for growth and career development

 

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.