Big Data Engineer

Big Data Engineer

This job is no longer open

About the role

We are looking for Data Engineers to come join Cloudflare and help us build a scalable petabyte scale data lake and EDW using modern tech stack from the ground up. Success in this role comes from marrying a strong data engineering background with product and business acumen to deliver scalable data pipelines and BI solutions that can enable analytics using self-service user interface at Cloudflare in a simple and agile manner. 

Your Responsibilities::

  • Designs, builds and supports scalable and reliable data solutions that can enable self-service reporting and advanced analytics using open source technologies in an agile manner.
  • Designs, builds and supports deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources
  • Develops technical tools and programming that leverage machine learning and big-data techniques to cleanse, organize and transform data and to maintain and update data structures and integrity on an automated basis
  • Close partnership with internal stakeholders and partners from Engineering, product, and business(Finance, Sales, Customer Experience, Marketing etc.).
  • Ability to design application components and evolve architecture including UI, API/Services, Data Access, Integration, Application components etc.
  • Capable of working closely with business and product teams to ensure data solutions are aligned with business initiatives and are of high quality.
  • Analyze and support platform requirements for Data Science team
  • Build tools to automate the monitoring or workload and take proactive measure to scale the platform or to fix the problem 

Basic Qualifications:

  • Bachelor’s or Master’s Degree in Computer Science or Engineering or related experience required.
  • 3+ years of development experience in Big data space working with Petabytes of data and building large scale data solutions using Google Cloud Platform, Apache Spark, Airflow, Kafka, Scala, Python,  etc
  • 1+ yr of experience with front end programming (React, Angular, HTML5, CSS etc.)
  • Experience with API design and development of RESTful web services or GraphQL
  • Knowledge of and experience with the backend frameworks like NodeJS, Golang, Python etc
  • Experience with automation tools and frameworks (CI/CD pipelines)
  • Working experience in Kubernetes, Docker etc.
  • Possess a problem-solving attitude.
  • Experience in the Internet security industry is preferred.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.