Backend/Data Engineer

Backend/Data Engineer

This job is no longer open

Company overview:

Blue Orange Digital is a cloud-based data transformation and predictive analytics development firm with offices in NYC and Washington, DC. From startups to Fortune 500’s, we help companies make sense of their business challenges by applying modern data analytics techniques, visualizations, and AI/ML. Founded by engineers, we love passionate technologists and data analysts. Our startup DNA means everyone on the team makes a direct contribution to the growth of the company.

Position overview:

We are seeking a Backend Engineer to join our product development team to help build, optimize, maintain and support the data pipeline management components of our product. Your main tasks will include developing, refactoring, customizing, and maintaining our data source integration (DSI) platform with multiple partner built data observability platforms. You will join a small team of engineers and have a large impact on shaping how the product is built and designed.

This is a full-time fully remote position for Latin American-based applicants within +/- 2 hours of Eastern Standard Time Zones (NYC). Resume must demonstrate professional English ability.

Responsibilities:

  • Be proficient in server-side development, automation, and optimization of data pipelines, including database creation and management and debugging
  • Integrate data from various backend services, APIs, and databases
  • Create and maintain software documentation
  • Create and analyze reliable and secure backend functionality
  • Build and maintain infrastructure and automation to support the running of the platform across multiple cloud environments.
  • Remain knowledgeable of emerging technologies/industry trends and apply them into operations.

Requirements:

  • Expert-level knowledge and experience in Python.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building, refactoring, customizing, and optimizing ‘big data’ data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with both structure and unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Strong project management, organizational, and collaboration skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a degree in Computer Science or another related field.

Experience using the following software/tools:

  • Experience with relational databases: Postgres, MySQL, MS SQL, etc.
  • Experience with ELT/ETL tools: Meltano, Airbyte or Fivetran.
  • Experience with data pipeline and orchestrator tools: Dagster, Airflow or Kubeflow.
  • Experience with AWS cloud services: EC2, EKS, EMR, RDS, Redshift and S3 (for data lake usage)
  • Experience with at least one of object-oriented/object function scripting languages: Python, Java or Scala.
  • Must have experience with DevOps tools:
    • Experience with IaC such as Terraform
    • Experience with Docker and container orchestration with Kubernetes
    • Experience with CI/CD tools: GitHub or Gitlab

Bonus points:

  • Hold certifications for cloud providers (AWS, Azure or GCP) and Snowflake.
  • Experience using the following software/tools:
    • Experience with big data tools: Spark (Scala or PySpark), Kafka, Hive and Hadoop.
    • Experience with NoSQL databases: MongoDB or Cassandra.
    • Experience with Data Warehouses: Snowflake, Redshift or BigQuery
  • Experience with observability tools for metadata catalog, data lineage and data quality.

Benefits:

  • Fully remote
    Flexible Schedule
    Unlimited Paid Time Off (PTO)
    Paid parental/bereavement leave
    Worldwide recognized clients to build skills for an excellent resume
    Top-notch team to learn and grow with

Salary: $5000 - $6000 USD per month

Blue Orange Digital is an equal-opportunity employer.

Background checks may be required for certain positions/projects.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.