Data Engineer (Data Bricks)

Data Engineer (Data Bricks)

This job is no longer open

Job Highlights:

  • Our technology focus is on Azure – you’ll have plenty of exciting opportunities to grow your skills in Microsoft and Azure in an environment committed to technical excellence and client experience in a very specific, defined space. Six months of experience on our team is worth years somewhere else.
  • Microsoft Partnerships – Our great global relationship with Microsoft ensures that we have a pipeline of cutting-edge Azure work opportunities, and access to the teams that have built the platform. You won’t find this at other places.
  • Competitive compensation package, salary, allowance, standard benefits including quarterly and annual performance-based cash bonus and other remuneration.
  • Great working environment and company culture with flexible work location.

 

Key Responsibilities:

  • Support the development of high performing, reliable and scalable solutions
  • Clearly communicate technical details to business and management personnel
  • Work independently or on a team to design and develop database solutions
  • Assist business development team with pre-sales activities and RFPs

 

Qualifications:

  • Bachelor’s degree in computer science, engineering, data science or a related field
  • Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
  • Knowledge of Databricks development, including Scala, Python, and Spark
  • Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
  • Ability to develop utilizing the following technologies: 
    • Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS)
    • Data Warehousing (Azure Synapse, CosmosDB)
    • Azure Storage Technologies (Data Lake, Blob Storage)
  • Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
  • Understanding of network infrastructure and security including 
    • Workspace Deployment
    • Azure Cloud Concepts
    • Network Security
  • Experience with Informatica (Informatica migration experience would be nice)
  • Eagerness to contribute in a team-oriented environment
  • Desire to work in an information systems environment
  • Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
  • Passionate about learning new technologies
  • Analytical approach to problem-solving; ability to use technology to solve business problems
  • Ability to work in a fast-paced environment

 

Preferred Experience/Skills:

  • Machine Learning/AI Practitioner expertise, including 
    • Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies
    • Experience with Azure ML Studio/Services, and R programming language
    • Understanding of analysis models, including Supervised vs Unsupervised, Regression vs Classification, clustering, and cross-validation
    • Building, Tuning, and deploying analysis models with Spark ML and ML Flow
  • Knowledge of Power BI is a plus
  • Relevant Certifications are a plus
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.