Senior Data Engineer - Machine Learning (US, Canada)

Pex

Senior Data Engineer - Machine Learning (US, Canada)

This job is no longer open
Here at Pex, we're on a mission to democratize digital rights for everyone. We are the team behind the Attribution Engine, a licensing infrastructure for the Internet enabling fair compensation and increased access to content. With its advanced identification technology, Attribution Engine ensures compliance and safety for platforms, gives rightsholders total control of their content, increases access and confidence for creators, helps law enforcement prevent toxic content, and provides brand safety for advertisers.

As a Senior Data Engineer, you will work alongside the Data Lab team to build the machine learning pipelines and databases needed to resolve inconsistencies in many types of music metadata.

Constructing the world's best music metadata source has become a major priority for Attribution Engine and with the new focus on long-tail songwriters, the need for a cleaned and linked music database is increasing. We currently have one engineer working on this system (Legato). The project is estimated to be in the final phases (version 4) next year. Both the speed and quality of work will increase with a second engineer working full time on the project. This will get other teams access to the data they will need sooner. 

The Team

Our engineering organization is made up of fully distributed and cross-functional teams that have talented engineers from various backgrounds and skill levels. The Data Lab team currently includes a Senior Data Engineer, three Machine Learning Engineers, and a Site Reliability Engineer. 

At Pex, we value transparency and clear communication, and we strive to create an environment where all team members feel safe and supported to take initiative, experiment, learn from mistakes, and share opinions freely. 

The Role

We’re looking for an accomplished and pragmatic data engineer who will work on the implementation of our data vision across the organization. As a Senior Data Engineer, you will:

• Create data pipelines for aggregation of 3rd party music metadata
• Contribute to code reviews for others on the team
• Participate in team deep dives and brainstorm solutions with the group
• Document and track your work to preserve transparency and maintainability 
• Stay up to date on new technologies related to Data Engineering

Pex’s Unified Analytics Architecture

Pex aspires to become a data-driven company. Our data architecture follows a unified analytics approach where we are leveraging a single modern cloud-native data platform to enable all types of workloads (batch/stream), all types of consumer profiles (BI & Reporting / ML & AI), and all types of data (structured, semi-structured and unstructured). 

To this end, we have chosen Snowflake as our cloud data platform implementing a Data Lakehouse architecture pattern. Our technology stack also includes dbt+Airflow for data transformation and for our ingestion layer, we use Debezium for CDC-based extract and load operations, and Apache Pulsar as our message queue. Today we offer BI functionality embedded in our core AE product and we are currently looking into modern BI platforms to include in our technology stack.

About You

We have a lot of people who did not follow the traditional career path. We value people who are curious and collaborative and bring their unique perspectives to work each day. While we’re excited to learn what you can bring to the team, there are a few key things you’ll need that are essential to success in this role:

• Experience with relational databases (any kind) - PostgreSQL
• Hands-on experience coding in Python
• Must have Linux/Unix, Git familiarity
• Experience with dbt would be nice but not a hard requirement (being skilled with SQL is also valuable)
• Experience with cloud environments or Snowflake would also be nice  

Perks and Benefits

• Salary: $140,000 - $170,000 USD/year
• Equity, with perks like a 10-year exercise window
• Competitive health insurance (99% employee and 70% dependent premium coverage for US-based employees)
• 401(k) with a considerable match for all US-based employees
• 30 days of paid time off + 9 paid holidays + the day off on your birthday
• Generous paid parental leave
• A fully remote working environment and supportive culture that cares about both excellent work and work-life balance
Pex is an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Since Pex is committed to the full inclusion of all qualified individuals, we strive to ensure that people with disabilities are provided with reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, please let us know when applying for a particular role in the “Additional Information” section.
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.