Upwork

Santa Clara, CA

201-500 employees

Upwork is the world’s largest work marketplace, connecting millions of businesses with independent talent around the globe.

Other Open Roles

Prior Listings

Other Jobs in Data Engineering

See all

Contract: Senior Data Engineer, DSI

Upwork

Contract: Senior Data Engineer, DSI

Data Engineering

This job is no longer open

Upwork ($UPWK) is the world’s work marketplace. We serve everyone from one-person startups to over 30% of the Fortune 100 with a powerful, trust-driven platform that enables companies and talent to work together in new ways that unlock their potential.

Last year, more than $3.3 billion of work was done through Upwork by skilled professionals who are gaining more control by finding work they are passionate about and innovating their careers.

This is an engagement through Upwork’s Hybrid Workforce Solutions (HWS) Team. Our Hybrid Workforce Solutions Team is a global group of professionals that support Upwork’s business. Our HWS team members are located all over the world.

Work/ Project Scope:

Operate ML jobs in production
Build and maintain MLops pipelines
Maintain CI/CD pipelines
Maintain data in Databricks in sync with Upwork data sources (Data Lake and Data Warehouse)
Run SQL queries to inspect quality and completeness of the data
Copy data from different AWS clusters regions
Inspect Databricks spark jobs
Support engineers and data scientists on Slack
Debug SQL / Python exceptions
Some experience with Terraform
Some experience with Kafka and Kinesis
Some experience with data governance (data ownership and change management)

Must Haves (Required Skills):

7+ years experience on IT systems
1+ year experience Spark clusters
4+ year solid experience with SQL
2+ years solid experience with DevOps on Linux environment
3+ years solid experience with some programming language
2+ years experience with Python
Some experience with Databricks (optional)
Experience with mission critical system support and availability.
Solid experience with: Moving large amount of data, AWS concepts, S3, Dynamodb, Kinesis, some basic python, background in SQL / Relational databases, good background in bash scripts

Upwork is proudly committed to fostering a diverse and inclusive workforce. We never discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical condition), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

#LI-BF1

This job is no longer open