Senior Data Engineer

Senior Data Engineer

This job is no longer open
At Kensho, we hire talented people and give them the autonomy, support, and resources needed to build cutting edge technology and products.  We produce a suite of AI-powered solutions that solves the challenges of the largest, most successful businesses and institutions, helping them make sense out of a world full of messy data.

We are seeking an experienced Software Engineer with a specialization in data engineering to join our Machine Learning Team. You will be responsible for implementing data ingestion pipelines to further our large language model efforts. You will work with stakeholders across Kensho and S&P to proactively understand the data landscape, triage data requirements, and ultimately incorporate the necessary data sets into our training corpus. 

Our ideal candidate has 5+ years of experience, has been recognized as a technical leader, and has demonstrated success:
- Navigating between project management, technical leadership, and individual contributor roles
- Negotiating between new requirements, legacy systems, technical debt, and best practices
- Mentoring colleagues on data engineering best practices and systems design

What You'll Do:

    • Work with industry standard and/or open source software such as s3, PostgreSQL and Airflow Support machine learning and application teams by setting up custom data solutions
    • Build event and batch driven ingestion systems for machine learning and R&D as needed
    • Develop and administer databases, knowledge bases, and distributed data stores
    • Create and use systems to clean, integrate, or fuse datasets to produce data products
    • Establish and monitor data integrity and value through visualization, profiling, and statistical tools
    • Perform updates, migrations, and administration tasks for data systems
    • Translate data governance strategy into implementation

What You'll Need:

    • B.S. or M.S. in Computer Science (or a related field) or equivalent work experienceExperience with various data-stores, distributed messaging platforms, or data processing frameworks
    • Experience designing and building reliable systems and data pipelines
    • Experience working with large structured and unstructured data sets
    • Effective coding, documentation, and communication habits
    • Proficient understanding of distributed computing principles
    • Experience integrating/fusing data from multiple data sources and domains
    • Knowledge of various ETL techniques, frameworks, and best practices
    • Strong communication, project management and organizational skills
    • Experience supporting and working with cross-functional teams in a dynamic environment
    • Proficiency with Python
    • (Bonus) Experience with Machine Learning workflows and operations
$150,000 - $225,000 a year
Kensho states that the anticipated base salary range for the position is 150k-225k. In addition, this role is eligible for an annual incentive bonus and equity plans. At Kensho, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.
At Kensho, we pride ourselves on providing top-of-market benefits, including:
 
-       Medical, Dental, and Vision insurance 
-       100% company paid premiums
-       Unlimited Paid Time Off
-       26 weeks of 100% paid Parental Leave (paternity and maternity)
-       401(k) plan with 6% employer matching
-       Generous company matching on donations to non-profit charities
-       Up to $20,000 tuition assistance toward degree programs, plus up to $4,000/year for ongoing professional education such as industry conferences
-       Plentiful snacks, drinks, and regularly catered lunches
-       Dog-friendly office (CAM office)
-       In-office gyms and showers (CAM, DC)
-       Bike sharing program memberships
-       Compassion leave and elder care leave
-       Mentoring and additional learning opportunities
-       Opportunity to expand professional network and participate in conferences and events 
 
About Kensho
Kensho is an Artificial Intelligence company that builds solutions to uncover insights in messy and unstructured data that enable critical workflows and empower businesses to make decisions with conviction.
 
Kensho was founded in 2013 and was acquired by S&P Global in 2018. Kensho continues to operate as a startup in order to maintain our distinct, independent brand and to promote our breakthrough, innovative culture. Our team of Kenshins enjoy a dynamic and collaborative work environment that runs autonomously from S&P Global, while leveraging the unparalleled breadth and depth of data and resources available as part of S&P Global.  As Kenshins, we pride ourselves on maintaining an innovative culture that depends on diversity and inclusion.
 
We are an equal opportunity employer that welcomes future Kenshins with all experiences and perspectives. Kensho is headquartered in Cambridge, MA, with offices in New York City, and Washington D.C.  All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.
 
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.