About Anaconda

Be at the center of AI

With more than 45 million users, Anaconda is the most popular operating system for AI providing access to the foundational open-source Python packages used in modern AI, data science, and machine learning through a seamless platform. We pioneered the use of Python for data science, championed its vibrant community, and continue to steward open-source projects that make tomorrow’s innovations possible. Our enterprise-grade solutions enable corporate, research, and academic institutions around the world to harness the power of open source for competitive advantage, groundbreaking research, and a better world. To learn more visit https://www.anaconda.com.

Here is why people love most about working here: We’re not just a company, we’re part of a movement. Our dedicated employees and user community are democratizing data science and creating and promoting open-source technologies for a better world, and our commercial offerings make it possible for enterprise users to leverage the most innovative output from open source in a secure, governed way.

Summary

We are seeking a Senior Data Scientist with deep expertise in NLP, user insights, and data science to join our AI Services team. In this role, you will lead efforts to evaluate and improve our language models (LLMs) while leveraging user telemetry and feedback to drive product enhancements. This position is ideal for a data scientist who combines strong analytical skills with a strategic understanding of user experience and model performance, helping to shape the future of our AI products.

What You'll Do

• Evaluate and Optimize LLMs: Design and execute experiments to assess and improve LLM performance across key metrics, focusing on accuracy, efficiency, and user relevance.
• Analyze Telemetry and User Data: Collect and analyze user interactions and telemetry data to identify patterns, uncover user needs, and provide actionable insights that drive model and product improvements.
• Translate Insights into Action: Work closely with product, engineering, and UX teams to ensure insights are actionable and aligned with business goals, directly influencing the user experience.
• Build and Maintain Data Pipelines: Develop and maintain clean, tested, and reproducible data pipelines to support continuous model evaluation and analysis.
• Experiment Design and A/B Testing: Design A/B tests and experiments to validate model improvements, using statistical methods to ensure robust, data-driven decision-making.
• Collaborate Across Teams: Partner with cross-functional teams to communicate findings, recommend improvements, and ensure data-driven decisions shape product development.

What You Need:

• 8+ years of data science or machine learning experience, with at least 4 years focused on NLP or language model evaluation.
• Strong proficiency in Python and experience with data analysis libraries (e.g., Pandas, NumPy) and machine learning frameworks (e.g., TensorFlow, PyTorch).
• Expertise in NLP evaluation techniques and statistical methods for A/B testing, hypothesis testing, and experiment design.
• Experience with telemetry and user data analysis to generate actionable insights.
• Clean, maintainable coding skills with a focus on reproducibility and testing.
• Excellent communication skills for translating technical insights into clear, actionable recommendations for non-technical audiences.
• Team attitude: “I am not done until WE are done”
• Embody our core values:     
• • Great People
  • Great Product
  • Great Performance
• Care deeply about fostering an environment where people of all backgrounds and experiences can flourish 

What Will Make You Stand Out:

• Experience in MLOps and model deployment: Familiarity with deploying, monitoring, and optimizing ML models in production environments.
• Advanced knowledge in data visualization: Ability to create compelling visualizations to communicate insights and model performance.
• Experience in cross-functional environments: Proven track record working closely with product, UX, and engineering teams to align technical and user-focused goals.
• Curiosity and passion for NLP advancements: Staying up-to-date with the latest trends and advancements in NLP, with enthusiasm for applying innovative techniques to enhance model performance.
• User-centric perspective: Strong commitment to understanding and addressing user needs, leveraging feedback to refine and improve model experiences.
• Experience working in a fast-paced startup environment
• Experience working in an open-source, AI, or data science-oriented company

Critical Competencies

• Technical Excellence in NLP and Model Evaluation: Deep expertise in natural language processing, with a proven ability to design rigorous evaluation frameworks for LLMs and apply relevant NLP metrics.
• Data-Driven Decision-Making: Strong analytical skills and a methodical approach to leveraging data insights, experiment design, and statistical methods to drive informed, impactful decisions.
• User-Centric Insight Generation: Ability to extract meaningful insights from telemetry and user feedback data, focusing on improving user experience and aligning model performance with real-world needs.
• Effective Communication and Collaboration: Skilled in translating complex technical concepts into clear, actionable insights for diverse teams, ensuring alignment across product, UX, and engineering functions.
• Commitment to Clean, Reproducible Code: Dedication to coding best practices, writing maintainable, well-tested code, and building reproducible data pipelines that ensure robust, scalable analyses.
• Continuous Learning and Adaptability: A proactive approach to staying current with advancements in NLP and data science, with the ability to adapt methods and insights to evolving technologies and user needs.

What We Value

• Strong focus on infrastructure reliability and performance
• Commitment to automation and reproducible deployments
• Balance between innovation and stability
• Clear, proactive communication and documentation
• Collaborative approach to problem-solving
• User-centric infrastructure design
• Continuous learning and knowledge sharing
• Data-driven decision making
• Pragmatic approach to technical solutions
• Strong sense of ownership and responsibility

Why You'll Like Working Here:

• Unique opportunity to translate strong open-source adoption and user enthusiasm into commercial product growth
• Dynamic company that rewards high-performers
• On the cutting edge of enterprise application of data science, machine learning, and AI
• Collaborative team environment that values multiple perspectives and clear thinking
• Employees-first culture
• Flexible working hours
• Medical*, Dental*, Vision*, HSA*, Life* and 401K*
• Paid parental leave - both parents
• Monthly productivity stipend 
• Open vacation policy* 
• Quarterly Snake days (company-wide bonus day off)
• 100% remote

*FTE employees based on your region

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

Anaconda, Inc. (“We”, “Us”) are committed to protecting and respecting your privacy. This Privacy Notice sets out the basis on which the personal data collected from you, or that you provide to Us, will be processed by Us in connection with Our recruitment processes. By clicking “Submit Application”, you acknowledge you have read our Privacy Policy and that Anaconda can retain your application data for up to 1-year, unless otherwise stated.  For the purpose of the General Data Protection Regulation (“GDPR”) ”) and the version of the GDPR retained in UK law (the “UK GDPR”) the Data Controller is Sydney Artt.

This job post expires 30 days from its original post date

Anaconda is an EEO/AA employer M/F/V/D.