Klaviyo
Boston
201-500 employees
Klaviyo offers a sms and email marketing automation platform for business of all sizes. Open source API, pre-built design templates, CRM and more.
Lead Data Engineer
Lead Data Engineer
This job is no longer open
As an engineer on the Events Team, that focuses on streaming and aggregation tech, you will be responsible for the design, implementation, and tuning of highly visible mission critical stream processing systems. Our stream processing stack includes Kafka, Flink, and Cassandra as well as tooling to support these systems.
We rely heavily on exactly-once processing semantics in order to provide data to our users that is unmatched in both latency and quality. Our flink clusters manage large amounts of state in order to keep latency low. You will be constantly challenged to improve these systems from every angle, such as monitoring, failure recovery, data quality, tooling, and much more.
We love tackling tough engineering problems and look for engineers who specialize in certain areas but are passionate about building, owning & scaling features end to end from scratch and breaking through any obstacle or technical challenge in their way. We push each other to move out of our comfort zone, learn new technologies and work hard to ensure each day is better than the last.
Lead Data Engineers are expected to bring to Klaviyo subject matter expertise and demonstrate adaptability by continuing to acquire and master new skills, level up all those around them, and research and prototype new technologies and solutions to help scale Klaviyo’s systems and product capabilities. Engineers come to Klaviyo with experience in a variety of languages and from a number of disciplines. All engineers are expected to become extremely proficient in the technologies we use (not exhaustive):
Python, Django, Java, Celery
MySQL, Cassandra, Kafka, Flink, RabbitMQ, Redis
HTML, JavaScript, LESS, React
Amazon Web Services (EC2, RDS, Aurora, etc.)
Terraform, Ansible, Packer, and other DevOps tools
How You'll Make a Difference
- Wholly owning features that 50,000+ customers rely on daily to reach 4B+ consumers to drive their business forward.
- Working on crafting our highly scalable real-time data pipeline that processes billions of events weekly across data sets growing to petabyte scale.
- Working on deep analytics system that provides insight into hundreds of terabytes of data.
- Be responsible for the mission, technical direction and operations of projects that have immediate impact.
- Helping architect and design robust and high performance data processing and storage systems leveraging new databases to serve different internal and external use cases. Contribute to open source data processing technologies.
- Contributing to the company as a subject matter expert in multiple areas, constantly pushing yourself to be a better engineer and to level up all of your peers within your team and within Klaviyo.
Who You Are
- Have 5-7+ years of experience building products that matter and pushing yourself and your team to be better engineers and build a product with passionate advocates
- Enjoy working with new technologies ranging from the frontend to backend, and are particularly passionate and an expert in multiple stack areas. You show this by having strong and opinionated experience with various technologies and know how to pick the right tool for any job
- Love digging into performance and scalability issues to drive breakthrough solutions-- whether it's a slow loading UI or too many clicks in a workflow, a database query timing out, or a queue that just won’t drain. You recognize all problems can be solved
- Enjoy shipping code early & often in an agile fashion, pairing with product management to craft better software by soliciting feedback from thousands of end users
- Like working on small, autonomous agile teams. At Klaviyo, you will have ownership of features, but you'll collaborate with everyone to make sure we produce the right solution
This job is no longer open