Senior Software Engineer - Data Processing & Workflow Foundations

The Data Processing and Workflow Foundations (DPWF) team is looking to hire a Senior Software Engineer that thrives at the intersection of infrastructure and software development. This team’s challenges break into 2 domains, which we consider engineering kafka as a platform and promoting event driven architectures.

Engineering kafka as a platform: Higher-level orchestration of Kafka to support our multi-cloud, multi-region, deployments. A subset of current focuses include:

• Software automation that creates, manages, and destroys kafka clusters in our environments.

• APIs and controllers that support operation of kafka clusters at scale atop kubernetes

• Automation of replication and other cluster management concerns.

Promoting event driven architectures: Reddit is increasingly adopting geographically distributed, eventually consistent architectures. As part of this shift, many systems are shifting to event driven architectures, and the DPWF team is working to make this adoption simpler and faster. Current projects are:

• Reddit specific clients and templates with helper functions and features suited to our use of Kafka

• Schema Registries and enforcement

• Capacity management and ACLs through client enforced authentication

• GitOps developer experience for Kafka interaction

As a member of the Data Processing and Workflow Foundations team, your work will span these 2 domains, which are rich with challenging infrastructure and software engineering problems. Your work will directly impact hundreds of millions of users around the world. Join us and help build the future of Reddit!

In your day-to-day, you can expect to:

• Work collaboratively with a team of software engineers to create and maintain the foundational platform for running Reddit’s infrastructure.

• Deliver software to improve the availability, scalability, latency, and efficiency of Kafka and other messaging components.

• Contribute feedback to the technical and strategic direction of eventing at Reddit.

• Automate critical aspects of the event driven development process

• Share on-call responsibilities. 

You have:

• 4+ years of experience developing internet-scale software, preferably in the context of infrastructure.

• Familiarity with asynchronous communication, bonus if familiar with Kafka specifically

• Experience developing on top of Kubernetes or similar distributed systems.

  • Kubernetes controller or operator development experience is a huge plus.

• Strong troubleshooting capabilities surrounding both systems and software.

• Experience engineering large systems, tracking work, and being a self-starter on projects.

• Excellent communication skills to collaborate with a service-oriented team and company.

Benefits:

• Comprehensive Healthcare Benefits

• 401k Matching

• Workspace benefits for your home office

• Personal & Professional development funds

• Family Planning Support

• Flexible Vacation (please use them!) & Reddit Global Wellness Days

• 4+ months paid Parental Leave

• Paid Volunteer time off

#LI-remote, #LI-JS5