Skip to content
Offshore1st

Apache Kafka & Streaming Engineer job description

Ready-to-use Apache Kafka & Streaming Engineer job description. Covers data modeling, query optimization, and pipeline design — copy it or let us match you with pre-vetted Apache Kafka & Streaming specialists.

Apache Kafka & Streaming Engineer

1. About the role

We are looking for an Apache Kafka & Streaming Developer to design, optimize, and maintain data systems built on Kafka Streams, ksqlDB, Kafka Connect. This role combines technical depth in Apache Kafka & Streaming with the ability to understand business context — you'll work with analysts, engineers, and stakeholders to ensure data is reliable, accessible, and useful. The ideal candidate has hands-on experience with Debezium and Apache Flink, can diagnose complex query performance issues, and understands both OLTP and OLAP patterns. You'll own data pipeline reliability, query performance, and schema evolution for systems handling millions of records.

2. Key responsibilities

  • Own Kafka Streams implementation and optimization — configuration, customization, and ongoing enhancement based on business needs
  • Manage ksqlDB workflows including setup, user training, and continuous improvement of processes
  • Implement and maintain Kafka Connect ensuring seamless integration with existing systems and workflows
  • Design and maintain Apache Kafka & Streaming schemas optimized for both operational and analytical workloads
  • Write and optimize complex queries, stored procedures, and data transformation pipelines
  • Monitor Apache Kafka & Streaming performance — query execution plans, resource utilization, and capacity planning
  • Build automated ETL/ELT pipelines for data integration from multiple source systems
  • Create dashboards and reporting solutions that enable data-driven decision making
  • Implement data quality checks, validation rules, and monitoring for data pipeline reliability
  • Plan and execute database migrations with zero-downtime cutover strategies

3. Must-have qualifications

  • Hands-on experience with Kafka Streams — configuration, customization, and troubleshooting in production environments
  • Proficiency with Debezium as part of the Apache Kafka & Streaming development/operations workflow
  • 3+ years of hands-on Apache Kafka & Streaming experience in production environments
  • Strong SQL skills — complex queries, window functions, CTEs, and query optimization
  • Experience with data modeling — star schemas, normalization, and denormalization trade-offs
  • Understanding of ETL/ELT pipeline design and data quality management
  • Ability to communicate data insights to both technical and non-technical stakeholders

4. Nice-to-have skills

  • Confluent Certified Developer for Apache Kafka certification or equivalent validated credential
  • Confluent Certified Administrator certification or equivalent validated credential
  • Experience with advanced Apache Kafka & Streaming features: ksqlDB, Kafka Connect, Schema Registry
  • Familiarity with the broader Apache Kafka & Streaming ecosystem including Apache Flink and Prometheus
  • Experience with real-time streaming systems (Kafka, Kinesis, or Flink)
  • Knowledge of data governance frameworks and data catalog tools

5. Interview tips

Technical Coding Exercise

Give a small, realistic Apache Kafka & Streaming coding challenge that tests fundamentals — clean code, edge case handling, and test writing. Time-box to 45-60 minutes.

Architecture Whiteboard

Present a system design problem relevant to Apache Kafka & Streaming. Evaluate their approach to scalability, data modeling, and trade-off discussions.

Code Review Simulation

Show an Apache Kafka & Streaming pull request with both good patterns and subtle issues. Assess what they catch, how they communicate feedback, and what they prioritize.

Past Project Deep-Dive

Have them walk through their most challenging Apache Kafka & Streaming project. Ask probing questions about architecture decisions, obstacles, and what they learned.

6. Typical team structure

Team size
2-5 Apache Kafka & Streaming developers
Reports to
Engineering Manager, Tech Lead, or CTO
Collaborates with
Product Management, QA/Testing, DevOps, Design

Related job description templates

All job description templates

Skip the JD. Get matched instead.

Pre-vetted Apache Kafka & Streaming profiles with video intros in 24 to 48 hours.

You'll get 3 to 5 profiles within 48 hours. Nothing is signed until you've interviewed.