Kafka Integration Engineer

Key Responsibilities

• Design, build, and maintain Kafka consumers to ingest and batch-process customer event data.
• Implement message parsing and transformation logic (JSON, Avro, Protobuf) to align with Captain Up’s event structure.
• Develop and configure provider-specific customer integrations.
• Manage secure credentials using AWS Secrets Manager and handle per-application configurations.
• Deploy and monitor services in Kubernetes using Helm.
• Work with DevOps to troubleshoot deployments, monitor performance, and ensure system reliability.

Requirements

• Proficient in Node.js and TypeScript.
• Strong experience with Apache Kafka and libraries like KafkaJS or similar.
• Familiarity with message schemas (Avro, Protobuf) and relevant parsing libraries.
• Hands-on experience with Kubernetes, Helm, and AWS services, especially Secrets Manager.Ability to write robust, testable, and maintainable code for high-throughput and low-latency data pipelines.
• Excellent debugging, problem-solving, and communication skills.