- Kafka-to-Kafka application
- Unit and Integration tests are prepared and ready to implement.
- Gradle as build tool
- Docker file available
- Basic CI/CD Pipeline
- Develop a DLQ (Dead Letter Queue) with S3 acting as remote storage
- Depending on time constraints, conduct Unit and/or only Integration testing for the solution
- Use Terraform to provision an S3 bucket. The code does not need to be perfect but should fulfill the primary requirements
- Create a Helm chart where we can read environments variables from a configmap and/or credentials from a mounted secret
- Define a flexible detection configuration contract
- Load your configuration and consume events matching your detection patterns
- Enhance the code to handle multiple events and transmit a single event once:
- merge identical record keys
- the pattern has been recognized five times in the record value for the same user
- Header-based filtering (pick one):
- consumer skips event when state evolved in header
X-Event-Statefrom valueDETECTION_REQUIREDtoIGNORED - producer emits when consumed record header doesn't have
X-Company-Test: true
- consumer skips event when state evolved in header