Tjeerd

As the logs flow from production to the back office, they pass through a Sensitive Data Scanner. This Scanner did require some maintenance, especially updating the Java and Kafka versions. The setup of the project and the lack of (unit) tests, made it also hard to maintain and making changes in the code. What did I do: Introducing the Maven Module structure Adding unit tests and mutation testing Refactoring the code, so it became better testable Solving issus in the code, so the vulnerability scans Knowledge transfers, with other developer Using git-repo with feature branches Setting up the build in Cloudbees-CI Environment (Jenkins) Set up creation of Docker image Deploying the Docker image and it’s configuration with Ansible Improving the Ansible deploymnt, so it’s more inline with other unix applications Adding the log4j configuration, as part of the deployment (and no longer only in the jar) Updating to Kafka version in production Replacing deprecated Kafka features (branch -> split) Updating to Java 17 Updating Maven dependencies and plug-ins Improving configuration Allow different formats (plain text, properties, json, csv) Allow comments in the configurations Adding some design patterns: Chain of Responsibility, Visitor, Fluent Interface Removing duplicated code Improving the creation of Kafka Topologies Adding Feature Toggles for: switching between implementations of topology models sending output as avro record sending output as json Updating the logging, to use latest feathers of log4j2 Logging as json, instead of flat message Using new features of the Java language and libraries Improving the cli by adding Picocli Adding version info, git hash as code in the build, so it can be used for logging during startup Adding version info, of libraries used Adding documentation Technology Stack Scrum / Agile, Java 17, Maven 3.8, (Gradle 8), Kafka 3.3, JUnit 4/5, Mockito, jsonassert, Cloudbees-CI, Nexus, Jenkins, SonarQube, NexusIQ, Synopsys Converity, Git, BitBucket, Confluence, Jira, Crucible, MatterMost, Teams, Docker, Ansible Tower, RedHat, Universal Base Image, VmWare