Business data platform
Java services, data integration and DevOps supporting a shared sales and marketing data foundation.
The system at a glance.
A conceptual view of the flow and its boundaries.
The challenge.
Sales and marketing teams needed a coherent data foundation spanning external providers, internal sources and analytics services.
My contribution.
Worked as a software engineer and DevOps lead across Java services, data integration, cloud migration and operational support.
Implementation.
- Coordinated vendor data-transfer transitions into company-managed SFTP and AWS S3 storage.
- Developed REST service integrations and Python/Pentaho batch transformations.
- Supported cloud infrastructure, release automation, SQL tuning and production troubleshooting.
Design decisions.
API delivery and batch ingestion have different execution and support needs.
Infrastructure automation and application observability need to evolve together during cloud migration.
Validation.
Unit and system testing, release validation and operational monitoring supported application delivery.
The outcome.
Supported a centralized business-data foundation and its application, ingestion and release workflows.
Explore the pattern.
The companion repository is an independent educational demonstration built with synthetic examples. It illustrates related engineering patterns and does not contain employer source code or production data. Repositories are currently private; please contact me for access.
Open private GitHub demo