How a large bank unified 8–10 TB of daily logs into one auditable data fabric for a 5–15 year retention obligation

Application, infrastructure and security logs from one platform, with role-based access and a bank-wide scale-out roadmap.

8–10 TBlog volume per day
5–15 yearsregulatory retention served
4log families unified

The challenge

A large universal bank had no centralised platform for the application, infrastructure and security logs generated across the organization. Fragmented, per-system log storage prevented cross-functional analytics, operational intelligence and predictive models for reducing unplanned outages, and could not serve the banking sector's 5–15 year log retention obligation in an auditable way. Daily log volume reached 8–10 TB.

At a glance

StackHPE Ezmeral Data Fabric, Kafka, Cloudera, OpenShift, Grafana

Duration1 year

AccessRole-based, 3 roles

What we did

SWICON delivered a proof of concept on HPE Ezmeral Data Fabric: real-time multi-source ingestion of application, application-security, infrastructure and infrastructure-security logs from OpenShift via Kafka, a multi-layer data model (raw and normalised) covering up to eight log types, bidirectional integration with the bank's existing Cloudera environment, Grafana reports and dashboards, and simplified role-based access control.

The result

The bank received a working unified log platform handling 8–10 TB per day, fast auditability and controlled internal data distribution, plus a bank-wide scale-out roadmap with phasing, timeline and cost estimate.

Facing something similar? Let’s talk.

Contact us