bigspark & NatWest
Unlocking Enterprise Data with a Cloud-Native API Layer
bigspark and NatWest are partnering to deliver a cloud-native Data Service API that provides seamless, governed access to enterprise data lakes - making batch and real-time data instantly available to consumer applications.
Overview
bigspark and NatWest are partnering to deliver a cloud-native Data Service API that provides seamless, governed access to enterprise data lakes - making batch and real-time data instantly available to consumer applications.
Introduction - Data Service API (DS-API)
Data Service API (DS-API) provides an interface for programmatic access to a cloud-native enterprise data lake via AWS Athena. This makes it easy for consumer applications to access batch and real-time data directly into their various user interfaces.
- Cloud-Native - Built on AWS Athena
- Real-Time + Batch - Unified data access
The Challenge - Business Problem
As data products increasingly migrate to the cloud, easy integration, unified governance, and quick access become critical areas of concern for enterprise teams.
Integration Complexity
Consumer applications struggle to connect to cloud-hosted datasets without standardized, well-documented interfaces.
Governance Gaps
Without a centralized access layer, enforcing consistent data governance policies across multiple consumers becomes fragmented and error-prone.
Access Latency
Teams need fast, reliable access to both batch and real-time data - without building bespoke pipelines for every use case.
The Opportunity - An API-First Approach
DS-API addresses these challenges by placing a purpose-built API layer between datasets and consumers, delivering three key benefits:
1. Easy Integration
A standardized, programmatic interface lets consumer applications connect to the data lake without custom integrations, reducing development time and complexity.
2. Unified Governance
A single API layer provides a centralized point for access control, auditing, and policy enforcement across all data consumers.
3. Quick Access
Powered by AWS Athena, DS-API enables fast, on-demand queries against both batch and real-time datasets, delivering data directly into application UIs.
Built on AWS
- bigspark - Cloud & Data Engineering
- NatWest - Enterprise Banking
- AWS Athena - Serverless Query Engine
Combining bigspark’s data engineering expertise with NatWest’s enterprise requirements, powered by AWS Athena to deliver scalable, governed data access.
Awards and Honours