As Europe moves towards a decentralised, cleaner energy network, the energy sector is experiencing an unprecedented influx of digital data. Millions of smart meters, smart sensors, solar installations and local microgrids continuously transmit operational readings. While this information is essential for balancing energy supply and demand, a significant hurdle remains: the data is highly fragmented, stored in incompatible formats and isolated within different organisations, making it incredibly difficult to utilise efficiently.
A Unified Framework for Energy Data
To address this challenge, a research team led by José L. Hernández from the CARTIF Technology Centre developed a standardised infrastructure framework. Presented at the ICEIS 2026 conference, their published paper introduces a modular “Data Lake” architecture tailored specifically for the European EnergyGuard project. This system acts as a robust central backbone, capable of organising and storing massive volumes of data collected from various testing facilities across the continent.
Solving the Digital Language Barrier
The primary innovation presented in the paper lies in the way the architecture manages data originating from highly heterogeneous sources. For example, a sensor in a Spanish solar farm may generate data differently from a smart meter in a Latvian building, creating potential interoperability challenges and risks of semantic misinterpretation.
The EnergyGuard framework addresses this challenge by combining a high-performance time-series database for real-time measurements with a semantic knowledge layer. Through the automatic linking of incoming data streams to ontology-defined descriptions of assets, sensors, and their relationships, the system preserves the meaning, context, and provenance of the information. As a result, data can be consistently interpreted and reused across different facilities, technologies, and geographical locations, regardless of its origin.
Prioritising Security and Real-World Testing
Because energy data often contains sensitive operational information or private household consumption patterns, the framework incorporates strict compliance protections from the ground up. The architecture features dedicated security layers that automatically handle data anonymisation and enforce strict access controls. Furthermore, by utilising high-performance supercomputing, this infrastructure creates a secure, simulated digital environment. This allows researchers and small businesses to safely evaluate new energy software against realistic grid conditions before launching them on the live power network.
For a closer look at the foundational digital systems that will support tomorrow’s utilities, the full published paper provides an accessible and thorough breakdown of this architecture.