Skip to content
Newsroom

Crate.io and Gantner: intelligent power grid management combines with an innovative database solution

With the help of Gantner Instruments, the University of Cyprus operates a Smart Micro Grid to research the controllability of renewable energy sources in the power grid and to advance the energy transition. To do so, Gantner relies on innovative solutions from Crate.io

Intelligent power grid management using a regenerative smart grid

With the increase in renewable energy sources, the challenge for grid operators to keep the grid frequency stable is becoming ever greater. In the Western European interconnected grid, for example, the grid frequency may only deviate from 50 Hertz by about 0.05 Hertz, so that there are no disturbances or nationwide failures (blackout).

With the help of Gantner Instruments, the University of Cyprus (UCY) is working on a research project that has set itself the goal of optimally and intelligently managing electricity consumption and power generation, especially within local grids with a high proportion of renewable energies.

Constant data collection is essential. Modern control technology makes it possible to execute controls faster and faster, whereby the use of smart grids can be further and further optimized. The ultimate goal is the perfect real-time control of a regenerative smart grid.

Gantner and Crate.io partner to deliver a best in-class measurement and analytics solutions

Gantner Instruments specializes in decentralized measurement and I/O systems as well as the measurement of mechanical, thermal and electrical quantities and is the project leader of the research project.

Gantner relied on the expertise of Crate.io to analyze the amount of data generated by the project in real time and to improve the processes through machine learning (ML). Crate.io is the developer of CrateDB, a world-leading multi-modal database that makes data analysis at scale incredibly easy.

Analytics Map

Fast data evaluation keeps the grid frequency in balance

UCY's smart grid project aims to demonstrate the use of renewable energies as a controllable solution in a power grid. Data should be recorded quickly and synchronously so that the network can be optimally controlled.

In UCY's Micro Grid, sensors permanently record the data on the generation and use of electricity. This results in immense amounts of so-called "hot & warm data" – i.e. data that must be accessed frequently and quickly.

For communication between the sensors and data acquisition, the researchers rely on the proven Modbus protocol, among other things. Machine learning is done in the object-oriented programming language Python. A prototype for the control of a small-scale intelligent power grid was first tested with fictitious data in a kind of "virtual twin" of the Campus Grid. For one and a half years now, UCY's specially built Campus Micro Grid has been in operation with real data.

SCADA overview window

CrateDB Cloud delivers access to critical data in microseconds

In order to intelligently control the batteries for energy storage and the grid services in UCY's Campus Grid, a huge amount of data has to be collected and evaluated quickly. Frequent and immediate access to this hot data is essential for real-time processes.

The management of the Smart Micro Grid is optimized by means of artificial intelligence (AI) in order to always achieve ideal values. To do this, the system had to be trained beforehand. Part of this machine learning process is also that the data is written back to the backend, for which CrateDB was the best choice. Originally, Gantner had relied on the open source software Apache Kafka, designed for streaming analytics. In the course of the project, however, it turned out that the data at Kafka is not available with the necessary retrieval times in the millisecond range.

"Unlike Kafka, with Crate.io's cloud and edge technologies, the data is hot at all times and can therefore be captured and processed quickly. With the help of CrateDB , we can make large amounts of data available in microseconds at the frontend. " Jürgen Sutterlütti, Vice President, Energy Segment and Marketing at Gantner Instruments.

The collection and processing of data from distributed measuring instruments is combined with edge devices for monitoring and control, connected to a cloud backend in the background. The process mixes real-time data with "older" large amounts of data. The measurement data is first calculated at the edge and then sent to the cloud for further processing.

Best possible control optimization for a reliable Smart Micro Grid solution

By using CrateDB as an index, Gantner and UCY's groundbreaking research project can ensure instant time series analysis with unlimited scalability.

The long-term vision of the research project is developing a complete solution for modern energy projects, the operation of photovoltaic systems and the monitoring of the infrastructure. All data will be viewed on a central console for real-time data virtualization or integrated into existing systems via API.

Thanks to dedicated and specialized project partners such as Gantner and Crate.io, the path from the stand-alone solution to the production-ready technology package for worldwide practical use has been paved.