How big is big data?
Wikipedia defines big data as collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. Big data is measured in terabytes, petabytes and describes the volume, variety and velocity (how fast data is being produced). Every day, globally we create 2.5 quintillion bytes of data —and 90% of the data in the world today has been created in the last two years alone. We are at the beginning of the big data revolution.
So how does big data impact energy and sustainability?
Data is collected across the energy industry; meters, sensors, on premise control and building automation software, weather, energy and resource information, energy consumption and production data are commonly captured. Data can be by collected by the second, minute, hour, month- or any variation in between. All of this data combined creates a requirement for a scalable solution that can mine all that data to create meaningful insights.
Big data does not need to be scary. Humans need software to manage this massive amount of energy and sustainability data and make intelligent recommendations for what humans need to do next. Properly harnessed, big data has enormous potential for improving operations, increasing efficiency and reducing our energy and resource consumption.
Some examples of big energy data in action
On the supply side, grid operators can aggregate data from grid sensors and utility databases and use the data to monitor the grid and combat blackouts in real time. On the demand side, commercial and industrial customers can aggregate energy and resource consumption, weather, production and other business data. Data can be mined to perform diagnostics, make intelligent recommendations and detect anomalies and inefficiencies to reduce or optimize energy consumption.
Seeing how far we have come in this field in the last few years, I can’t wait to see what’s next.