Cloudbased software platform for big data analytics in. This lifecycle forms an observe, orient, decide, and act ooda loop. The platform offers an adaptive information integration pipeline for ingesting dynamic data. Big data analytics in the smart grid below please find a white paper currently open for public comment. Big data refers to data that would typically be too expensive to store, manage, and analyze using traditional relational andor monolithic database systems. Nielson and acxiom are other leaders in the cloudcomputing and big data analytics space. Big data analytics in mdm and smart grid energy central. Analytics turn their data into knowledge that helps optimizing grid efficiency and. Cloudbased big data analytics technology finds a place in future networks owing to the innumerable traditionally unmanageable abilities and services.
Ieee international conference on computational intelligence and computing research, 20, pp. This enables the business to take advantage of the digital universe. Recommended standards, existing frameworks and future needs 14 4. Big data analytics with energyip analytics suite energy. These analytics helps the organisations to gain insight, by turning data. Cloud technologies used in a scalable software platform for the smart grid cyber physical system. The main idea of our framework is to build a hierarchical structure of cloud computing centers to provide different types of computing services for information management and big data analysis. Big data analytics for dynamic energy management in smart. A cloudbased architecture for bigdata analytics in smart grid. Heres an interesting nosql conference coming up in san jose at the end of august related to the big data. Readable and accessible, big data analytics strategies for the smart grid addresses the needs of applying big data technologies and approaches, including big data cybersecurity, to the critical infrastructure that makes up the electrical utility grid.
It also brings a lot of opportunities and challenges to the data analysis platform. Hadoop yarn is the computation core for big data analysis. Cloudbased software platform for big data analytics in smart grids. Smart grid analytics enable utilities to more rapidly and effectively address issues regarding improved grid operations, customer engagement, and financial management. R is a challengeapplication to perform intelligent demandside management and relieve peak load in smart power grids. This article focuses on a scalable software platform for the smart grid cyberphysical system using cloud technologies. The grid software team at ge digital is building the analytics and software necessary to handle the growing volume of variable renewable generation. Figure 2 from cloudbased software platform for big data analytics. Gain realtime insights that improve your decisionmaking and accelerate innovation.
Hence, elastic resource reconfiguration is a critical issue for smart grid big data application, since the widespread of data sources make the workload changing. In this paper, we have summarized the stateoftheart in the exploitation of big data tools for dynamic energy management in smart grid platforms. Cloudbased software platform for big data analytics in smart grids abstract. An integrated perspective of managing and analysing such big data can answer a number of science, policy, planning, governance and business questions and support decision making in enabling a smarter environment. Big data analytics strategies for the smart grid crc. Saas bi also known as ondemand bi or cloud bi involves delivery of business intelligence applications to end users from a hosted location. Using big data, iot and grid analytics to optimize. Dec 29, 2015 smart grid is one of the most important area for big data applications, while the cloud based platform is believed to be the deserved paradigm to conduct smart grid big data processing.
Big data analytics in the smart grid ieee smart grid. In addition, big data analytics can help power providers evaluate the areas within their smart grid networks that can be refined or improved and help assess the business benefits being achieved as a result of smart grid investments. Oct 18, 2017 the internet of things iot is offering unprecedented observational data that are used for managing smart city utilities. A large amount of landuse, environment, socioeconomic, energy and transport data is generated in cities.
Analytics to manage big data from smart grids the tibco blog. Cloudbased software platform for big data analytics in smart grids article pdf available in computing in science and engineering 154. Smart grid data analytics market, size, share, trend and. In order to meet increasing power demand and to intelligently incorporate new equipment, while also preventing blackouts and power losses, the power grid must evolve. Best practices in big data analytics for the smart grid 12 3. The real value is in leveraging the data for business intelligence and analytics. An implementation with relevant source code on a secured cloud platform is presented in section 4.
Sensus, based in raleigh, north carolina, announced this week it would acquire startup verdeeco, a smart grid analytics vendor. To that extent the hadoop framework, an open source implementation of the mapreduce computing model, is gaining momentum for big data analytics in smart grid. Autogrids core technology is its energy data platform, the cloudbased unstructured data analytics and management engine that takes in data from a multitude of sources and applies. If you are ambitious and change makes you thrive, drive our siemens healthineers digital transformation as product manager. Sysmech which specialises in big data, iot, realtime analytics and infrastructure monitoring is to provide its open and technologyagnostic digital platform for the living lab 2. Insight, a cloud based big data analytics architecture which utilizes.
According to 4, there are two types of data generated in smart grids event data and usage data. In order to provide a public comment, please sign in, click on the. The characterizations of big data, smart grids as well as huge amount of data. Ten drivers which will move utilites to big data and analytics. Sabitha, a cloud based architecture for big data analytics in smart grid. This article focuses on a scalable software platform for the smart grid cyber physical system using cloud technologies. Big data challenge that requires advanced informatics. Towards cloud based big data analytics for smart future. Analytics turn their data into knowledge that helps optimizing grid efficiency and supply security scroll down to discover how. Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering, vol 256. Bigdata platforms and bigdata analytics software focuses on providing efficient analytics for extremely large datasets. Furthermore, the big data framework for smart grids including the lifecycle of smart grid data from data generation to data analytics is introduced. Autogrid, universal bigdataplusapps platform for the smart grid 6 the smart grid presents an interesting problem for the world of big data, and particularly the field of unstructured data. Big data analytics platforms for realtime applications in.
Contextaware qos assurance for smart grid big data. Harness the power of cloud based big data analytics with source soft solutions. With our cloud based aaas, you can address user needs across various analytics requirements. A secure cloud computing based framework for big data. The hdfs and yarn run on the same set of nodes, which allows tasks to be processed on the nodes in which smart grid data are already present. We have first highlighted that, in order to deal with the extreme size of data, the smart grid requires the adoption of advanced data analytics, big data management, and powerful monitoring techniques. With the advent of the digital age, the amount of data being generated, stored and shared has been on the rise. The atlantabased companys flagship product is a grid analytics engine dubbed griddna. In this context, big data analytics combined with grid visualization can lead to better predictive decisions and situational awareness. A survey on realtime analytics framework for smart grid. Right from data delivery, management and usage, we help our clients develop a comprehensive cloud based big data strategy, define aaas framework and optimize the value for their enterprise data. Fortunately, opensource apache hadoop distributions that include the mapreduce. Data analytics current and future deployment of smart grid devices is producing mountains of data, enabling benefits through analytics.
This article focuses on cloud technologies used in a scalable software platform for the smart grid cyberphysical system. Big data framework for analytics in smart grids sciencedirect. Harness the power of cloudbased big data analytics with source soft solutions. Google clouds fully managed serverless analytics platform empowers your business while eliminating constraints of scale, performance, and cost. Simmhan and saima aman and alok gautam kumbhare and rongyang liu and sam stevens and qunzhi zhou and viktor k.
Using smart grid to improve operations and reliability. Big data analytics for dynamic energy management in smart grids. Technological changes are being implemented throughout the entirety of the power grid that facilitates the evolution of a. Smart grid analytics is the application of advanced analytics methodologies to the data including predictive and prescriptive analytics, forecasting and optimization. For this utilities will have to use big data analytics. Recently, edgecomputing is emerging as firstclass paradigm to complement cloud centric analytics. From data warehouses, social media, webpages and blogs to audiovideo streams, all of these are sources of massive amounts of data. Cloudbased software platform for big data analytics in smart grids, comput. Our advanced big data analytics solutions and consultation services help companies solve complex business problems, increase efficiency and create new revenue streams. Evaluation of big data frameworks for analysis of smart grids. Dec 12, 20 this article focuses on a scalable software platform for the smart grid cyberphysical system using cloud technologies.
In a datarich smart grid, these decisions are guided by data analytics and mining that must scale with the number of buildings and customers, and the temporal granularity of decision making. A big data framework that can be a start for innovative research in smart grids and implementation of the framework on a secure cloudbased platform is presented in. Smart grid is defined as an intelligent network based on new technologies, sensors and equipments to manage wide energy resources and to enhance the reliability, efficiency and security of the entire energy value chain. Dynamic demand response is a challengeapplication to perform intelligent demandside management and relieve peak load in smart power grids. The rapid deployment of phasor measurement units pmus in power systems globally is leading to big data challenges. Turning huge volume of data that the smart meters and sensors captures into information and acting upon it in realtime will deliver the real benefits that smart grid and mdm promises. Cloudbased software platform for big data analytics in smart. Edge and fog gateway devices are an integral part of iot deployments to acquire realtime data and enact controls. Oct, 2016 simmhan y, aman s, kumbhare a, rongyang l, stevens s, qunzhi z, prasanna v 20 cloudbased software platform for big data analytics in smart grids. In this paper, we propose a secure cloud computing based framework for big data information management in smart grids, which we call smart frame. Sep 27, 2019 big data refers to data that would typically be too expensive to store, manage, and analyze using traditional relational andor monolithic database systems.
New high performance computing techniques are now required to process an ever increasing volume of data from pmus. Pdf this article focuses on a scalable software platform for the smart grid cyber physical system using cloud technologies. The opportunities for smart grid analytics are expanding because theres exponentially more data. Storing and processing the huge amount of data generated by the smart meters, requires improved platforms, appropriate for big data analytics, such as hadoop, cassandra, and hive. Dynamic demand response d 2 r is a challengeapplication to perform intelligent demandside management and relieve peak load in smart power grids. Hadoop is a promising platform for the distributed processing of large sgs data sets. Usually, such systems are costinefficient because of their inflexibility for storing unstructured data such as images, text, and video, accommodating highvelocity realtime. The accenture report offers 10 leading practices for applying smart grid analytics. Pdf cloudbased software platform for big data analytics. Autogrid, universal bigdataplusapps platform for the. Autogrid, universal bigdataplusapps platform for the smart.
Optimizing hadoop performance for big data analytics in. This paper presents a theoretical and experimental perspective on the smart. The cloudbased platform blends artificial intelligence and machine learning algorithms to improve grid. Top 53 bigdata platforms and bigdata analytics software in. From open enterpriseready software platforms to analytics building blocks, runtime optimizations, tools, benchmarks and use cases, intel software makes big data and analytics. Cloudbased software platform for big data analytics in smart grids yogesh simmhan, saima aman, alok kumbhare, rongyang liu, sam stevens, qunzhi zhou and viktor prasanna, university of southern. Uk smart home energy platform living lab moves forward with. These analytics helps the organisations to gain insight, by turning data into high quality information, providing deeper insights about the business situation. Examples of cloud analytics products and services include hosted data warehouses, software asaservice business intelligence and cloud based social media analytics. Usually, such systems are costinefficient because of their inflexibility for storing unstructured data such as images, text, and video, accommodating highvelocity realtime data. The top trends in smart grid analytics greentech media. In this paper, we propose a secure cloud computing based framework for big data information management in smart grids, which we call smartframe. This smart grid offers deep monitoring and controls, but needs advanced analytics over millions of data streams for efficient and reliable operational decisions.
1215 369 794 696 1130 694 1327 223 13 1465 517 270 561 99 84 790 892 510 889 416 625 1514 366 440 1342 900 432 1244 1418 1268 3 645 1143 195 1441 1072 151 960 488 1331 354 1252 739 365 911 210 757