AUSTIN, Texas – eSmart Systems, Xcel Energy, and EDM International announce the completion of the first phase of a strategic initiative to enhance the aerial inspection of Xcel’s transmission system. The foundation of this solution is Collaborative Intelligence, which combines human intelligence with Grid Vision™, an AI-based analytics solution from eSmart. The first phase, launched in December 2019, was successful in deploying Collaborative Intelligence to inspect and document 2,897 miles of Xcel Energy’s transmission assets and finished ahead of schedule in March. The multi-year initiative will be expanded into Phase Two to continue to update asset records, reduce operational costs, decrease failure rates, and extend asset life
Xcel Energy’s work on unmanned aircraft systems with our partners demonstrates that collaboration benefits customers, the economy, and the environment,” said Michael Lamb, senior vice president, transmission- Xcel Energy. “Our company is an industry leader in using UAS technologies for transmission line inspections and our work with eSmart Systems and EDM will help improve the safety and reliability of the energy grid.
Phase Two launched in May 2020.
Phase Two builds on the success of Phase One, with an additional 5,000 miles of Xcel Energy’s transmission system to be inspected by the end of 2020. As in Phase One, transmission asset imagery will be collected by Xcel Energy’s Unmanned Aircraft Systems (UAS) and manned helicopters. Phase Two will further improve the inspection processes by enhancing the Collaborative Intelligence approach with a deeper integration of eSmart’s Grid Vision™, an AI-based analytics system, into their existing business processes. eSmart and EDM are leveraging the Phase One image data to improve the efficacy of Grid Vision™ by eSmart, making the asset component identification and defect detection more efficient and effective.
eSmart Systems is pleased to partner with EDM to bring its Collaborative Intelligence approach to help Xcel Energy use aerial image data. We see this project as helping utilities to practically bridge the gap in the transition from today’s largely manual processes to the world that leverages digital technology such as AI and UAS images for grid inspection and asset management
Phase One was a tremendous success for the partnership of Xcel Energy, EDM, and eSmart. We are now in the process of applying those results to enhance our large-scale transmission inspection capabilities. The problems we’re solving for Xcel Energy, including a full inventory of grid assets and updating their inventory system, as well as accelerating the identification of defects, will help utilities more efficiently and safely operate their critical infrastructure
Collaborative Intelligence
The Collaborative Intelligence approach combines human intelligence from EDM’s T&D Subject Matter Experts with Grid Vision™, an AI-based analytics system by eSmart. Together they analyze aerial images captured by Unmanned Aircraft Systems and manned helicopters. This project is seen as a key linchpin transitioning from today’s manual grid inspection practices to a process that uses the optimal combination of humans, AI, and aerial images. These synergies result in more efficiently inspected grid systems, reduced failure rates, and extended asset life.
About the Companies
eSmart Systems
eSmart Systems is a developer of disruptive intelligent analytics targeting utility and energy markets. eSmart Systems, headquartered in Norway, has 80 employees including sales representatives in Denmark, UK, and in the US. The company was established in 2013, has commercial revenues from large and established utilities and transmission & distribution grid operators. Key owners are Kongsberg Digital, Energy Impact Partners, Equinor Energy Ventures, Nysnø Climate Investments, Innogy Ventures, and several Norwegian utilities.
For more information, visit esmartsystems.com.
Xcel Energy
Xcel Energy (NASDAQ: XEL) provides the energy that powers millions of homes and businesses across eight Western and Midwestern states. Headquartered in Minneapolis, the company is an industry leader in responsibly reducing carbon emissions and producing and delivering clean energy solutions from a variety of renewable sources at competitive prices. For more information, visit xcelenergy.com or follow us on Twitter and Facebook.
EDM International
EDM is an employee-owned alliance of engineers, scientists, technologists, and businesspeople providing innovative services and products to the utility industry since 1982. The company has become a leader in utility engineering, operations, and asset management by merging excellence in technical disciplines with a genuine concern for client needs. EDM is headquartered in Fort Collins, Colorado, and has offices in San Diego, California, and Billings, Montana, and staff in other locations in North America.
Contact
Knut Johansen, CEO, eSmart Systems, + 47 909 81 318
knut.johansen@esmartsystems.com
Steve Hambric, President North America, eSmart Systems, +1 (404) 432-6891
steve.hambric@esmartsystems.com
Maria Cervantes, Marketing & Communications, eSmart Systems, +1 (512) 999-6645 maria.cervantes@esmartsystems.com
7 leading Norwegian utilities entered a three-year R&D partnership with eSmart Systems to improve
current power grid operations and maintenance.
eSmart Systems has since 2013 been developing Connected Grid with central Norwegian DSO’s through the R&D projects Braadland and Astrum. The success from the former projects has led to innovative solutions, new partners and the current R&D initiative Opal.
“We are pleased that some of Norway’s most progressive utilities have chosen eSmart Systems as a long-term partner through their commitment to the Opal-project. I am confident that our initiatives will have a major impact on the power grid industry,” says Knut H. H. Johansen, CEO of eSmart Systems.
Access to data
The project´s objective is to create an open AI-platform system that will, through a unique and secure method of processing data and training of AI-algorithms, increase each customer’s data’s value, in addition to accelerate the usage of applied AI for the utilities, regardless of their size.
“Together with the partners, we have identified a need for new systems that build upon the results of our previous R&D projects. One of the most important premises for utilizing the power of artificial intelligence is access to data. Asset Intelligence will be essential to the product moving forward,” explains Erik Åsberg, CTO at eSmart Systems.
Intelligent Asset Management will use data from all customers to calculate probabilities of errors down to the component level based on load, environment, and location. With applied AI the operation of power grids can be revolutionized. The project’s main goal is to make the AI technology more easily accessible and applicable to the utility companies.
“eSmart Systems has a unique expertise when it comes to AI and intelligent solutions. We are looking forward to continuing the collaboration with eSmart Systems and all the project partners. This investment will lead to increased opportunities and add great value to the data we collect in the future,” says Tore Morten Wetterhus, CEO in Glitre Energi Nett.
In addition to Glitre Energi and eSmart Systems, the Opal project includes Troms Kraft Nett, SFE Nett, Norgesnett, Hallingdal Kraftnett, Lyse Elnett, and Ringerikskraft Nett.
Read also:
eSmart Systems strengthens its ambitions for growth in North America. In July, the company opened the new US headquarters in Austin, Texas.
eSmart Systems US Inc, a subsidiary of eSmart Systems AS, has recently made the move from its previous office in Bellevue to the growing tech hub of Austin. Being in the center of the country also has logistical advantages for the successful delivery of eSmart’s programs across North America.
Building on its demonstrated success in Europe, eSmart Systems recently secured a USD 34 million investment for international expansion with a focus on North America. This investment has led to an increased focus on strengthening the company’s presence in the US.
We look forward to being Austin-based and to continue building our team of industry experts. The US is a key market for eSmart’s global ambitions, says Steve Hambric, President North America at eSmart Systems US, Inc.
The new office is located in North Austin, 11801 Domain Blvd 3rd Fl. To learn about opportunities to join our team please see careers page.
COVID-19 is having a dramatic impact on our lives, societies, and businesses. We want to share an update on what eSmart Systems is doing to keep our people, customers and partners safe while we continue to deliver our services around the world.
eSmart Systems is following the guidance of global health experts at the Norwegian Institute of Public Health (NIPH), World Health Organization (WHO), and U.S. Centers for Disease Control (CDC) on preventing the spread of the COVID-19 virus. All employees in eSmart Systems are now working from our home offices and we have stopped all public travelling. But we are privileged to be able to deliver uninterrupted services and operation over the Internet.
This requires new routines and business processes both internally and externally with customers and partners. We have activated our CIRT – Critical Incident Response Team and follows the principles and guidelines in our business continuity plans to ensure information security, business operation and communication in this extraordinary situation.
Information security – a top priority
When turning the whole operation into a fully distributed organization overnight, we must enforce new and improved security measures both for people and systems. Security of information is a top priority for eSmart Systems, and we were recently awarded ISO/IEC 27001 certification that proves the company’s ability to protect internal and external information to the highest standard.
Maintaining operation – our primary focus
As the company is serving customers and partners across the world, we are focusing on maintaining the highest level of service possible. Even if we are refrained from travelling and commuting the whole organization has shown tremendous skills and discipline in using collaboration tools like Microsoft Teams, Slack, Chat and Video Conference services to maintain our operations. Our Gold partnership with Microsoft supports us in providing premium, uninterrupted Microsoft Azure based services to customers and internal operation.
If there is anything we can do to support you or your organization in these challenging times do not hesitate to contact us either through your customer representative, via our Support line support@esmartsystems.com or directly on our cell phones.
As this situation is evolving rapidly, we will continue to communicate via social media and on our Web page how eSmart Systems is responding to COVID-19 development and implementation of new supporting procedures.
Stay safe, nut H. H. Johansen CEO
We are a part of the Satellite Imagery and Drone Use panel at the EEI Wildfire Technology Summit in Dallas on February 18.
Steve Hambric, President North America at eSmart Systems, will be part of the panel, together with representatives from Battelle Memorial Institute, ORNL, StormGeo and SharperShape.
During the panel discussion I will focus on collaborative AI, the efficiency and efficacy improvements of AI in the inspection process, and the use of synthetic data to create algorithms for less common defects
The session will cover an array of solutions and advancements regarding unmanned aircraft systems (UAS) and initiatives related to satellite/geospatial imagery that are now available and/or being applied by electric companies to meet the many challenges around the wildfire threat.
Moderator is Chris Eisenbrey from Edison Electric Institute (EEI).
Utility attendees include PG&E, Xcel, SCE, Oncor, PNM, OG&E among others.
Leverage New Technology
Some areas that will be explored are the application of artificial intelligence (AI) and machine learning; advances in data imagery analytics; federal government and national lab initiatives and activities. In addition to strategies and policies that should be considered that will allow the industry to more fully unleash and leverage the many tools and technologies in this space.
Learn more about EEI Wildfire Technology Summit.
Read also:
- “A great honor and a new milestone for us”
- New app effectively collects inspection data
- Microsoft and eSmart Systems – bringing innovative solutions to the energy and utility industries
eSmart Systems secures valuable information security certification after the company recently became ISO/IEC 27001:2013 certified.
ISO/IEC 27001 is the most widely recognized international standard for an Information Security Management System. An ISMS is a framework of policies and procedures that includes all legal, physical and technical controls involved for risk management processes in an organization.
Information security – a top priority
Security of information is a top priority for eSmart Systems and the newly awarded ISO/IEC 27001 certification proves the company’s ability to protect internal and external information to the highest standard. As the company continues to scale with customers and partners across the world, it is essential that information security is of the highest priority.
This is an outcome from thorough preparation and hard work from all of our employees and management. It is essential for a company like eSmart Systems to be ISO certified. This certification proves our commitment to securing our client’s Information assets and protect our business, including software and IP.
This demonstrates that our organization is taking the proper measures in risk assessment and reliability when it comes to information handling and security
The ISO/IEC 27001:2013 certificate
The certificate covers the following activities:
Software development based on cloud technology and artificial intelligence that provides insight into data and decision support primarily for the energy sector based on sensors and images, improved power grid operation and optimization of investments in the grid.
Additional information about the ISO standards can be found here: https://www.iso.org/
ISO/IEC 27001:2013 Certificate
The Electric Grid from Space to Sky — StormGeo Partners with eSmart Systems, HVL and European Space Agency
Originally posted on StormGeo.com
Oslo, Norway, December 12, 2019 — StormGeo, a leading provider in weather intelligence and decision support solutions, today announced a new project with ESA wherein StormGeo will assess the technical feasibility and commercial viability of satellite-based services in support of smart grids and electricity grid maintenance.
The proposed framework, known as GridEyeS, aims to give electric utilities and transmission companies more accurate risk assessments, faster outage management and better restoration strategies. The project team combines the expertise in satellite images and remote sensing from StormGeo, machine learning and drone imagery from eSmart Systems, and data science and power systems from HVL.
GridEyeS is one of the first projects of its kind to monitor the electricity network. Technical project lead, Professor Reza Arghandeh, discussed the challenges of the project, “Combining massive heterogeneous data sets from various sources of satellite sensors, drone images and weather observations and extracting intelligence out of it is a complex computational process. We will tackle this complex challenge with state-of-the-art machine learning algorithms that are able to capture spatiotemporal changes in datasets related to the electricity network infrastructure.” Prof. Arghandeh teaches Big Data and Machine Learning at Western Norway University of Applied Science (HVL) and is a Senior Data Scientist at StormGeo.
Using satellite images to analyze and predict the influence of vegetation on the risk level in power grids is a high-priority research axis, as vegetation is a main factor for grid disturbance. Furthermore, the potential for using satellite-based information is broad and could, for example, also be exploited for subsidence detections along power line trails
By connecting data across systems and companies, we are opening up a new world of streamlined operation planning and faster grid restoration,” said Jostein Mælan, COO of Weather Insights at StormGeo. “Given the team’s combined expertise in AI, software development, satellites, weather and power grids, we expect to push the boundaries to make our electricity grids more resilient.
The first stage of the project over Norway will be completed in 2020.
About StormGeo
StormGeo is a global provider of weather intelligence and decision support services, with leading solutions for shipping, oil and gas, renewable energy, utilities and aviation. StormGeo’s products and services help clients manage risk, optimize performance, reduce costs and increase revenue. The company has 24 offices in 15 countries, including six 24/7/365 global operations centers. As a participant in the UN Global Compact for Sustainable Ocean Business, our passion for weather and the protection of natural resources motivates us to support our clients in making informed, environmentally responsible business decisions. For more information, visit www.stormgeo.com.
About eSmart Systems
eSmart Systems AS is a Norwegian developer of next generation software solutions for inspections of powerlines, grid maintenance planning and energy flexibility optimization. Our mission is to create intelligent solutions to accelerate the transition to a sustainable future, by developing innovative technology to the energy market. The company is based on more than 20 years of international experience in establishing and operating knowledge based, leading IT and energy related companies targeting global markets. Key owners of the company are Kongsberg Digital, Energy Impact Partners, Equinor Venture, Nysnø, innogy Ventures and several Norwegian utilities. For more information, visit www.esmartsystems.com.
Next year, the big venture AI Week will take place for the first time. Over the course of three days in September 2020, the spotlight will be on artificial intelligence and the endless possibilities of technology. The initiators aim to create an unparalleled conference week in Norway’s AI epicenter, Halden.
– AI Week is a collaborative project in which the Institute of Energy Technology (IFE), Halden municipality, eSmart Systems and Smart Innovation Norway want to showcase the unique environment within artificial intelligence in Halden and Norway. The competence environment within artificial intelligence in Halden dates back to the early 1980s, and has gained solid and broad international experience due to its extensive research and development in the field, says project manager for AI Week, Martine Bjørnstad.
The initiative started with a shared idea of organizing a conference that focuses on artificial intelligence (AI), however the idea has evolved, and it will now be a grand technology festival consisting of several different events with artificial intelligence being the running theme, and sustainability being the underlining theme.
– We wish to put our competent AI environment on the map, adds the initiators of AI Week.
Gathering a AI-national team
– This is an important part of our mutual goal of uniting a Norwegian AI-team. It provides us with a meeting ground for applied artificial intelligence where Norwegian players meet with international environments, arranged by several key organizations with long-standing experience in the field, comments one of the initiators and director of research at IFE, Dr. Tomas Nordlander.
The date is set to September 15-17 next year, and during these three days there will be activities for everyone, regardless of age and knowledge level on the topic.
– This should be something for the sharpest academic minds from India to Canada, and right down to kindergarten level. We will host a main conference in Brygga kultursal with prominent speakers, yet we also want to bring in elements such as coding for children and educational activities for the elderly, says Thor Mosaker, CEO of Smart Innovation Norway.
Intelligent technology put to use
AI Week´s ambition is to create an arena for both the Norwegian and international AI environment, while simultaneously showcasing the excellent AI expertise that lies in Halden and Norway.
– Not to mention, we want to showcase the practical use of this groundbreaking technology, says Knut H. H. Johansen, CEO of eSmart Systems.
Recently, a brand new cluster for applied artificial intelligence, called Cluster for Applied AI, was launched – and it is the initiators of this new cluster that are also behind the initiative of AI Week.
Significant event
In connection to AI Week, several parallel activities will be arranged in Halden, including an academic conference with the same theme; applied artificial intelligence, hosted by Østfold University College and IFE.
– We have a fantastic bunch of brilliant people from the tech world who are working to get the program in place these days. In addition, all the partners contribute with important skills that will make the event significant for anyone who wants to learn more about AI, says project manager Bjørnstad.
She hopes that the people of Halden will embrace the initiative, both in the form of participation and in showcasing the city itself, the country and the expertise that exists here.
– Without revealing too much, it will be a lot of exciting activities and events during these three days, both academically and of a cultural nature, concludes Bjørnstad and smiles.
For more information, contact:
Martine Bjørnstad, Project Manager AI Week
- Phone: +47 402 20 077
- Email: martine.bjornstad@smartinnovationnorway.com
Tomas Nordlander, IFE Research Director
- Phone: +47 988 24 892
- Email: tomas.nordlander@ife.no
Knut H. H. Johansen, CEO of eSmart Systems
- Phone: + 47 909 81 318
- Email: knut.johansen@esmartsystems.com
Jens-Petter Berget, Head of the Department of Social Development in Halden Municipality
- Phone: +47 402 21 454
- Email: jens-petter.berget@halden.kommune.no
Thor Mosaker, CEO of Smart Innovation Norway
- Phone: +47 934 35 163
- Email: thor.mosaker@smartinnovationnorway.com
Nhan Van Nguyen defended his PhD degree at the University of Tromsø (UiT), Department of Physics and Technology, on December 3rd 2019.
At eSmart Systems, Nhan Van Nguyen holds the position of Senior Data Scientist.
The title of his PhD thesis is: «Advancing Deep Learning for Automatic Autonomous Vision-based Power Line Inspection». After having successfully defended his PhD, Nhan was congratulated by the faculty, family and representatives from eSmart Systems.
Background
Nhan Van Nguyen has a B.Eng. degree in Computer Science and Engineering from the Ho Chi Minh City University of Technology, Vietnam, and a M.S. degree in Computer Science from Østfold University College, Norway. Nhan specializes in deep learning for computer vision.
Assessment Committee
The faculty appointed the following assessment committee:
- Associate Professor Atsuto Maki, Division of Robotics, Perception and Learning, KTH, Royal Institute of Technology, Sweden
- Professor Kjersti Engan, Department of Electrical Engineering and Computer Science, University of Stavanger, Norway
- Associate Professor Stian Normann Anfinsen, Department of Physics and Technology, UiT, Norway
The candidate’s main supervisor has been Professor Robert Jenssen (UiT). Chair of the defence was Professor Rune Graversen (UiT).
The trial lecture took place on December 3rd, 2019 at 10:15, and the public defence of the thesis took place later the same day, at 12:15.
Abstract
“Electricity is fundamental to the ability to function of almost all modern-day societies. To maintain the reliability, availability, and sustainability of electricity supply, electric utilities are usually required to perform visual inspections on their electrical grids regularly. These inspections have been typically carried out using a combination of airborne surveys via low- ying helicopters and eld surveys via foot patrol and tower climb. The primary purpose of these visual inspections is to plan for necessary repair or replacement works before any major damage that may lead to a power outage. These traditional inspection methods are not only slow and expensive but also potentially dangerous. In the past few years, numerous eorts have been made to automate these visual inspections. However, due to the high accuracy requirements of the task and its unique challenges, automatic vision-based inspection has not yet been widely adopted in this eld.
In this dissertation, we exploit recent advances in Deep Learning (DL), especially deep Convolutional Neural Networks (CNNs), and Unmanned Aerial Vehicle (UAV) technologies for facilitating automatic autonomous vision-based power line inspection. We propose a novel automatic autonomous vision-based power line inspection concept that uses UAV inspection as the main inspection method, optical images as the primary data source, and deep learning as the backbone of data analysis.
Next, we conduct an extensive literature review on automatic vision-based power line inspection. Based on that, we identify the possibilities and six main challenges of DL vision-based UAV inspection: (i) the lack of training data; (ii) class imbalance; (iii) the detection of small power line components and defects; (iv) the detection of power lines in cluttered backgrounds; (v) the detection of previously unseen power line components and defects; and (vi) the lack of metrics for evaluating inspection performance. We address the first three challenges by creating four medium-sized datasets for training component detection and classication models, by applying a series of eective data augmentation techniques to balance out the imbalanced classes, and by utilizing multistage component detection and classication based on Single Shot multibox Detector (SSD) and deep Residual Networks (ResNets) to detect small power line components and defects.
Then, we address the fourth challenge of DL vision-based UAV inspection, which is to detect power lines in cluttered backgrounds, by proposing LS-Net, a fast single-shot line-segment detector, for then to apply it to power line detection. The LS-Net is by design fully convolutional and consists of three modules: (i) a fully convolutional feature extractor; (ii) a classier; and (iii) a line segment regressor. With a customized version of the VGG-16 network as the backbone, the proposed LS-Net outperforms the existing state-of-the-art DL-based power line detection approaches by a considerable margin and can detect power lines in near real-time.
Finally, we propose few-shot learning as a potential solution to the fth challenge of DL vision-based UAV inspection, which is to detect previously unseen power line components and defects. To pave the way for addressing the challenge, we propose an innovative approach for advancing the state of the art of few-shot learning. Specically, we propose a novel dissimilarity measure in terms of the Squared root of the Euclidean distance and the Norm distance (SEN) combined to address the existing issues of the traditional Euclidean distance in high dimensional spaces. We extend the powerful Prototypical Network (PN) by replacing the Euclidean distance by our proposed SEN dissimilarity measure, which we refer to as SEN PN. With minimal modications, the SEN PN outperforms the original PN by a considerable margin and demonstrates good performance on the miniImageNet dataset with no additional parameters as well as almost no additional computational overhead. The sixth challenge, which is to address the lack of metrics for evaluating inspection performance, is left for future work.
The contribution of this dissertation is threefold:
First, it proposes a novel automatic autonomous vision-based power line inspection concept that uses UAV inspection as the main inspection method, optical images as the primary data source, and deep learning as the backbone of data analysis.
Second, it provides an overview of the possibilities and challenges of deep learning in automatic autonomous vision-based power line inspection.
Third, it proposes approaches for addressing the identied challenges, for advancing deep learning, and for paving the way for realizing fully automatic autonomous vision-based power line inspection.”
eSmart Systems recently launched a new Earth fault module in Connected Grid that is expected to significantly reduce inspection cost related to earth fault troubleshooting. The module enables earth fault monitoring at transformer and customer level which will bring great insight for determining where the earth fault has its origin.
Earth fault is a phenomenon which means that an undesired current leakage goes from a conductor to earth or to other parts of an installation that should not be energized. As it is difficult to pinpoint where the cause of the earth fault lies, without onsite investigation, the fault location identification often lands on the grid company.
Identification of the origin is often difficult when it comes to earth faults. Connected Grid has functionality for real time, continuous visualization of earth faults in distribution networks. Functionality differentiates the earth faults based on their origin which is crucial for rapid rectification
eSmart´s Earth Fault module provides detailed information of the earth fault such as time of occurrence, duration, type of fault and size of the leakage current for further follow up.
I am excited for this release. Our solution not only reveals the origin of the earth fault, but along with advanced visualization, provides a fast and efficient troubleshooting process for the grid company
Focus on Earth Fault
Lie explains, the reason for focusing on earth faults is that the IT grid structure, can cause the earth faults to become a danger to life and property. Grid companies for example in Norway are responsible for earth faults occurring in the grid. If the error proves to be within the customer installation, the customer is liable to rectify the error.
An eSmart customer said that one earth fault troubleshooting normally requires 2 resources during one full day, which results in high inspection cost. By using the module in Connected Grid, they have estimated their savings to be up to 2 MNOK.