Come see our presentation with Xcel Energy at TechCon 2023. 

We are delighted to announce that eSmart Systems will be attending TechCon 2023. Xcel Energy will be giving an insightful presentation about their Unmanned Aerial Survey Virtual Inspection program in collaboration with eSmart Systems. We eagerly anticipate this event as an opportunity to strengthen our partnership and contribute to Xcel Energy’s esteemed position as the forefront technology leader in the Utility industry.

If you can’t attend but would like to learn more, please reach out to us directly.

Contact us

The project, completed in 2021, focused on hardware and defects identification. The project looked at cotter pins, with an emphasis on loose and upside-down cotter pins. The project was able to automatically detect over 11,000 total and successfully identify 781 upside-down pins within a few seconds. The project enabled the public utility’s maintenance engineers to efficiently locate the 2-inch upside-down cotter pins on up to 100 feet high towers and assess their conditions. The outcome of the project is an increase in powerline safety, field worker safety, and, as result, community safety. The case-study described below demonstrates the potential of virtual powerline inspections in enhancing community safety.

Introduction

Multiple large-scale wildfires are reported in the US every year. Such events cost tens of billions of dollars in direct costs such as property loss and damage and indirect costs such as long-term health exposures, market loss, and non-collectable taxes, etc^[1]. The consequences of such events can be disastrous from a human, material, and environmental perspective.

Defects in the power grid can cause wildfires; active causes can include a tree or branch falling over a powerline and sparking a wildfire. Triggered material or old powerline components can generate arcs or sparks, and under dry weather conditions and with dry surrounding vegetation, can lead to disastrous and hard to control wildfires.

To minimize the risk of wildfires caused by power grid issues, it is important to ensure conductors do not encounter any foreign objects like trees, other conductors, or the ground. This can only be achieved by properly managing vegetation in areas surrounding powerlines and by sufficiently keeping conductors separate from each other. Spacers and cotter pins, specifically, play a critical role in keeping conductors separated. Spacers keep conductors away from each other, while cotter pins hold the parts in transmission towers in place.

Cotter pins, however, could wear out and loosen over time. A loose and upside-down cotter pin is more likely to slip, becoming unsafe and increasing the chance of conductor failure and the probability of generating an arc flash touching their surroundings. Therefore, a main focus of the efforts led by the public utility to minimize the chance of wildfires is the management and maintenance of cotter pins specifically. As they are more likely to be upside-down than loose, the public utility decided to first assess the number of upside-down cotter pins on their grid. However, manually identifying the orientation of cotter pins is a tedious and resource-consuming task, as there can be as many as 50 2-inch cotter pins on each lattice tower, and the grid in this case includes over 1000 lattice towers.

The new approach

Both the public utility and the engineering and construction company defined the inspection process based on the required scope and accessibility of each structure. eSmart Systems shared their expertise to support that process definition and provided access to Grid Vision, a virtual inspection solution for power grids, enabling professionals to inspect powerlines from the office. Virtual inspection is a new approach to conducting powerline inspections by leveraging the power of automation, smart algorithms, and user-friendly interfaces to facilitate the work of the professionals analyzing the status of the infrastructure. Virtual inspections are also supported with artificial intelligence (AI) to automatically and promptly identify all the components of a power grid, as well as to detect various failures in the grid. With the application of such technologies, the software was able to identify 781 instances of upside-down cotter pins out of 11,000 cotter pin crops, within seconds (Figure 1).

Figure 1: Examples of an upside-down cotter pin automatically detected in the grid.

By associating those findings with information of the tower on which the upside-down cotter pins were located, the public utility could identify which towers required attention instantly. This approach has improved the efficiency and accuracy of identifying upside-down cotter pins and improved safety by having line workers only climbing structures when needed.

The utility also looked at other types of key components and their failure modes (flashed insulators, woodpecker damage on wooden transmission towers, rust on lattice towers, etc.) that could be identified utilizing this new approach for a proactive maintenance of powerlines. C-hooks and shackles, which are used for affixing insulators to brackets attached to crossarms, are particularly important components to look at in this context. The lattice towers are over 50 years old. Nonetheless, the virtual detection system was able to identify over 25,000 crops of C-hooks and shackles on the images captured during the inspection and very little wear was detected.

Figure 2: Examples of (a) a c-hook in good condition, (b) very limited level of wear seen on c-hooks during the project and (c) a shackle, highlighting the general good condition of those components in the grid.

Utilities are constantly looking for innovative ways to improve safety inspection and grid maintenance. This project has demonstrated that well-designed solutions supported by AI are game-changing tools, making inspection easier, more efficient and safer. The collaborative AI approach was instrumental to ensuring the correct components were identified and defects detected. The construction company’s review of the results from eSmart Systems’ Grid Vision solution ensured that high quality inspection standards were met and illustrated how utilities and engineering companies can benefit from virtual inspection tools.

The success of this program demonstrates how proactive actions can be implemented to enhance power grid management efficiency, and proves that smart solutions could help prevent wildfires, in addition to illustrating numerous other advantages, such as new quality assessment possibilities, defect detection standardization, and increased trust in data.

Contact us today and see how Grid Vision is transforming the way the world’s leading energy providers inspect and maintain critical infrastructure.

^[1]https://www.nfpa.org/News-and-Research/Publications-and-media/NFPA-Journal/2020/November-December-2020/Features/Wildfire

This article is a joint collaboration with EDM International

With headquarters based in Fort Collins, CO, EDM International is an alliance of engineers, scientists, biologists and business people working to provide innovative solutions for the utility industry. They have additional EDM offices in San Diego, CA, Billings, MT and Phoenix, AZ, along with staff located in other parts of North America.

Not all virtual inspections will give you the same results, so before you go and add virtual inspections to your inspection toolbox, there are some things you need to consider so you get the maximum value.

So, what’s the big plan? Why are you thinking about virtual inspections? Cut costs, be more efficient, enhance safety, try out Artificial Intelligence (AI)?  Or all of the above…

A mix of inspection methods such as ground, climbing, bucket truck, routine aerial, and detailed aerial patrols supplemented with advancements in viewing and data collection technologies (e.g., stabilized binoculars, digital cameras, field computers, etc)  have been utilized for decades to assess system conditions and identify maintenance items needing mitigation. Maintenance and inspection teams have developed best practices to improve what they get out of these inspection methods, while there are still improvements that can be made, most utilities are quite comfortable with the planning, scope and outcomes of these methods.

Now with virtual inspections, while the objectives are the same, perform a visual inspection of the grid, identify defects, and categorize their priority level so maintenance teams can deploy crews to repair any high priority defects and schedule lower priority maintenance. The methodology, enabling technologies and subject matter experts can have a huge impact on the results from your virtual inspection program.

Getting your planning right!

If you don’t scope and plan your virtual inspections correctly you could end up spending more on these types of inspections with less return, and the CFO really doesn’t like that.

You need to determine what defects your virtual inspection will focus on, as an aerial photo will show you the grid from a different perspective relative to say ground patrol and there will be certain defects that may be more difficult to detect, for example defects at the base of a pole or structure for which the evidence is relatively small. Further, it may not be possible to effectively measure the extent of such a defect from a photo.

Image taken by foot patrol of corrosion at the bottom of the structure. Difficult to get depth and measurement of defect from a virtual inspection. Image courtesy of EDM International.

Let’s look at data capture.

Think about the number of circuits you are planning to inspect with this method, and the technology you will use to capture the data from the field. Determine if you will be utilizing drones, or manned aircraft and once you determined the method, what will be the flight strategy and profile as this impacts your cost, time and the defects you can detect. For example, if you are utilizing drones (and of course you are because drones are super cool!), you can conduct linear or orbital flight pattern or a combination of both, you can also invest in drone flight optimization software to help optimize your data capture.

And yes, drones are cool and all but have you ever tried flying one? It is not that easy, and it is not always allowed, so you also need to consider regulations and potential flight restrictions in certain areas. Regulations vary from region to region and gaining approvals for certain types of flight can be a long process (government entities are not really known for being quick) especially when seeking to perform Beyond Visual Line of Sight (BVLOS) operations.  With data capture the key is to strike a balance between ensuring you get the data you need without needing to re-fly and making sure the approach is scalable.

Or were you planning a totally different approach and want to use images taken by other methods like LiDAR flights – then there are a lot of different questions you should be asking, like will it even work? Technology is rapidly changing and the ability to bolt on capturing LiDAR with what you are already doing will greatly expand the use case for the data and dramatically improve your return on investment. 

Then there is the image capture technology.

Just like our mobile devices, image capture technology is rapidly advancing. Who thought 15 years ago we would utilize our phones for almost everything and they would replace our wallets and cameras. This begs the question, how do you pick the right technology and ensure that the data you have captured is usable not only for an inspection, but beyond?

Once you capture the data, what are your plans with the number of images and data that you are going to collect, where will you store it all? You have to budget for it and plan for how you will be able to access the data, make it usable so that it is not just left in a data lake (gathering dust and eventually turning into an unstructured data swamp with warning signs) until the next inspection.

We’re conducting an ongoing large-scale virtual inspection program and over just the first three-years we’ve collected so many images that if we were using printed images (we’re not 😉), and we stacked them on top of each other they would equate to the height of the Empire State Building (that is 380 meters without the spire and antenna)! So, storage, albeit electronic/digital, is definitely something to think about.

The technology to enable virtual inspections and processing of the inspection data is something that needs to be given a lot of thought. There are a lot of solutions on the market at the moment, how do you pick the right one for you? Do you know what you need? Do you know what questions you should be asking to get beyond the smoke and mirrors of an impressive demo? A couple of important points to consider… 

• Can the software structure your images based on asset models?
• Can it also link the images to the metadata, and the right physical asset on the grid?
• Does the software you are considering enable efficient inspection and recording of findings?
• Does this software facilitate fast loading times for memory intensive images and quick access for inspectors? Time is money, everyone knows that.. right?

Then there is advanced technology like AI.

The new shiny tool in the toolbox, that is being marketed as the solution to all your problems. How do you build your strategy around that? One of the most important points to consider is that AI, no matter what industry you are in, needs training data (and a lot of it!). Therefore, when you are seeking an AI solution or trying to build your own, know that there are a lot of utilities who tried before you, and are now stuck with their AI in the innovation stage; because their AI will not do what they expected, it won’t solve all their problems because they simply do not have enough data to train the AI to detect the defects and components. The CFO is now cutting their budget since they are not showing any results, and they’ve had so many developers working on it that the costs have skyrocketed.  

So instead of being put in that awkward position, know that AI solutions are complex and take time to develop, and they are surrounded by expectations and misconceptions. Our personal favorite is that AI will replace the Subject Matter Experts (it won’t, we promise) so managing the expectations are key. Any transition takes a little time, and Rome was not built in a day – remember?

The Subject Matter Experts.

Let’s pretend we have all that. Once you have plans for the scope, capture process and technology, the next question is – who will perform the virtual inspection? Your Subject Matter Experts (SMEs) will have the biggest impact on the value you get back.  And thus it is critical to consider their experience and expertise and ensure they are trained on the technology…which needs to be easy to use and efficient, or your SMEs will quickly become disenchanted.  

Planning does not end with the inspection.

If you do not incorporate consideration of the additional business processes associated with inspection work into your planning, then your return will be short lived and the value limited. We have seen utilities do this right and when they do, we find maintenance teams consistently utilizing the inspection data in their everyday work; being able to do a lot more without a field visit. Accurate inspection data can empower utilities to prioritize capital projects and save a ton of money by only focusing on assets that need to be prioritized.

There have also been instances where maintenance teams have been able to reduce the risks of unplanned outages by identifying at-risk assets utilizing accurate virtual inspection data and enhance safety, reduce costs and help ensure compliance with their own standards as well as those of the regulators.  

So, before you embark on a virtual inspection initiative, stop and plan. It really can make the difference between an innovation project that gets mothballed, and one that drives efficiency gains, cost savings and automation of your business .  We know you are under pressure to reduce your operation and maintenance costs, but remember not all virtual inspections are the same, nor are they the silver bullet for all of your inspection needs. However, they can represent a cost-effective solution to add to your existing toolbox and when done right can reduce your costs, drive efficiency, support your digitalization journey and, most importantly, facilitate safety and reliability improvements.

Contact us today and see how Grid Vision is transforming the way the world’s leading energy providers inspect and maintain critical infrastructure.

Come see our presentation with Xcel Energy at TechCon 2023. 

We are delighted to announce that eSmart Systems will be attending TechCon 2023. Xcel Energy will be giving an insightful presentation about their Unmanned Aerial Survey Virtual Inspection program in collaboration with eSmart Systems. We eagerly anticipate this event as an opportunity to strengthen our partnership and contribute to Xcel Energy’s esteemed position as the forefront technology leader in the Utility industry.

If you can’t attend but would like to learn more, please reach out to us directly.

Contact us

Come see our presentation with Xcel Energy at TechCon 2023. 

We are delighted to announce that eSmart Systems will be attending TechCon 2023. Xcel Energy will be giving an insightful presentation about their Unmanned Aerial Survey Virtual Inspection program in collaboration with eSmart Systems. We eagerly anticipate this event as an opportunity to strengthen our partnership and contribute to Xcel Energy’s esteemed position as the forefront technology leader in the Utility industry.

If you can’t attend but would like to learn more, please reach out to us directly.

Contact us

Utility companies are required to inspect their grid on a regular maintenance cycle. Traditionally this work would be done by walking along, or flying helicopters over the power grid. Inspection and maintenance of power lines used to be tremendous and tedious work, not to mention extremely dangerous.

Even though most utility companies have moved over to image-based inspection, they have trouble sorting through the vast amounts of images. It is estimated that one expert can sort through 50 000 images per year.

Thanks to a Norwegian tech company, eSmart Systems, based in Halden, Norway, this tedious job can now be done faster, more accurate, more cost effective and a lot safer.

Images are imported into their software, Grid Vision, which uses collaborative artificial intelligence (AI) to detect faults in components. eSmart Systems estimate their solution can help utilities companies save inspection costs by 40 per cent.

In stress tests, eSmart Systems have been able to process 180 000 images an hour, more than three times the amount of what a human is capable of processing in a whole year!

More precise defect detection

Åsberg ensures that Grid Vision is not created to make the detection experts redundant. The approach used in Grid Vision is Collaborative-AI, where the expert’s feedback on the recommendations made by the AI to raise the quality of their work, and free up time, that they can use to improve their service to their customers.

–  As the experts work with the AI, it learns, gets smarter and even more precise. With faster image processing, the utilities can detect defects earlier and resolve any issues before they become a problem. The experts can even move their attention to predictive maintenance, says Åsberg. 

eSmart Systems has one of the largest qualified data sets in the world. They have expanded their suite of solutions to create synthetic images. In graphic engines like Unreal, they create 3D models of digital components and add faults to give the AI more data to learn from.

– The utilities get more objective inspections and a better foundation to plan their maintenance budgets. Deeper insight and better documentation in the infrastructure can really make a difference ahead of the wildfire season for example, says Åsberg.

Industrial scale through the cloud

eSmart Systems currently serve utility companies across Europe and North America and have helped inspect more than 100 000 kilometers of transmission and distribution overhead lines and analyzed more than 3 million images. All because their solutions are built with the purpose of being scalable in Microsoft’s cloud platform, Azure.  

eSmart Systems is a certified independent software vendor (ISV) partner with Microsoft. The entire solution is hosted in Azure.

– Our solution was born in Azure. We have never owned a server on our own. On a technical level, Microsoft and Azure has been totally crucial for our ability to scale, Åsberg explains.

The partnership has been fruitful on a commercial level as well.

– All our leads are generated through Microsoft’s ecosystem. It can be difficult for a small company from Norway to get the contracts with enormous utility companies on our own. The path to a meeting is much shorter when it is a technology giant like Microsoft that makes the call, says Åsberg.

Industry lead for power and utilities in Microsoft Norway, Tor Inge Åsen, underlines that the partnership is mutually beneficial.

– While we can supplement eSmart Systems thanks to our brand, they validate us in an industry where we have no solutions that are directly applicable as well. They give us a way into a vertical we would’ve struggled to get a foothold in without a partner with expertise in the field, Åsen confirms.

A solution for the future

The energy grid is the largest asset in the world, and a necessity if our society is to have any chance of making the green shift into a more electrified world.

– Our software will play a huge part in how utilities will prioritize investments. Maybe they can even defer infrastructure investments and focus on high-risk assets only, because they will be in more control over the maintenance needs. This gives eSmart Systems a higher purpose, and makes our job more meaningful, says Åsberg.

Contact us today and see how Grid Vision is transforming the way the world’s leading energy providers inspect and maintain critical infrastructure.

Norwegian company eSmart Systems was among one of the first in the world to develop an Artificial Intelligence based solution, Grid Vision^®, for the inspection and maintenance of critical energy infrastructure. With over 20 years of experience, it has become the leading international player within its field. The company has global customers including several of the world’s largest energy companies, such as Naturgy, Xcel Energy and E.ON.

Oslo, Norway, August 22, 2022 – In the recently completed Series B share issue, the current investors – Equinor Ventures, Kongsberg Group, Nysnø Climate Investments, Energy Impact Partners, and Future Energy Ventures – together with the U.S.-based investment fund manager, Arosa Capital, have raised ~€40 million.

The capital will be used to accelerate the company’s commercial development and international growth.

Arosa Capital, which manages traditional and alternative energy investments, and who recently became an investor of eSmart Systems, believes the company can take a leading position in the global energy market.

Mr. Bache added: “We are thrilled that a respected, long-term strategic investor like Arosa Capital shares our view of growth opportunities going forward. The completion of this share issue in today’s financial climate is a confirmation of our company’s strong position and prospects.”

According to Princeton Environmental Research and Rystad Energy the global energy transmission network is expected to triple in size, and over $18 trillion is to be invested by 2050 to reach net zero, creating massive growth opportunities for eSmart Systems.

“The current geopolitical situation has increased attention on energy security and emphasized the need for a stable power grid. We are also experiencing more frequent occurrences of extreme weather, resulting from climate change, making power infrastructure more vulnerable. eSmart Systems is uniquely positioned to assist grid operators in meeting these challenges.”, says Mr. Bache.

Last summer, eSmart Systems acquired the Stavanger-based company Verico to strengthen and expand its international platform. Verico offers specialized product and services within Enterprise Asset Management complementing eSmart Systems’ existing services. The combined company employ 110 employees in Norway, Sweden, Germany, the Netherlands, the UK and the US.

Investment banks DNB Markets and Arctic Securities were financial advisors of the share issue.

About eSmart Systems

eSmart Systems is a leading provider of AI-powered solutions for the inspection and maintenance of critical infrastructure. With the Grid Vision® portfolio, the company provides Inspection Management and Asset Information Management solutions and services to utilities globally. Grid Vision provides a data-driven and condition-based approach to infrastructure inspections and support utilities to reduce inspection costs, improve inspection safety, improve the quality of asset data and prolong asset life. More information about the company can be found at www.esmartsystems.com.

About Arosa Capital

Arosa Capital Management LP is an U.S.-based alternative investment fund manager that focuses on energy both within traditional and alternative energy sources. Arosa was founded in 2013 and combines fundamental analysis with a long experience and deep knowledge of the energy markets to invest in venture companies, private and public companies, as well as in credit and commodities. More information about Arosa Capital can be found at www.arosacapital.com.