Advantages of Robotic Visual
Inspection
The latest state-of-the-art robots create
digital twins, tag inspection data posi-
tions within the asset model, and
provide 3D semi-autonomous control.
These robots then generate inspec-
tion reports automatically and directly
upload the data into asset performance
management systems. Recent technol-
ogy is moving toward refining this new
process of robotic visual inspection while
supporting a seamless integration into
asset owners’ digital strategy. By using
the latest robotic technology, inspections
are now semi-automated, data is auto-
matically stored, and asset inspections
can be compared over time.
Robotics visual inspection offers
several compelling advantages for
inspecting confined spaces, including:
Ñ Enhanced visibility. Robotic systems
equipped with high-definition
cameras can provide superior visual
inspection capabilities compared to
human inspectors. These cameras can
capture detailed images and videos
of the interior of confined spaces,
allowing for thorough examination of
equipment, structures, and compo-
nents. The enhanced visibility offered
by robotic visual inspection ensures
that potential defects, damage, or
anomalies are detected with precision.
Ñ Consistency in inspection. Robotic
visual inspection systems can follow
predefined inspection paths and
parameters consistently, ensuring
uniform coverage of the entire
confined space. Unlike human inspec-
tors, robots do not suffer from fatigue
or distractions, which can compro-
mise the thoroughness and accuracy
of inspections. This consistency in
inspection results in high-quality data
for analysis and decision-making.
Ñ Safe accessibility to hazardous
environments. With the use of
robotics, human entry into confined
spaces can be eliminated, and the
related efforts and challenges as
previously described (limited access,
restricted movement, communication
challenges, required confined space
training, emergency planning and
measures) are reduced.
Ñ Real-time monitoring and feedback.
Robotic visual inspection systems can
provide real-time monitoring and
feedback during inspections. As the
robot navigates through the confined
space, operators can view live video
feeds and data from onboard sensors,
allowing them to assess the condition
of assets immediately. Any abnor-
malities or issues identified can be
addressed promptly, minimizing
downtime and reducing the risk of
potential failures.
Ñ Comprehensive documentation and
reporting. Robotic visual inspection
systems can automatically capture and
store visual data, creating comprehen-
sive documentation of inspections.
These records can include images,
videos, timestamps, and annota-
tions, providing a detailed history
of the condition of assets over time.
Additionally, automated reporting
features enable the quick and accurate
generation of inspection reports, facil-
itating compliance with regulatory
requirements and internal quality
standards.
Inspection plan
Inspection plan
Planning &preparation On-site execution Inspection data analytics &reporting
System operation/inspection
Guesstimate position
Maneuvering
Search for inspection spots
Assess camera images
Store images &take notes
Inspection documentation
Ad hoc assessment
Notes, stored images ...
Inspection planning
System preparation, training ...
Inspection data management
Save images into a file system
Digitize or save notes into the file system
Inspection report preparation
Copy relevant images into a template report
Add taken notes to the report
System operations
Inspection report
Inspection results
Procedures
Drawings
Figure 1. Remote visual inspection (RVI) process involving manual preparation, inspection, and documentation.
FEATURE
|
ROBOTICVT
50
M A T E R I A L S E V A L U A T I O N J U L Y 2 0 2 4
Ñ Integration with data analysis
tools. Visual data captured by robotic
inspection systems can be integrated
with data analysis tools and software
for further analysis. Advanced
image-processing algorithms can
detect patterns, anomalies, or defects
in visual data, supporting predictive
maintenance and asset management
strategies. By leveraging the power
of data analytics, companies can
optimize maintenance schedules,
extend asset lifespan, and reduce
operational costs.
These advantages make robotic
visual inspection a valuable solution for
industries seeking efficient, accurate,
and safe methods of assessing confined
spaces and maintaining critical assets.
Key Technology: Localization and
Data Geotagging
Robotic localization technology for
autonomous operation and report-
ing is available and is used by both
drones and mobile robots on the plant
level. However, most modern localiza-
tion technology cannot be applied to
confined spaces due to the lack of GPS
reception, weakly textured surfaces, asset
size, and complex geometries.
Current robotic practice in GPS-
restrictive areas is simultaneous
localization and mapping with lidar
remote sensing technology. By using
a lidar, a point cloud of the environ-
ment is created, and a mesh is stitched
together simultaneously while the robot
is moving. By comparing the point
clouds and mesh, the absolute distance
between positions can be computed,
and the robot can be located within an
asset.
Another much simpler approach is
to provide a 3D model of the asset as
input, measure the distance from the
robot to a specific point on the asset,
and compare this with the distance cal-
culated using the corresponding position
in the 3D model. To increase accuracy
and repeatability, additional navigation
sensors are integrated into the localiza-
tion process. These include an inertia
measurement unit (IMU), odometry
(distance measured by the driving
wheels), and kinematic constraints. All
this data is combined using a particle
filter and/or a Kalman filter. This allows
for the calculation of the robot’s 3D pose
(position and orientation within the
asset) and the specific location in the 3D
model where the inspection camera is
directed (Figure 2).
As a result, the system can geotag all
images to the 3D model and store them
in a database along with the camera
settings at the time of capture, such
as zoom level, lighting, and resolution
(Figure 3).
Notes—either as text or created with
a drawing editor—can be added to the
images during the inspection or later
when creating the documentation. These
annotated images are then stored in the
database. The inspection report can be
generated automatically using templates
(Figure 4).
A primary goal is to minimize the
time spent on-site and inspecting the
asset. The planning of the inspection,
based on the inspection plan, can be
completed before the mission by uti-
lizing a 3D model and a virtual repre-
sentation of the robot and inspection
camera system. This can be achieved
through a sophisticated simulation tool,
which enables running the inspection
scenario to assess technical feasibility
Area under
inspection
x x
y
y
Figure 2. The approach to calculate the 3D pose of a robotic system in a confined space and to
localize the inspection camera view on the asset being observed: (a) robot with distance sensors
(lidar), IMU, and odometry (b) confined environment (c) localization of robot and inspection
data.
Data point
selected
Camera cone
Inspection
data (visual
inspection)
Figure 3. 3D digital twin software calculates the view cone of an inspection camera and
automatically links the captured image with the correct asset coordinates. The data can be edited
and amended with comments and sketches.
J U L Y 2 0 2 4 M A T E R I A L S E V A L U A T I O N 51
Previous Page Next Page