Académique Documents
Professionnel Documents
Culture Documents
An optical sensing system for seam tracking and weld pool control
in gas metal arc welding of steel pipe
K.-Y. Baea,, T.-H. Leea, K.-C. Ahnb
a
Department of Industrial Automation Engineering, Chinju National University, Chinju, South Korea
b
Department of Mechanical Design Engineering, Chinju National University, Chinju, South Korea
Accepted 8 November 2001
Abstract
A visual sensing system was developed for automatic gas metal arc welding (GMAW) of the root pass of steel pipe. The system consisted
of a vision sensor that consisted of a charge-coupled device (CCD) camera and lenses, a frame grabber, image processing algorithms, and a
computer controller. A specially designed ®ve-axis manipulator was used to position the welding torch and to provide the vision sensor with
automatic access to view the welding position. During the root pass welding, an image of the weld pool and its vicinity was captured using
the camera without interference of the intensive arc light by viewing at the instance of a short-circuit of the welding power. The captured
image was then processed to recognize the weld pool shape. For seam tracking, the manipulator was used to adjust the torch position based
upon the pool image to the groove center. The measured gap size was used to determine the appropriate welding conditions to obtain sound
penetration. The welding speed was chosen using fuzzy logic with the knowledge of a skilled welder and measured gap. The automatic
welding equipment demonstrated that both welding conditions and torch position could be appropriately controlled to obtain a sound
weldment and a good seam tracking capability. # 2002 Elsevier Science B.V. All rights reserved.
Keywords: Visual sensing; Weld pool control; Seam tracking; Root pass welding
1. Introduction the root pass requires the ability to adjust torch position and
welding conditions, dealing with a variety of root states.
As demands on pipe structures for ocean exploration, steel There have been many studies on visual sensing techniques
towers, water and oil pipe lines, etc. are increasing, the for observing weld pool images during welding. A weld pool
requirements for greater productivity and accuracy in man- control technique with the vision sensor system consisting of
ufacturing these structures are also increasing. For joining a charge-coupled device (CCD) camera and a long wave
one pipe to the other, girth arc welding, which consists of the pass ®lter for lowering the arc intensity in bead-on-plate
root pass and the ®ll pass procedures, is prevalently per- welding has been investigated [1,2]. Control of the weld pool
formed. The welding process for manufacturing pipe struc- width in pulsed metal inert gas (MIG) welding was also
tures can be accomplished with automatic equipments that studied using measurement of the weld pool with a vision
have been partially mechanized only for ®ll pass welding sensor during the base current period of the pulse [3,4].
and operated by a welding operator. Manufacturing toler- Moreover, the relationship between the observed bead width
ances at the preparation stage cause unavoidable amounts of and the penetration depth in gas metal arc welding (GMAW)
distortion, eccentricity, and mismatch that produce a varia- process has also been investigated [5]. However, because
tion in gap size and also in seam location. The irregularities most of these studies observed the weld pool with a top-side
in the root shape of a groove make it impossible to set view, only the width of the weld pool could be investigated,
welding conditions and torch location to be constant during and information on penetration through the joint could not
welding. Therefore, the root pass procedure has been very be determined. Although an automatic pipe welder with a
dif®cult to automate and is generally performed by a skilled vision sensor that could give a front view of the weld has
welder. To achieve full automation of steel pipe welding, the previously been reported with GMAW [6,7], only a limited
root pass weld should ®rst be automated. The automation of information is available on this equipment.
In this study, experimental results from testing of a seam
*
Corresponding author. tracking and weld pool control system for the root pass
E-mail address: kybae@chinju.ac.kr (K.-Y. Bae). welding of steel pipe is presented. The system consisted of a
0924-0136/02/$ ± see front matter # 2002 Elsevier Science B.V. All rights reserved.
PII: S 0 9 2 4 - 0 1 3 6 ( 0 1 ) 0 1 2 1 6 - X
K.-Y. Bae et al. / Journal of Materials Processing Technology 120 (2002) 458±465 459
®ve-axis pipe welding manipulator with its controller, the manipulator, a welding power source, a control panel and a
hardware logic for detecting the short-circuit and the visual control computer. Fig. 1 shows a schematic drawing of the
sensing system. The manipulator was constructed to permit pipe welding manipulator.
the welding torch and the vision sensor to have automatic The base table of the manipulator is composed of three
access to a welding position with predetermined con®gura- Cartesian axes, where the X- and Y-axes cooperate to travel the
tions when the pipe to be welded was selected. The visual curved racks grasping the welding torch and the CCD camera
sensing system was composed of a CCD camera, lenses and to a predetermined welding position when a pipe diameter is
®lters, a frame grabber and image processing algorithms. given. The Z-axis is used for seam tracking. By rotating one
When low current GMAW, that is used for root pass curved rack grasping the torch holder, the torch can rotate
welding, is applied, the intensive arc light momentarily around thewelding position to a suitablewelding con®guration
extinguishes periodically with a short-circuit. In this study, angle (A-axis). Similarly, the other curved rack can also rotate
the short-circuit phenomena was utilized in order to acquire the camera to another con®guration (B-axis) corresponding
an image of the weld pool and its vicinity using the vision with the torch con®guration to observe the weld pool. The
sensor. The sensor was located almost tangent to the surface manipulator ®nds the welding position (x, y) using the follow-
at welding position. The acquired image was then processed ing coordinate transformation with given information on a
to detect the shape and size of the weld pool, from which the pipe such as diameter (D) and welding start position (c).
relative distance between the torch position and the weld x L1 L2 1 1
2 D cos
c; yH 2 D sin
c (1)
seam was determined and the gap size of groove measured.
The information made it possible for the system controller to where L1 is the distance from the origin of X-axis to the
determine a new welding position, permitting the torch to center of the pipe along the X-direction, L2 the distance from
advance to that position, apply new welding conditions all in the x-position to the center of the curved rack along X-
real time. For the determination of welding conditions, the direction, and H is the distance from the origin of the Y-axis
relation between the gap size and the welding speed was to the center of the pipe along the Y-direction.
chosen using fuzzy logic and incorporating the knowledge of
a skilled expert. 2.2. Controller
A series of experiments was conducted to evaluate the
performance of the seam tracking and weld pool control of Fig. 2 shows a block diagram of the controller of the pipe
the system for the root pass welding of a steel pipe. welding system that is based on an IBM compatible personal
computer. The computer acquires images of the weld pool
through the CCD camera and the frame grabber, sets the
2. Pipe welding system welding current and voltage through the digital±analog (DA)
converter board, monitors the welding current through the
2.1. Welding manipulator analog±digital (AD) converter board, commands the arc to
be on or off, controls the wire, checks the gas, etc. through
The pipe welding system developed in this study consists the digital input and output (DIO) board, sets torch position
of a positioner for turning the pipe, a ®ve-axis welding through a motion control board.
A vision sensor for monitoring the weld pool requires a 3.3. Pool image searching
special optical system to reduce the intensity of the arc [8].
In this study, for this purpose, the vision sensor which The image searching algorithm to detect boundary of the
basically consisted of a CCD camera and a close-up ring, weld pool was based on the technique that searched the
Fig. 3. Short detection from raw current signal: (a) current signal; (b) short signal.
K.-Y. Bae et al. / Journal of Materials Processing Technology 120 (2002) 458±465 461
pixels along the counterclockwise (CCW) direction around and the pool center in the vertical direction for each column
the presently detected position for a next boundary position were then added. And then, the differentiation for the
[3]. In the proposed algorithm in this study, a next searching summation along the horizontal direction was carried out
direction for the present boundary position was ®rstly to obtain minimal and maximal values, and their column
determined to be located at 458 in the CCW direction from positions, respectively. Consequently, the center of the torch
the presently searched direction. The angle would be then could be then determined to be located at the center of the
increased by a step of 458 until to ®nd the ®rst pixel having a two columns.
gray level above the threshold, and the found pixel became a An offset of the welding wire from the center of a groove
boundary pixel of the weld pool. This algorithm can be makes shapes of the weld pool at both sides around the wire
expressed as follows: to be of asymmetry. In this study, for tracking a groove
0 center, i.e. a weld seam, the welding torch was controlled to
u cos q sin q u
(2) move to the direction along which the asymmetry of the
v0 sin q cos q v
weld pool around the wire diminished.
where u0 , v0 are the components of searching direction vector
to find a next boundary pixel, q np=4 (n 1; . . . ; 7), and 4.2. Weld pool control
u and v are the components of present searching direction
vector derived from the following equation: The control technique of a skilled welder was implemen-
ted as the control algorithm of the weld pool to obtain a
u i iP
B sound penetration in welding of the pipes which had a
v jB jP
variation of gap. For the purpose of this, the gap size should
Here i and j are the pixel coordinates, subscript `P' the be ®rstly measured from an image of the weld pool as done
present boundary pixel, and subscript `B' is the previous by a welder in a manual welding. In this study, widths of a
boundary pixel. partial region of the weld pool from the lowest row to 10
pixels above corresponding a 0.5 mm height were averaged,
and then the result was de®ned to be a measured gap size.
4. Seam tracking and weld pool control Meanwhile, because the weld pool should be appropri-
ately penetrated through the gap of pipe to obtain a sound
4.1. Seam tracking penetration, there may be a close relation between the real
gap and the measured gap for the sound weldment. For
As shown in Fig. 4, an image of the weld pool necessarily identifying the relationship, the temperature distributions
contains the shadow of the wire indicating current position around the groove were considered to be of valuable infor-
of the torch, and the center of the weld pool presenting the mation and were therefore predicted with a welding current
center of groove. In order to search the center of the wire of 180 A, a voltage of 20 V, and a speed of 2.1 mm/s by
with the features from an image of the weld pool, the left and using the FEM program developed for a previous study [10].
the right extreme columns of the weld pool were at ®rst Fig. 5 shows the predicted temperature distribution of a half
identi®ed, respectively. From the mid column between the section around the center of groove. The region heated above
left extreme column and the groove center to the mid one 1500 8C can be considered to be a part of the weld pool, and
between the groove center and the right extreme column, the it penetrates through the non-melted zones to be a back bead.
gray level of each pixel located between a pool start pixel The penetrated region below the bottom of the gap would be
observed as a part of the bright weld pool by the camera, and
the width of the region is considered to be a measured gap in
this study. With the results, the relation between the actual
Fig. 12. Result of weld pool control: (a) with control; (b) without control.
was only a small increment in the gap size compared with 6. The fuzzy logic of which rule was based on the
the 3.0 mm gap for which initial welding conditions were knowledge of a welding expert could determine in real
decided, no good weldment was produced by occurrence of a time an optimal welding speed corresponding to a gap
penetration of the wire into the gap. Accordingly, these variation.
results meant that the weld pool control should be always
required to deal with any gap variation in the root pass
welding of a pipe. References
[1] D.-C. Kim, S.-H. Rhee, K.-W. Um, A study of weld pool width
7. Conclusion control in gas tungsten arc welding using the digital image
processing, J. KSME(A) 20 (9) (1996) 2760±2769.
A visual sensing system was proposed for the seam [2] Stenning Vision Ltd., N.N. Reference Manual, Stenning Vision Ltd.,
tracking and the pool control to automate the root pass Canada.
[3] K. Ohshima, M. Morita, K. Fujii, M. Yamamoto, T. Kubota, Sensing
welding of steel pipe. As the result of the investigation of the
and digital control of weld pool in pulsed MIG welding, Trans. Jpn.
feasibility and weldability through a series of welding Weld. Soc. 23 (1) (1992) 36±42.
experiments for the proposed system and its algorithms, [4] K. Ohshima, M. Yamamoto, T. Tanshi, S. Yamane, Digital control of
following conclusions could be derived: torch position and weld pool in MIG welding using image processing
device, IEEE Trans. Ind. Appl. 28 (3) (1992) 607±612.
1. The manipulator with the torch handling mechanism [5] R. Kovacevic, Y.M. Zhang, L. Li, Monitoring of weld joint
worked exactly in locating the torch at a start position of penetration based on weld pool geometrical appearance, Weld. J.
welding for any specified diameter of pipe. 74 (10) (1996) 317s±329s.
[6] Tecnar Automation Ltd., N.N. Reference Manual, Rotoweld 2000
2. The short-detection logic captured very well the period
Pipe Welding Workstation, Tecnar Automation Ltd., Canada.
of an arc extinction during welding process and correctly [7] F. Nadeau, P. Fafard, G. Patenaude, J. Tremblay, Method and
issued a trigger pulse for the camera to acquire an image apparatus for controlling root pass weld penetration in open butt
of the weld pool without interference of the arc. joints, US Patent 4,733,051 (1988).
3. The edge-detection technique could quickly and easily [8] H. Wata, Y. Manabe, Y. Hiromoto, H. Yoritaka, Group-control system
for narrow-gap MIG welding, in: H. Namura (Ed.), Sensors and
find the boundary of the weld pool from its background,
Control System in Arc Welding, Chapman & Hall, London, 1994,
which shortened the processing time with considerable pp. 176±181.
exactness in searching an image of the weld pool. [9] J. Weston, Advanced Welding Systems, Vol. 2, IFS Ltd., UK (Chapter 6).
4. The position of wire, the center of the weld pool, and the [10] K.-Y. Bae, S.-J. Na, D.-H. Park, A study of mechanical stress relief
gap size of the weld pool could be calculated with the treatment of residual stresses for one-pass submerged arc welding of
V-grooved mild steel plate, Proc. Inst. Mech. Eng., Part B: J. Eng.
features extracted from an image of the weld pool.
Manufac. 208 (1994) 217±227.
5. The seam tracking logic for sustaining a symmetry of [11] J.-W. Kim, S.-J. Na, A self-organizing fuzzy control approach to arc
the weld pool around the wire was appropriate enough to sensor for weld joint tracking in gas metal arc welding of butt joints,
obtain a suitable result in the seam tracking. Weld. J. 71 (2) (1993) 60s±66s.