Académique Documents
Professionnel Documents
Culture Documents
ROBOT
Thesis submitted in partial fulfillment of the requirement for the award
of degree
BACHELOR OF TECHNOLOGY
by
Name of the student
1)Debanjan Sarkar
Roll no.
15800312007
Decleration
I hereby declare that the work presented in the thesis entitled as WIRELESS GESTURE
CONTROLLED ROBOT bonafied record of the systematic research work done by us under the
guidance of Mrs. Mousumi Karmakar, Department of Electronics and Communication Engineering,
Mallabhum Institute of Technology, Bishnupur, India and that no part thereof has been presented for
the award of other degree.
Place. Bishnupur
_________________
Date.
Debanjan Sarkar
Roll no.-15800312007
Certificate
This is to certify that the thesis entitled WIRELESS GESTURE CONTROLLED ROBOT
by Debanjan Sarkar submitted to the Mallabhum Institute of Technology, Bishnupur for the
degree of Bachelor of Technology, is a record of bonafide research work, carried out by us in the
Department of Electronics and Communication Engineering under my supervision and guidance. I
believe that the thesis fulfill parts of the requirements for the award of degree of Bachelor of
Technology. To the best of my knowledge, the matter embodied in the thesis has not been
submitted to any other University/Institute for the award of any other degree.
ii
Acknowledgement
I take this opportunity to express my sincere gratitude to the faculties of Electronics and
Communication Department, especially our mentor Mrs. Mousumi Karmakar for their noble
guidance during the seminar. We are indebted to them for their kind help and timely
encouragement in making this seminar work professionally stimulating and personally satisfying.
iii
Contents
Title page
Declaration
Certificate
Acknowledgement
List of symbols and abbreviations
List of Figures
List of Tables
Abstract
Introduction
Chapter 1
6
1.1. Theory
1.1.2. Accelerometer (ADXL335)
8
10
11
12
13
14
1.1.9. DC motors
15
16
17
18
1.2.2.2. Theory
1.2.2.3. Circuit diagram
19
20
Chapter 2
2. Microcontroller codes
21
Chapter 3
3. Output
24
Chapter 4
4.1. Feasibility of the project
4.1.1. Software
4.1.2. Hardware
4.1.3. Expanses
26
26
26
4.2. Application
28
4.3. Limitation
29
30
List of Figures
Figure no.
Name
Page no.
Block Diagram
ADXL335 Accelerometer
LM324 IC
PT2262 IC
10
RF Transmitter
11
RF Receiver
11
PT2272 IC
12
AT 89C51 microcontroller
13
Crystal Oscillator
13
10
L293D IC
14
11
H-Bridge
14
12
DC Motor
15
13
DC Gear motor
16
14
17
15
Transmitting circuit
18
16
ASK Modulation
19
17
Receiver circuit
20
18
Move Forward
24
19
Move Backward
24
20
Move Right
24
21
Move Left
24
22
Robot 1
25
23
25
List of Tables
Table no.
Table Name
Page no.
10
11
Accelerometer Orientation
25
Expanses
27
11
12
ABSTRACT
Gesture Controlled Car is a robot which can be controlled by simple human gestures. The user
just needs to wear a gesture device in which a sensor is included. The sensor will record the
movement of hand in a specific direction which will result in the motion of the robot in the
respective directions. The robot and the Gesture instrument are connected wirelessly through
radio waves. User can interact with the robot in a more friendly way due to the wireless
communication. We can control the car using accelerometer sensors connected to a hand glove.
The sensors are intended to replace the remote control that is generally used to run the car. It will
allow user to control the forward, backward, leftward and rightward movements, while using the
same accelerometer sensor to control the throttle of direction and the other pair to rotate in the
clockwise direction which makes the car to rotate about its own axis without any kind of forward
or backward motion. The main advantage of this mechanism is the car with this mechanism can
take sharp turn without any difficulty
INTRODUCTION
The robot is usually an electro-mechanical machine that can perform tasks automatically.
Some robots require some degree of guidance, which may be done using a remote control or
with a computer interface. Robots can be autonomous, semi-autonomous or remotely
controlled. Robots have evolved so much and are capable of mimicking humans that they
seem to have a mind of their own.
An important aspect of a successful robotic system is the Human-Machine interaction.
In the early years the only way to communicate with a robot was to program which required
extensive hard work. With the development in science and robotics, gesture based recognition
came into life. Gestures originate from any bodily motion or state but commonly originate
from the face or hand. Gesture recognition can be considered as a way for computer to
understand human body language. This has minimized the need for text interfaces and GUIs
(Graphical User Interface). Gesture recognition technologies are much younger in the world of
today. At this time there is much active research in the field and little in the way of publicly
available implementations.
Several approaches have been developed for sensing gestures and controlling robots.
Glove based technique is a well-known means of recognizing hand gestures. It utilizes a
sensor attached to a glove that directly measures hand movements.
A Gesture Controlled robot is a kind of robot which can be controlled by hand gestures
and not the old fashioned way by using buttons. The user just needs to wear a small transmitting
device on his hand which includes a sensor which is an accelerometer in our case. Movement of
the hand in a specific direction will transmit a command to the robot which will then move in a
specific direction. The transmitting device includes a Comparator IC for assigning proper levels
to the input voltages from the accelerometer and an Encoder IC which is used to encode the four
bit data and then it will be transmitted by an RF Transmitter module.
At the receiving end an RF Receiver module will receive the encoded data and decode it by
using a decoder IC. This data is then processed by a microcontroller and passed onto a motor
driver to rotate the motors in a special configuration to make the robot move in the same
direction as that of the hand.
CHAPTER 1
1.1 THEORY
Gesture recognition technologies are much younger in the world of today. At this time there is
much active research in the field and little in the way of publicly available implementations.
Several approaches have been developed for sensing gestures and controlling robots. Glove based
technique is a well-known means of recognizing hand gestures. It utilizes a sensor attached to a
glove that directly measures hand movements.
A Gesture Controlled robot is a kind of robot which can be controlled by hand gestures and not
the old fashioned way by using buttons. The user just needs to wear a small transmitting device on
his hand which includes a sensor which is an accelerometer in our case. Movement of the hand in
a specific direction will transmit a command to the robot which will then move in a specific
direction. The transmitting device includes a Comparator IC for assigning proper levels to the
input voltages from the accelerometer and an Encoder IC which is used to encode the four bit data
and then it will be transmitted by an RF Transmitter module.
At the receiving end an RF Receiver module will receive the encoded data and decode it by using
a decoder IC. This data is then processed by a microcontroller and passed onto a motor driver to
rotate the motors in a special configuration to make the robot move in the same direction as that
of the hand.
Accelerometer
Decoder
MCU
Comparator
RF Receiver
Motor Driver
Encoder
RF Transmitter
Motors
PIN NO.
SYMBOL
FUNCTION
ST
GND
VCC
Figure 3. LM324 IC
PIN NO.
SYMBOL
FUNCTION
Output 1
Output of 1stcomparator
Input 1-
Input 1+
VCC
Input 2+
Input 2-
Output 2
Output 3
Input 3-
10
Input 3+
11
Ground
Ground(0V)
12
Input 4+
13
Input 4-
14
Output 4
12
Figure 4. PT2262 IC
Table 3. Pin description for PT2262
PIN NO.
SYMBOL
FUNCTION
1-8
A0-A7
Address pins
Vss
Ground pin
13-10
D0-D3
Output pins
14
TE
15-16
Osc1-Osc2
17
Dout
18
Vcc
5V supply voltage
Radio frequency (RF) is a rate of oscillation in the range of about 3 KHz to 300 GHz, which
corresponds to the frequency of radio waves, and the alternating currents which carry radio
signals.
Although radio frequency is a rate of oscillation, the term "radio frequency" or its abbreviation
"RF" are also used as a synonym for radio i.e. to describe the use of wireless communication
as opposed to communication via electric wires
The RF module is working on the frequency of 315 MHz and has a range of 50-80 meters.
Figure 5. RF Transmitter
Figure 6. RF Receiver
PIN
FUNCTION
VCC
5V supply
GND
Ground pin
Data
Ant
11
PIN
FUNCTION
VCC
5V supply
GND
Ground Pin
Data
Ant
12
Figure 7. PT2272 IC
Table 6. Pin description for PT2272
FUNCTION
1-8
A0-A7
Address pins
Vss
Ground pin
13-10
D0-D3
Output pins
14
Din
Input of RF
15-16
Osc1-Osc2
17
VT
18
Vcc
5V supply voltage
12
1.1.7MICROCONTROLLER (AT89C51)
The processing is the most important part of the robot. Till now we get the data from the decoder.
Based on that data decisions have to be made. So here the role of microcontroller comes up. We
used a microcontroller for our robot to give it a decision capability. Our microcontroller is made
up by Atmel and the product name is AT89C51.
Port 1 works as an input port while Port 2 is working as output port for our program.
13
As seen in the image, the circuit has four switches A, B, C and D. Turning these switches ON
and OFF can drive a motor in different ways.
14
1.1.9 DC MOTORS
A machine that converts DC power into mechanical power is known as a DC motor. Its operation
is based on the principle that when a current carrying conductor is placed in a magnetic field, the
conductor experiences a mechanical force.
DC motors have a revolving armature winding but non-revolving armature magnetic field and a
stationary field winding or permanent magnet. Different connections of the field and armature
winding provide different speed/torque regulation features. The speed of a DC motor can be
controlled by changing the voltage applied to the armature or by changing the field current.
15
16
17
18
19
20
CHAPTER 2
2. MICROCONTROLLER CODES
;;;;;;;;;gesture based robot;;;;;;;;;;
Org 00h
mov p1,#offh
movp2,#00h
start:mov a,p1
anl a,#0fh
;;;;;;;;;;;For stopping;;;;;;;;;;;;;
Cjne a,#0ch,nxt
Clr p2.0
Clr p2.1
Clr p2.2
Clr p2.3
;;;;;;;;;;;;For moving forward;;;;;;;;
nxt:cjne a,#08h,nxt1
setb p2.0
setb p2.2
Clr p2.1
Clr p2.3
;;;;;;;;;;;For reverse;;;;;;;;;;;;;;
nxt 1:cjne a,#04,nxt2
setb p2.3
setb p2.1
clr p2.2
clr p2.0
21
22
CHAPTER 3
3. OUTPUT
We achieved our objective without any hurdles i.e. the control of a robot using gestures. The robot
is showing proper responses whenever we move our hand. Different Hand gestures to make the
robot move in specific directions are as follow:
The robot only moves when the accelerometer is moved in a specific direction. The
valid movements are as follows:
Table 7. Accelerometer orientation
DIRECTION
ACCELEROMETER ORIENTATION
Forward
+y
Backward
-y
Right
+x
Left
-x
Stop
Rest
24
25
CHAPTER 4
4.1.1 SOFTWARE
We targeted to choose a language that is easy to understand and program. So we chose assembly
language for our project. Assembly language is the basic language of microcontrollers. Although
its not user friendly in terms of programming but still one can learn it quickly.
4.1.2 HARDWARE
We chose accelerometer as the sensing device because it records even the minute movements.
We could also have completed our project using Arduino but chose microcontroller instead
because its cost is low and is easily available everywhere. There are a number of dc geared
motors available but the ones we chose are capable of supporting loads up to 6kgs.
4.1.3 EXPENSES
This project is quite cost effective. The components used are easily available in the market apart
from accelerometer, RF modules and the motors. These components are quite cheap as compared
to the motors which are the only expensive part in our whole project. But these particular motors
are capable of providing support to loads up to 6kgs which is what we wanted.
26
Table 8. Expenses
S. NO
COMPONENT
AMOUNT RATE ( )
COST ( )
15
30
30
30
1uF Capacitor
10
Accelerometer (ADXL335)
159
159
Comparator IC (LM324)
25
25
Encoder IC (PT2262)
200
200
RF Module (Rx/Tx)
199
199
10
LED
11
12
Decoder IC (PT2272)
200
200
13
Microcontroller (AT89C51)
85
85
14
10
10
15
33pF Capacitor
16
110
110
17
1N4007 Diode
18
9V
20
40
19
DC Gear Motors
169
338
20
Base
300
Total
1756
27
4.2. APPLICATION
Gesture control can be used in different areas such as in healthcare field that is wheelchair
control for handicapped patients and also for controlling hospital beds.
It can also be used in industrial section such as controlling the robotic arm with our gesture
instead of using the joystick or any other controlling device. We can also control humanoid robot
using hand gesture
28
4.3. LIMITATION
The on-board batteries occupy a lot of space and are also quite heavy.
Secondly, as we are using RF for wireless transmission, the range is quite limited; nearly 5080m.
Thirdly, an on-board camera can be installed for monitoring the robot from faraway places. All
we need is a wireless camera which will broadcast and a receiver module which will provide live
streaming.
29
30
References
[1] Waldherr, S., Thrun, S., and Romero, R., A Gesture based interface for Human-Robot
Interaction, Kluwer Academic Publishers, Netherland, 2000.
[2] Liu, T., Guo, H., and Wang, Y., A new approach for color-based object recognition with
fusion of color models, Congress on Image and Signal Processing Conference, Sanya-China,
vol. 3, pp. 456-460, May 2008.
[3] Wang, B., and Yuan, T., Traffic Police Gesture Recognition using Accelerometer, IEEE
SENSORS Conference, Lecce-Italy,pp. 1080-1083,Oct. 2008.
[4] Lalanne, T., and Lempereur, C., Color recognition with a camera: a supervised algorithm for
classification, IEEE Southwest Symposium on Image Analysis and Interpretation, TucsonArizona, pp. 198- 204, April 1998.
[5] Available: http://en.wikipedia.org/wiki/Gesture_recognition.
[6] Cannan, J. and Hu, H., Human-Machine Interaction (HMI): A Survey.[Online]. Available:
http://www. dces.essex.ac.uk/staff/hhu/Papers/CES-508%20HMI-Survey.pdf
[7] Das, S., Toya, L., Green, Perez, B., and Murphy, M. M., Detecting User Activities using the
Accelerometer on the Smartphone, Team for Research in Ubiquitous Secure Technology REU
Research Program, July 2010.
[8] Aroca, R. V., AntnioPricles B. S. de Oliveira, and Gonalves, L. M. G., Towards Smarter
Robots With Smartphone, 5th workshop in Applied Robotics and Automation, Bauru-Brazil,
June 2012.
[9] Song, M., Kim, B., Ryu, Y., Kim, Y., and Kim, S., A design of real time control robot
system using android Smartphone The 7th International Conference on Ubiquitous Robots and
Ambient Intelligence (URAI), Busan Korea, Nov. 2010.
[10] Shilpa, V., Pradeep, H. S., and Kurian, M. Z., The Symbian Robot,International Journal of
Computer Science and Informatics (IJCSI), Vol-1,Issue-3.
[11] M. Klingmann, Accelerometer-Based Gesture Recognition with the iPhone, Goldsmiths
University, MSc in Cognitive Computing, London,September 2009.
[12] Gobel, S., Jubeh, R., Raesch, S. L., and Zundorf A., Using the Android Platform to
control
Robots,
Kassel
University
Germany.[Online].Available:
www.innoc.at/fileadmin/user_upload/_temp_/RiE/.../65.pdf
13] Do, H. M., Mouser, C. J., and Sheng, W., Building a Telepresence Robot Based on an
opensource, ASCC Lab, Oklahoma State University USA, Dec. 2011
31