SSCET 1

Technical paper presentation BRAINGATE

ABSTRACT: The mind-to-movement system computer thoughts that using is a allows only a his quadriplegic man to control a scientific e%tend

SYSTEM
The down $Brain about Gate$ one

(Application of human computer interaction)

contains tiny spi"es that will millimetre into the brain after being implanted beneath the s"ull,monitoring from a small the activity of group

milestone. It was reached, in large part, through the brain gate system. This system has become paralyzed. a boon The to the Gate Brain

neurons.It will now be possible for a patient with spinal cord in#ury to produce brain signals that relay the intention of moving the paralyzed limbs,as signals electronic operate to an implanted These devices sensor,which is then output as impulses. mechanical impulses enable the user to with the help of a computer cursor. &atthew 'agle,a ()year-old &assachusetts man with a severe spinal cord in#ury,has been paralyzed from the nec" down since (**+.,fter ta"ing part in a clinical trial of this system,he has opened email,switched Tchannels,turned on lights..e even moved a robotic hand from his wheelchair. This

ystem is based on !yber "inetics platform technology to sense,transmit,analyze The is principle that with brain of and operation ystem brain are apply the language of neurons. behind the Brain Gate intact signals function,

generated even though they are not sent to the arms, hands and legs.The signals are interpreted and an translated alternate into Brain cursor Gate movements, offering the user pathway to control a computer with thought,#ust as individuals who have the ability to move their hands use a mouse.

SSCET 2

mar"s the first time that neural movement signals have been recorded and decoded in a human with spinal cord in#ury.The system is also the first to allow a human to control his surrounding environment using his mind. How does the brain control motor function/ The brain is 0hardwired0 with connections, which are made by billions of neurons that ma"e electricity whenever they are stimulated. The electrical patterns are called brain waves. 'eurons act li"e the wires and gates in a computer, transmitting gathering and electrochemical

body to the central nervous system. 1eceptors sense things li"e chemicals, light, and sound and encode this information into electrochemical by the signals sensory by transmitted everything

neurons. ,nd interneurons tie together connecting the various neurons within the brain and spinal cord. The part of the brain that controls motor s"ills is located at the ear of the frontal lobe. .ow communication contain embedded does this happen/ sensors

&uscles in the body$s limbs called muscle spindles that measure the length and speed of the muscles as they stretch and contract as you move. 2ther respond sensors in the s"in to stretching and

signals over distances as far as several feet. The brain encodes information not by relying on single spreading rapidly neurons, it but by large new carry across to

pressure. 3ven if paralysis or disease damages the part of the brain that processes movement, the brain still ma"es neural signals. They$re #ust not being sent to the arms, hands and legs. , technique called uses brain neurofeedbac" scalp to translate

populations of neurons, and by adapting &otor circumstances. neurons signals from the central nervous system to the muscles, s"in and glands of the body, while sensory neurons carry signals from those outer parts of the

connecting sensors on the

SSCET 3

waves into information a person can learn from. The sensors register different frequencies of the signals produced wave whether in the brain. indicate is or These changes in brain patterns someone

ystem and a cursor is shown to the user on a computer screen that provides an alternate 0BrainGate pathway0. The user can use that cursor to control the computer, #ust as a mouse is used.0

concentrating

suppressing his impulses, or whether he is rela%ed or tense. NEURO ROSTHET!C "E#!CE: , neuroprosthetic device "nown as Braingate converts brain activity into computer commands. , sensor is implanted on the brain, and electrodes are hoo"ed up to wires that travel to a pedestal on the scalp. 4rom there, a fiber optic cable carries the brain activity computer. R!NC! $E: "The principle of data to a nearby

operation of the BrainGate 'eural Interface ystem is that with intact brain function, neural signals are generated even though they are not sent to the arms, hands and legs. These signals are interpreted by the

SSCET 4

Brain%ate is a brain implant s&stem de'eloped b& the bio(tech con-unction "epartment Uni'ersit&. was those who The to ha'e compan& with the of !urrently the chip uses +** hair-thin electrodes that $hear$ neurons firing in specific areas of the brain, for e%ample, the area that controls arm movement. translated The into activity is electrically de'ice help lost C&ber)inetics in *++, in

Neuroscience at Brown desi/ned

control of their limbs0 or other bodil& functions0 such as patients with am&otrophic cord in-ur&. into lateral The the sclerosis 1A$S2 or spinal computer chip0 which is implanted patient and con'erts the intention of the user into computer commands.

charged signals and are then sent and decoded using a program, which can move either a robotic arm or a computer cursor. ,ccording to the three system. confirmed in#ury, !yber"inetics$ patients The that website, been has have company one

implanted with the BrainGate patient has

5&att 'agle6 has a spinal cord whilst another advanced ,7 . In addition to real-time analysis of neuron patterns to relay movement, the Braingate array NEURO CH! : is also capable of recording electrical data for later analysis. , potential use of this feature would be for a neurologist to study seizure

SSCET 5

patterns epilepsy.

in a patient with

removing

unnecessary

frequency bands, averaging the current brain activity level, transforming scalp potentials . Band Alpha 1_2 5( rh&th m Beta 1_2 Theta 1_2 "elta 1_2 the and measured to corte% denoising. potentials with a range of and conditions tates.

Braingate is currently recruiting patients neuromuscular neurodegenerative 8nited

for pilot clinical trials in the

4requency bands of the 33G : 4requency ;.z< =-+( @-++ +A -B* A-C DB ,mplit- 7ocation -ude ;_V< +* -+)* 2ccipital> ?arietal regions varies ?recentral> ?ostcentra l regions () typically frontal regions varies varies varies varies

"ETECT!ON: 3OR4!N%: 2peration of the B!I system is not simply listening the 33G of user in a way that let9s tap this 33G in and listen what happens. The user usually generates some sort of mental activity pattern that is later detected and classified. RE ROCESS!N%: The raw 33G signal requires some preprocessing before the feature e%traction. This preprocessing includes The detection of the input from the user and them translating it into an action could be considered as "ey part of any B!I system. This detection means to try to find out these mental tas"s from the 33G signal. It can be done in time-domain, e.g. by comparing amplitudes of the 33G and in frequency-domain. This involves usually digital signal processing for sampling and

SSCET 6

band pass filtering the signal, then calculating these time -or frequency domain features and then classifying them. These classification algorithms include simple comparison of amplitudes linear and nonlinear equations and artificial neural networ"s. By constant feedbac" from user to the system and vice versa, both partners gradually learn more from each other and improve the overall performance. CONTRO$: The final part consists of applying the will of the user to the used application. The user chooses an action by controlling his brain activity, which is then detected and classified to corresponding action. 4eedbac" is provided to user by audio-visual means e.g. when typing with virtual "eyboard, letter appears to the message bo% etc. TRA!N!N%: The training is the part where the user adapts to the B!I begins system. with This very with training simple mental

activity which is used to relay the information to the computer. &otivation,

frustration, fatigue, etc. apply also here and their effect should be ta"en into consideration when planning the training procedures. B!O 6EE"BAC4: The definition of the biofeedbac" is biological information which is returned to the source that created it, so that source can understand it and have control over it. This biofeedbac" in B!I systems is usually provided by visually, e.g. the user sees cursor moving up or down or letter being selected from the alphabet.

A boon to the paral&7ed (Brain %ate Neural !nterface S&stem The &assachusetts first man patient, with a

&atthew 'agle, a ()-year-old severe spinal cord in#ury, has

e%ercises where the user is familiarized

SSCET 7

been paralyzed from the nec" down since (**+. 'agle is unable to move his arms and legs after he was stabbed in the nec". Euring )C sessions, at 'ew 3ngland and 'agle learned inai .ospital !enter, to open 1ehabilitation

simulated e-mail, draw circular shapes using a paint program on the computer and play a simple videogame, 0neural ?ong,0 using only his thoughts. .e could change the channel and ad#ust the volume on a television, even while conversing. .e was ultimately able to open and close the fingers of a prosthetic hand and use a robotic limb to grasp and move ob#ects. Eespite a decline in neural signals after few months, 'agle remained an active participant in the trial and continued to aid the clinical team in producing valuable feedbac" concerning the BrainGateF technology. NA%$E8S STATE9ENT: GI can$t put it into words. It$s #ustHI use my brain. I #ust thought it. I said, 0!ursor go up to the top right.0 ,nd it did, and now I can control it all over the screen. It will give me a sense of independence.I

SSCET 8

OTHER A

$!CAT!ONS:

neuronal firings to reproduce images seen by cats. The team used an array of electrodes embedded in the thalamus 5which integrates all of the brain9s sensory input6 of sharpeyed cats. 1esearchers targeted +CC brain cells in the thalamus lateral geniculate nucleus area, which decodes signals from the retina. The cats were shown

1ats

implanted

with

eight short movies, and their neuron firings were recorded. 8sing mathematical filters, the researchers decoded the signals to generate movies of what the cats saw and were able to reconstruct recognisable scenes and moving ob#ects.

B!Is in Theodore Berger$s e%periments. everal laboratories have managed to record signals from mon"ey and rat cerebral corte%es in order to operate B!Is to carry out movement. &on"eys have navigated computer cursors on screen and commanded robotic arms to perform simple tas"s simply by thin"ing about the tas" and without any motor output. 2ther research on cats has decoded visual signals. Garrett tanley$s recordings of cat vision using a B!I implanted in the lateral geniculate nucleus 5top row: original imageJ bottom row: recording6 in +@@@, researchers led by Garrett tanley at .arvard 8niversity decoded

In the +@=*s, ,postolos Georgopoulos at Kohns .op"ins 8niversity mathematical found a relationship

between the 5based on a cosine function6. .e also found that dispersed groups of neurons in different areas of the brain

SSCET 9

collectively controlled motor commands but was only able to record the firings of neurons in one area at a time because of technical limitations imposed by his equipment.;A< There has been rapid development in B!Is since the mid-+@@*s.;)< everal groups have been able to capture comple% brain motor centre signals using recordings from neural ensembles 5groups of neurons6 and use these to control e%ternal devices, including research groups led by 1ichard ,ndersen, Kohn Eonoghue, ?hillip Lennedy, &iguel 'icolelis, and ,ndrew chwartz.

the

feedbac"

loop

and

reproduced mon"ey reaching and grasping movements in a robot arm. Mith their deeply cleft and furrowed brains, rhesus mon"eys are considered to be better models for human neurophysiology than owl mon"eys. The mon"eys were trained to reach and grasp ob#ects on a computer screen by manipulating while a #oystic" corresponding

movements by a robot arm were hidden.The mon"eys were later shown the robot directly and learned to control it by viewing its movements. The B!I used velocity predictions to control reaching movements and simultaneously predicted hand gripping force. 2ther labs that develop B!Is and algorithms that decode neuron signals include Kohn Eonoghue from Brown 8niversity, ,ndrew from the ?ittsburgh researchers and were chwartz of 1ichard able to

"ia/ram

of

the

BC!

de'eloped b& 9i/uel Nicolelis and colle/ues for use on Rhesus mon)e&s 7ater e%periments by 'icolelis using rhesus mon"eys, succeeded in closing

8niversity

,ndersen from !altech. These produce wor"ing B!Is even though they recorded signals from far fewer neurons than

SSCET 10

'icolelis

5+)NB*

neurons group rhesus

Biomedical

Instrumentation, signal

versus )*N(** neurons6. Eonoghue$s reported training

&icroelectronics,

processing, ,rtificial 'eural 'etwor"s and 1obotics which has developments. implemented overwhelming .ope for these many

mon"eys to use a B!I to trac" visual targets on a computer screen loop with B!I6.;+*< or without chwartzss$s assistance of a #oystic" 5closedgroup created a B!I for threedimensional trac"ing in virtual reality and also reproduced B!I control in a robotic arm. CONC$US!ON: The idea of moving robots or prosthetic devices not by manual control, but by mere Gthin"ingI 5i.e., the brain activity of human sub#ects6 has been a fascinated approach. &edical cures are unavailable for many forms of neural and muscular by paralysis. is a The strong B&I enormity of the deficits caused paralysis to motivation solutions. pursue

systems will be effectively Biomedical applications. RE6ERENCES +6Graun, !hristian J Ger"en, Kens J Ketter, .ans-!hristian J Laonig,Merner !entred 1esearch Technology 3uropean Eigital 7ibrary 3!E7 and for J 1eiterer, &etadata (**): Eigital on ,dvanced .arald: &edio-is - a 8serBrowser.In:

7ibraries, ?roceedingsof the @th !onference 7ibraries, pringer

-erlag, eptember (**). (6;.eilig u. a. (**=< .eilig, &athias J Eemarmels, &ischa J Lonig, Merner ,. J Ger"en, Kens J 1e%hausen, Ketter, 1eiterer, .arald: &edio-is: visual information see"ing in digital libraries. In: ,-I $*=: ?roceedings ofthe wor"ing ,dvanced conference visual on ebastian J J .ans-!hristian

o this idea helps

many patients to control the prosthetic devices of their own by simply thin"ing about the tas". This technology is well supported by the latest fields of

interfaces.

SSCET 11

'ew

Oor",

'O,

8 ,

,!&,&ai (**=,

. A@*PA@+.

B6http:>>portal.acm.org>citation. cfm/idQ+B=))R@.+B=)RC+. P I B' *-@C=-R*))=-+A+-) A6;.uffman (**=< .uffman, cott: Google. Mebsite. eptember(**=.P817 http:>>googleblog.blogspot.com> (**=>*@> search-evaluation-atgoogle.html earch evaluation at