MURI Project Proposal Form Section I: Proposal Cover Page

Date of submission: 23 August 2013 Proposed project title: Training the Extended Voltage Manifold Computer Principle Mentor Name: Ken Yoshida Phone number: 274 9714 Department: Biomedical Engineering Co-mentor Name: Paul Salama Phone number: 278 1682 Department: Electrical Engineering Co-mentor Name: Phone number: Department:

Title: Associate Professor Email: yoshidak@iupui.edu School: Engineering and Technology

Title: Professor Email: psalama@iupui.edu School: Engineering and Technology

Title: Email: School:

Please note that preference will be given to projects that include mentors from multiple disciplines.

MURI Mentors Project Proposal Form, Updated: 9_10_12

Section II: Student Request Page

Total number of students requested: 4 (Note: The total number of students must exceed by two the number of mentors) Total Number of freshmen and/or sophomores to be recruited: 1 (Note: Preference will be given to projects that include at least one freshman and/or sophomore) Disciplines or majors of students (preference will be given to projects that include at least two disciplines or majors): Biomedical Engineering (bioinstrumentaiton), Computer Engineering, Electrical Engineering, Applied Mathematics, Applied Statistics, Applied Physics Skills expected from students: Signals and Systems, Matlab, Stochastic Systems, Physics Electricity, Calculus Multivariate, Linear Algebra Names of students you request to work on this project. (Mentors are invited to recommend students that they would prefer to work on the proposed project. Please provide an email address and a rationale; for example, a student may have an essential skill, may already be working on a similar project, or may be intending to apply to graduate school to pursue the same area of research.) The Center for Research and Learning will consider the students requested below, but cannot guarantee placement of specific students on teams. Name of Student: 1)_________________ 2)_________________ 3)_________________ 4)_________________ 5)_________________ 6)_________________ Students Email: ______________ ______________ ______________ ______________ ______________ ______________ Rationale: ________________________ ________________________ ________________________ ________________________ ________________________ ________________________

MURI Mentors Project Proposal Form, Updated: 9_10_12

Section III: Body of Proposal

(A maximum of 5 pages is allowed for answers to questions 1-11.) 1) What are the research objectives for the proposed project? 2) What specific research question(s) will your proposed project address? 3) What is the significance of this research? 4) Why does this proposal offer a good opportunity for undergraduate researchers to gain substantive research skills? 5) What research methodology and specific tasks will students and mentors undertake? 6) What plan has been designed to ensure effective communication with all co-mentors and undergraduate researchers on the MURI team? 7) What measureable outcomes and benefits will this research provide to the students, you and your co-mentor(s), your department, and your school? 8) What is the timeline for the major tasks associated with this proposal? 9) Please provide a rationale for your budget request. (NOTE: The maximum budget allowance is $2,000 for equipment and/or supplies needed for the research team. Generally speaking, expenditures for computers and/or travel are not approved by the review committee at this time due to financial constraints.) 10) Please describe your plan for sustaining your research beyond the funding that MURI is able to provide. (For example, please list other external grants that have been or will be submitted as a follow-up to your MURI funding.) 11) Please identify any areas relevant to risk management. All university policies with respect to research must be followed. The usual risk management assurances must be provided where appropriate (animal use, radiation safety, DNA, human subjects protocols) in accordance with the university policies. No funds may be released without risk-management assurances, where needed. Project proposals without required compliance approvals will be reviewed but the funds will not be released until approval is given by the university. Further information on risk management is available from http://researchadmin.iu.edu/cs.html

MURI Mentors Project Proposal Form, Updated: 9_10_12

Section III: Body of Proposal Overview and Objectives

Electronic analog computers were the primary computing platform in the first half of the 20th century. They use the intrinsic values of electronic components to continuously implement differential equations. Their prime advantage lies in their relative simplicity, speed and low power consumption. In effect, the preamplifier and analog filters used in the head stage and signal conditioning modules of bioelectric amplifiers are simple electronic analog computers. In the 2nd half of the 20th century, they have largely been supplanted by digital electronic computers due to their numerical accuracy, reconfigurability through programming, that overcame some of the limitations of the early electronic analog computer. These early computers were sensitive to noise and temperature. The precision of the result relied on the stability of the value of the electronic components, which changed with use. Moreover, programming of the computer required physical hardware additions and structural changes. Thus, they were difficult to program and maintain, and could not be implemented as a general purpose configurable computing platform. inally, given that physical components and circuitry needed to be altered to program the computer, they were difficult to scale down in si!e. The present pro"ect aims to address this technological gap by advancing a hybrid technology that leverages the nearly instantaneous computational power of potential manifolds with digitally programmable, sampled time system# the e$tended analog computer %E&'(. In preliminary collaborative wor), *rs +oshida and Mills elucidated the fundamental equations governing the E&' and developed a simplified E&' framewor) which we call the E$tended ,oltage Manifold 'omputer %E,M'(. -ith E,M' modules, the means to implement arbitrary finite impulse response and infinite impulse response filters was further developed. The present pro"ect aims to further develop the E,M', focusing upon methods to train E,M' modules using automatic machine learning techniques. To bring focus to the pro"ect, development of the E,M' will be using signals originating from neuroprosthetic electrode arrays. &lthough limited to a specific application and class of problem the application is identical to and generali!es to processing of other bioelectrically active tissues that rely on interpretation of single unit activity. such as intracortical /012/31,dorsal root ganglion /41, /51, and s)eletal muscles /61 signals. The E,M' addresses a )ey missing but necessary component for the translation of advanced multi7channel neuro 8 muscular techniques outside of the laboratory to mobile neuroprosthetic applications. a downscale7able means to decipher and process the raw neural signal. 'urrent conventional methods involving *9: lac) sufficient processing power and are not amenable to the massively parallel and relatively time7critical tas) this problem presents. This project aims to address this problem by applying the EV ! to this tas"# Specific $im: E$plore automatic machine learning methods to develop a robust automatic means to train E,M' modules and networ)s to perform neural unit spi)e detection and classification.

The E$tended &nalog 'omputer In 0;;< after =ee &. >ubel analy!ed the decision7ma)ing processes in the brain /;1, he created a new theoretical model of multi7dimensional sensory inputs in uncertain decision processes that he called the E$tended &nalog 'omputer %E&'( /001. The "ustification that >ubel gave, of a baseball player who sees, runs toward and catches a long fly ball on a windy day, is outside the scope of 9hannon?s @eneral :urpose &nalog 'omputer %@:&'(. In 0;;3 Mills began to build restricted versions of the E&'. It was Figure 1: An implemen a ion o! he "# ended Analog $ompu er %&e! '( found to represent a new computational )he de*i+e is +on!igured hrough he US, por o! he no e-oo.( )he paradigm that required new techniques to +urren densi / dis ri-u ion and mani!old po en ials al er as sour+es or apply. Aur e$perience also indicates that sin.s are added or reposi ioned( "a+h o! he hree +ases sho0n here silicon ,=9I implementations of the E&' represen di!!eren solu ions o a pro-lem posed o he "A$( have the potential to deliver not tera =A:s, but tera:*Es, the solution to trillions of partial differential equations per second /001.
The E&' prototype developed by Mills and co7wor)ers is deceptively simple. It is a small seven7inch square board. The top of the E&' contains a matri$ of 23 current 8 voltage sources and sin)s, the input8output points of

2013 IUPUI MURI proposal Yoshida & Salama

the device arranged on a conductive sheet or thin7film % ig 0(. Each point is digitally programmable to source or sin) current, or measure the sheet potential or current. These are driven by an on7board microprocessor that receives configuration commands through a B9C port. The conductive sheet of the E&' can be connected to a variety of conductive materials. in our current prototypes plastic foam and conductive polymers are used. ,=9I sheets and three7dimensional colloids have also been used /021. The operation of the E&' is inherent in the mathematical principles of natural materials, which are selectively enhanced or inhibited using the continuous logic of =u)asiewic! /0<1. Theoretically, functions including arithmetic, inversion, integration, interpolation, ordinary and partial differentiation, limits, and minor error correction are possible. This computational power is so comple$ that it requires an automated search of the E&' function space to locate. :arado$ically, the E&' is so well adapted to evolved solutions that they may be found using particle swarm optimi!ation %:9A( /0D1, /031 in a few iterations. The E&' was developed to solve multivariate spatial problems. 9olutions to the problems are solved by ad"usting the location and numbers, positions and amplitudes of current sources in"ecting or sin)ing current onto a conductive space using machine learning optimi!ation techniques such as :9A. The changes in location of sources and sin)s ad"ust how the current distributes itself in the space, which come as solutions to :oissonEs equation. Ance configured, the solutions to the problems posed to the E&' form nearly instantaneously, as soon as the current density distribution forms on the conductive sheet. Fon7linearities can be further added by recursion of outputs bac) onto the manifold sheet through logic functions. The E&' was developed from arrays of analog logic circuits %=u)asiewic! =ogic &rrays, ==&s(, which, in turn, are e$tensions of resistive meshes. or e$ample, ==&s can act as retinas that detect edges moving hori!ontally, vertically and diagonally, something that a resistive mesh cannot do inherently. They, however, were not designed to directly ta)e inputs that are a function of time, such as raw nerve recordings.

The E$tended ,oltage Manifold 'omputer %E,M'( The voltage manifold and spatial calculations There are four possible modes in which >ubel and MillsE E&' can operate# voltage input to voltage manifold, current input to current density manifold, voltage input to current density manifold and current input to voltage manifold. %e restricted o&r research to the c&rrent inp&t to voltage manifold case' and refer to E$!s &sing this restricted case as the E(tended Voltage anifold !omp&ter )EV !*# Enforcing this limitation bounds the E&' in two important ways. 0( The inputs and the outputs of the E,M' do not alter the total conductivity of the space. This restricts the space to a constant passive conductivity defined by the electrical properties of the media. 2( The addition of input or output points does not alter the current density distribution or potential manifold generated by any other input or output. Thus, each source and the voltage manifold it creates in the media becomes independent of the manifold of any other source.
The E,M' can be described as a finite number of discrete, time varying current sources and a finite array of discrete, distributed measurement points distributed in a conductive space. &t any given moment in time, the potential measured by the any given measurement point is the sum of the potentials resulting from each of the active current sources. Each measurement site can furthermore be described as a point in an infinitely volume conductor, and the potential it sees as simply the sum of the by %eq.0(, where v%t( is the measured potential at time t. in%t( is the current at the n7th source. G is the conductivity of the volume conductor. and 1n is the distance of the n7th current source at a specific point in the manifold space. or a uniform volume conductor, this e$pression becomes strictly a function of the current at each node and a constant inversely proportional to the distance between the source and the point in space, or v ( t )= bn i n ( t ) %eq.2( where -n is a constant related
n =0 N1

to distance and the conductivity of the volume. This equation also describes the relationship of a set of current sources and the potential measured on the manifold at a particular location in the conductive space. The potential is the sum of the input current functions multiplied by a constant for each current source that is defined by the distance between the current source and measurement point as shown in the left panel of ig 2. :ositive and negative weights are represented by defining two measurement points and ta)ing their difference. In the right panel of ig 2 the current source inputs above the dotted line have coefficients defined positive definite, while those below the dotted line have negative coefficients. Those points on the dotted line, the locus of points of equal distance between the measurement points ,0 and ,2 have !ero valued coefficients.

2013 IUPUI MURI proposal Yoshida & Salama

V 1, n V 2, n=

1 1 1 ( )i 4 r 1, n r 2, n n

Figure 2: Illus ra ion o! 0o sour+e sensor la/ou s ra egies !or he "2M$( ,o h panels sho0 s3uare uni!orm +ondu+ i*e shee s popula ed 0i h mul iple sour+es and one or 0o sensing poin s( )he le! panel is an illus ra ion o! e3(2( )he +oe!!i+ien !or ea+h inpu +on ri-u es o he po en ial seen a he de e+ ion poin -/ a !a+ or o! -i 0hi+h is in*ersel/ rela ed o he dis an+e ri( 4eigh s in he le! panel +an onl/ -e de!ined posi i*e de!ini e( 5ega i*e 0eigh s +an -e assigned -/ using a di!!eren ial measuring me hod sho0n in he righ panel(

Extension to time domain signals The original concept of the E&' too) the form of a general purpose spatial processor. :rocessing of real7 time functions in the time domain was not defined. & second modification of the E&' was defined and implemented /041 to ta)e one of the spatial dimensions of the E&' and use it to capture time varying data using a tapped delay line. The input data is sampled and presented through a transconductance amplifier and a cloc)ed array of transmission gates. These gates propagate the sampled data at each cloc) cycle, stored as an analog charge at each sample and hold gate. 9equencing the tapped delay lineEs gating sequence propagates the data of the sampled time instances down an analog first in first out % I A( ban) at a propagation velocity equal to the
sampling time delay. This is described by
v ( t )= bn i ( t n ) %eq.<(. where is the sampling interval and
n= 0 N1

constraining the input function to that of a single traveling wavelet. Each input current, in this case, is related to the input current at a previous point in time. Cy ma)ing each current source related to each other by integer multiples of a time delay, we have effectively traded a spatial dimension and assigned it to a time point. Fe$t, by regularly sampling time at a fi$ed rate, the continuous time is converted to discrete time and the equation becomes v ( m)= bn i ( mn)
n= 0 N 1

%eq.D(. This governing equation is identical to that of a inite Impulse

Figure 3: S+hema i+ ar+hi e+ ural represen a ion o! he "2M$ implemen ing a Fini e Impulse Response !il er %&e! ' or he more general 6ire+ !orm I FIR7IIR !il er %Righ '( )apped dela/ lines hold he presen and pas inpu and ou pu !un+ ion *alues8 0hi+h are rans!ormed o +urren and in9e+ ed in o he "2M$ +ondu+ i*e shee %sho0n in -lue'(

>esponse % I>( filter. More importantly, it has the implication that any arbitrary I> filter, limited only by the filter order and density of sources, can be defined on the E,M'. &rchitecturally, eq.D can be implemented by time

2013 IUPUI MURI proposal Yoshida & Salama

sampling the input waveform and passing the sampled waveform down a tapped delay line. Each delayed input is converted to a current through a transconductance buffer and in"ected into the E,M' conductive sheet at points to implement the desired coefficient. The sheet sums the potential manifold from each input current and the resulting potential is measured by the sensing point or differential measurement points. This architecture is shown in the left panel of ig <. Cy placing the tapped delay line on the output instead of at the input, and feeding bac) the values of the tapped delay line through transconductance amplifiers bac) into the voltage manifold space it is possible to implement an auto7regressive or Infinite Impulse >esponse %II>( filter. In combination with the I> circuit, a combined I>7II> filter in the *irect orm I can be constructed, as shown in the right panel of ig <. Thus, given these three implementations of the E,M', any arbitrary digital filter or transfer function can be implemented and deterministically configured.

$pproach
The preliminary wor) has developed methods to understand the voltage manifold and develop an architecture to implement linear filters with the E,M' platform. The concept of E,M' was validated using finite element method % EM( simulations and using a non7real7time hardware implementation of the E&'. They demonstrated that the theory that was developed accurately and precisely predicted and actual behavior of the physical device. -hen applied to a specific neural signal processing tas), they demonstrated signal processing steps for improving the signal to noise ratio and linear shape classification techniques can be implemented on the E,M'. However, these did not demonstrate the potential for computation speed or ta)e advantage of the families of solutions that e$ist on the E,M' manifold. The pro"ect will leverage *r 9alamaEs e$pertise in advanced signal processing and recursive optimi!ation methods to define the error space and e$plore automatic optimi!ation methods to locate the number and positions of measurement points needed. In general, the procedures ta)en will be the development of the theory of operation followed by computeri!ed finite element model simulations of the E,M' modules and algorithms. Feural recordings ta)en from the training data sets from the animal e$periments will be used to develop algorithms. Three sets of data will be defined. The raw multichannel recordings will comprise one set. Two other sets will be formed by using current methods to isolate the waveforms of single nerve units. Foise free templates of these units will be captured by spi)e triggered averaging clearly identifiable units to create sets of noise free unit templates. The total set of unit templates will then be divided randomly into two sets. The first set will be used to synthesi!e simulated multi7channel multi7unit nerve activity where the firing time instances of all units in the recording are )nown. Foise will be added by adding recordings of ambient noise made during the animal e$periments to simulate realistic nerve recordings. & second set of synthesi!ed recordings will be used to define the performance test set. Ance an algorithm is developed, they will be tested against a test data set. Two specific research problems were identified to develop networ)s of E,M' modules# 0( the development of methods to train the E,M' modules and 2( the development of strategies to reali!e input and output locations on the manifold sheets. These two problems are developed as &ims 0 and 2. $im +* E(plore a&tomatic machine learning methods to train EV ! mod&les and networ"s of EV ! mod&les to perform ne&ral &nit spi"e detection and classification# :/po heses: a' "2M$ modules +on!igured as shee s or ne 0or.s o! shee s +an de e+ and +lassi!/ single !i-er ner*e a+ i*i /( -' )he per!orman+e o! au oma i+all/ +on!igured "2M$ modules +an generali1e o mee or e#+eed he +lassi!i+a ion per!orman+e o! de erminis i+all/ +on!igured linear me hods( The E,M' module comprises of a set of input current sources and the set of output voltage measurement N 1 points. Each output voltage is governed by eq.0, or restated v ( x )= 1 i ( x ) . The output voltage is 4 j =1 r j j strictly a function of the sum of a constant weighting function defined by the Euclidean distance between each input and the output and the magnitude of each input current, and is described by a class of functions called radial basis functions %>C (. In the case of the E,M', the )ernel function is a simple hyperbolic function. More importantly, a class of neural networ) can be constructed using >C modules, the radial basis function networ) %>C F(. Thus multi7layer perceptron networ)s can be constructed by lin)ing multiple E,M' modules where each manifold sheet of the E,M' becomes a single layer in the >C F. Training of the >C F can be implemented using bac) propagation using a linear descent error operator /051, /061 but adaptation is needed to implement the algorithm for our )ernel function. Training the E,M'7>C F will involve recursively running finite element method % EM( simulations of E,M' modules as the algorithm modifies the locations of the input and

2013 IUPUI MURI proposal Yoshida & Salama

output points of a randomly initiali!ed the manifold sheet. >epetition of the process is necessary to ensure that a global minimum of the error function is reached. Ance a training algorithm is formali!ed, particle swarm optimi!ation %:9A( can be introduced to the training algorithm to increase the speed of training. Initially, single layer E,M'7>C Fs will be e$plored. Their performance compared against the deterministic linear methods %matched filter and :'&( and standard single layer linear perceptrons implemented in Matlab. These results will be used to hypothesis 0a. -e e$pect equal performance between the linear deterministic method, the linear perceptron and the single layer E,M'7>C F. Fe$t, the number number of layers and input sources will be increased to test the performance between two layer E,M'7>C Fs will be defined and trained. -e e$pect greater generali!ability and thus higher detection8classification performance with the networ) based methods. The MB>I team will develop machine learning techniques to automatically configure the E,M'. The 'omsol EM simulation tools will be used to e$plore and adapt 9warm and radial basis function networ) training techniques to automatically configure the E,M'. The in7sili+o solutions will be tested against a real7time implementation of the E,M'. The outcomes of this wor) will then be used to support a grant proposal to the F9 .

,-I Project

anagement

To facilitate communication between the co7mentors and the undergraduate researchers, an Ancourse pro"ect site will be requested and used as the pro"ect information repository and primary communication tool. The orum tool will be used as the official communication pathway and communication archive in the pro"ect. &ll participants will be required to enable forum notifications and watch for all threads and postings. The undergraduate researchers will be requested to assign < officers amongst themselves# a general pro"ect leader to coordinate management of the research activities, a pro"ect accounts manager to administer the research budget and purchases, and communications officer to act as the single point of contact for e$ternal communications. Ciwee)ly meetings with the co7mentors will ta)e place on Mondays and ridays during the pro"ect period. Monday meetings will be used to plan activities for the wee), while riday meetings will be used to report upon progress during the wee). The pro"ect is designed to develop and reinforce team group wor) in research. The participation in both parts of research, management and technical, will be imposed upon the group. The technical s)ills of computer programming, signals and systems, and biophysics will be reinforced and integrated within the conte$t of neural signal processing. These activities will aim to produce as deliverables a pro"ect report consisting of the technical and management activities in the pro"ect, and participation in the Bndergraduate >esearch *ay with a poster presentation of the pro"ect. -e will aim to publish the results of the research activities, initially as a conference paper at either the IEEE7EMC9 or CME9 meeting. &s with the previous MB>I pro"ect, it is anticipated that the preliminary wor) developed by the MB>I team will become the seed of a Masters or :h* thesis pro"ect. -e also hope to identify potential future candidates to ta)e graduate research positions for future pro"ects within the lab.

B&dget
The pro"ect involves programming and signal processing using Matlab and =ab,iew. >esearch licenses for these two software titles are requested to complete this pro"ect.
Software Title Matlab %base( 9ignal processing toolbo$ -avelet toolbo$ 9ystem Identification toolbo$ 'ontrol toolbo$ Aptimi!ation toolbo$ 'omsol 9ubscription :'C abrication Total !ost I000 I<0 I<0 I<0 I<0 I<0 I0,D00 ID00 ./'010 9tat 9tat 9tat 9tat 9tat 9tat So&rce Math 'enter Math 'enter Math 'enter Math 'enter Math 'enter Math 'enter 'omsol 9AI'

-is" management
This pro"ect will involve development of swarm and gradient descent training techniques for the E$tended &nalog Manifold 'omputer. &ll development will ta)e place in7sili+o or with a reali!ed benchtop prototype E&M' device. The wor) will not involve any animal wor), human sub"ects, pathogens, recombinant techniques, radiation or other ha!ards.

2013 IUPUI MURI proposal Yoshida & Salama

<

Section IV: -eferences

/01 /21 /<1 /D1 /31 /41 /51 /61 /;1 /001 /001 /021 /0<1 /0D1 /031 /041 /051 /061 :. J. 'ampbell, J. E. Kones, >. K. Huber, J. -. Horch, and >. &. Formann, L& silicon7based, three7dimensional neural interface# manufacturing processes for an intracortical electrode array.,M I""" )rans( ,iomed( "ng(, vol. <6, no. 6, pp. 5362546, &ug. 0;;0. &. Cranner, >. C. 9tein, E. ernande!, +. &oyagi, and >. &. Formann, L=ong7term stimulation and recording with a penetrating microelectrode array in cat sciatic nerve,M I""" )rans ,iomed"ng, vol. 30, no. 0, pp. 0D42035, Kan. 200D. &. Cranner and >. &. Formann, L& multielectrode array for intrafascicular recording and stimulation in sciatic nerve of cats,M ,rain Res,ull, vol. 30, no. D, pp. 2;<2<04, Mar. 2000. J. K. Atto, :. K. >ousche, and *. >. Jip)e, LMicrostimulation in auditory corte$ provides a substrate for detailed behaviors,M :ear(Res(, vol. 200, no. 022, pp. 0022005, *ec. 2003. *. K. &nderson, J. Fa"afi, 9. K. Tanghe, *. &. Evans, J. =. =evy, K. . Het)e, N. =. Nue, K. K. Oappia, and J. *. -ise, LCatch7fabricated thin7film electrodes for stimulation of the central auditory system,M I""" )rans ,iomed"ng, vol. <4, no. 5, pp. 4;<250D, Kul. 0;6;. +. &oyagi, >. C. 9tein, &. Cranner, J. @. :earson, and >. &. Formann, L'apabilities of a penetrating microelectrode array for recording single units in dorsal root ganglia of the cat,M =(5euros+i(Me hods, vol. 026, no. 022, pp. ;220, 9ep. 200<. *. K. -eber, >. C. 9tein, *. @. Everaert, and &. :rocha!)a, L=imb7state feedbac) from ensembles of simultaneously recorded dorsal root ganglion neurons,M =5eural "ng, vol. D, no. <, pp. 904629060, 9ep. 2005. *. arina, J. +oshida, T. 9tieglit!, and J. :. Joch, LMultichannel thin7film electrode for intramuscular electromyographic recordings,M =( Appl( Ph/siol( ,e hesda Md 1>?<, vol. 00D, no. <, pp. 6202625, Mar. 2006. =. &. >ubel, LThe brain as an analog computer,M =( )heor( 5euro-iol(, vol. D, no. 2, pp. 5<260, 0;63. =. &. >ubel, LThe E$tended &nalog 'omputer,M Ad*( Appl( Ma h(, vol. 0D, no. 0, pp. <;230, Mar. 0;;<. K. -. Mills, M. :ar)er, C. Himebaugh, '. 9hue, C. Jopec)y, and '. -eilemann, LPEmpty space? computes,M 2004, pp. 0032024. K. -. Mills, L:olymer processors,M Technical >eport T>360, *epartment of 'omputer 9cience, Bniversity of Indiana, 0;;3. K. -. Mills, LThe nature of the E$tended &nalog 'omputer,M Ph/s( 5onlinear Phenom(, vol. 2<5, no. ;, pp. 02<320234, Kul. 2006. >. Eberhart and K. Jennedy, L& new optimi!er using particle swarm theory,M pp. <;2D<. K. . Jennedy, >. '. Eberhart, and +. 9hi, S0arm in elligen+e. 9an rancisco# Morgan Jaufmann :ublishers, 2000. M. 9oliman, L*eveloping a neural signal processor using the e$tended analog computer,M M.9., Indiana Bniversity 7 :urdue Bniversity Indianapolis, Indianapolis, IF, 2002. 9. 'hen, '. . F. 'owan, and :. M. @rant, LArthogonal least squares learning algorithm for radial basis function networ)s,M I""" )rans( 5eural 5e 0or.s, vol. 2, no. 2, pp. <022<0;, Mar. 0;;0. :. ,. +ee and 9. 9. Hay)in, Regulari1ed radial -asis !un+ ion ne 0or.s@: heor/ and appli+a ions. Few +or)# Kohn -iley, 2000.

2013 IUPUI MURI proposal Yoshida & Salama

Section V: !vs2-es&mes
'urriculum vitae of Jen +oshida and :aul 9alama are attached.

Section VII: $ppendi( Past MURI Mentoring Activities

Title of Past MURI Project: Towards estimating the position of the leg using sensory information intercepted by neuroprosthetic electrodes Date Awarded: 9ummer 2002 Date Completed: 9ummer 2002 Description: The pro"ect aims to merge two lines of research ta)ing place within the Cioellab %*r +oshidaEs lab(# 0. *evelopment of a robotic end point effector 2. *evelopment of neural signal processing algorithms. The first phase of the research will concentrate on wor) with the robotic end7effector. The second phase of the research will concentrate on the analysis of the neural signal processing algorithm. To accomplish this, a multi7disciplinary team with interest in mechanics, signal processing, computer programming, neural electrophysiology, and rehabilitation is required. Student earning !utcomes: @roup management and learning. Mechanics of the leg, and measurement of all 4 mechanical *A s. :rogramming Matlab @BIs, digital signal processing using 9-T. Poster presentations: Title# Measurement of the =imb 9egment Mechanics of the =eg Bsing a >obotic Endpoint Effector *ate# Kuly 2002 9tudents Involved# Kimmy @. 'orcoran, *aniel =. rench, Eric >. -olf Title# @raphical Feural 9ignal :rocessing &nd &nalysis ramewor) or Electroneurograms *etected Cy Intrafascicular Electrodes *ate# Kuly 2002 9tudents Involved# Thawng!apum =ian, 9haoyu Qiao Title# Measuring the )inematics and biomechanics of the leg during endpoint manipulation *ate# Fov 2002 9tudents Involved# &lec -illard Title of Past MURI Project: *evelopment of a biofeedbac) testing platform for evaluating sensory feedbac) and volition through an advanced neuroprosthetic device Date Awarded: Act 2005 Date Completed: *ec 2006 Description: The pro"ect aims to design, develop and implement a psychophysical testing protocol and instrumentation to efficiently quantify and map the volitional intentions and sensory feedbac) perceived by a sub"ect following multi7channel surface stimulation and recording. The system will be the first step towards developing a method to be used to evaluate an amputee sub"ect interacting with a neuroprosthetic electrode implanted in the amputee?s peripheral nerve. It further aims to introduce tools and concepts across disciplines to the MB>I

2013 IUPUI MURI proposal Yoshida & Salama

scholars through cross pollination and group wor) on a multidisciplinary pro"ect involving psychophysics, bioinstrumentation, and ob"ect oriented software design !utcomes: The protocol, instrumentation and software developed by the MB>I team served as the basis of a successful application to the European 'ommission %TIME( 200672002. It formed the initial starting point for a :h* student thesis pro"ect. Co @eng, the :h* student from &alborg Bniversity is co7mentored by *r +oshida and *r Kensen %&alborg Bniversity(, and has published 2 full papers, and 3 conference papers %listed below(. Pu"lications: Title# *evelopment of a biofeedbac) testing platform for evaluating sensory feedbac) and volition through an advanced neuroprosthetic device *ate# 0280682006 9tudents Involved# *avid 9empsrott, Crandon Crungard, 9riharsha Muttineni, Magali 'arret @EF@, C., 3OS4I5$' 6#, :ET>IFI., =., KEF9EF, -., LEvaluation of sensation evo)ed by electrocutaneous stimulation on forearm in nondisabled sub"ects M, =RR6, D;%2(, pp. 2;57 <06, 2002 *AI# 00.04628K>>*.2000.0;.0065 @EF@, C., 3OS4I5$' 6#, KEF9EF, -., LImpacts of selected stimulation patterns on the perception threshold in electrocutaneous stimulationM, =ournal 5eural "ngineering Reha-ili a ion, 6%;(, pp. 0700, 2000. *AI# 00.0064805D<7000<767; @EF@, C., 3OS4I5$' 6#, KEF9EF, -., %2000( L& case study on phantom sensation and sensory discrimination induced by electrocutaneous stimulationM, 5euros+ien+e 20118 -ashington *', 6;5.068@@<2. @EF@, C., H&>>EC+, J.>., JBF*B, &., 3OS4I5$' 6#, CA>ETIB9, T., 9TIE@=ITO, T., :&99&M&, >., @BI>&B*, *., *I,ABN K.=., CEF,EFBTA, &., *I:IFA, @., >A99IFI, :.M., KEF9EF, -., %2000( L*evelopment of a :sychophysical Testing :latform 2 a computeri!ed tool to control, deliver and evaluate electrical stimulation to relieve phantom limb painM, 5ordi+7,al i+ $on! on ,M" and Medi+al Ph/s, &alborg, *enmar). @EF@, C., 3OS4I5$' 6#, KEF9EF, -., %2000( LEffects of the number of pulses on evo)ed sensations in pairwise electrocutaneous stimulationM, IF"SS20108 ,ienna &ustria, paper 45. @EF@, C., 3OS4I5$' 6#, KEF9EF, -., %2000( L:sychophysical evaluation of the effect of electrode location on sensations during electrocutaneous stimulationM, IS"C2010, &alborg, *enmar). %submitted 0.00( @EF@, C., 3OS4I5$' 6#, KEF9EF, -., %200;( LEffects of stimulus patterns on sensory thresholds in dual7channel electrocutaneous stimulationM, So+( 5euros+ien+e A-s r(, 'hicago, I=

2013 IUPUI MURI proposal Yoshida & Salama

BIOGRAPHICAL SKETCH
Provide the following information for the Senior/key personnel and other significant contributors in the order listed on Form Page 2. Follow this format for each person. DO NOT EXCEED FOUR PAGES. NA ! P%S&'&%N '&'(!

"oshida# $en
e*A +% %NS ,S!* NA ! -credential# e.g.# agency login.

Associate Professor of )iomedical !ngineering

kyoshida
!/,+A'&%N/'*A&N&N0 (Begin with baccalaureate or other initial professional education, such as nursing, include postdoctoral training and residency training if applicable.) /!0*!! &NS'&','&%N AN/ (%+A'&%N /"" F&!(/ %F S',/" (if applicable)

,niversity of +alifornia# San /iego ,niversity of +alifornia# (os Angeles ,niversity of ,tah# Salt (ake +ity# ,' ,niversity of Alberta# !dmonton# A)# +anada

).S. Ph./. Postdoctoral

12/32 12/35 62/57 17/53

Pre4A !S )iomedical !ngineering )iomedical !ngineering Neuroscience

A. Personal Statement 'he nervous system can be viewed as the substrate upon which consciousness and our ability to manipulate and interact with our environment resides. & view the capturing and understanding of the electrical activity of the nervous system as the gateway to understanding the systems# states and processes that enable us to be human. From that standpoint# advanced neuroprosthetic devices are the means to that world within us. Applied to those who suffered loss of function of that substrate through in8ury or disease# they hold the key to replacing the lost function by acting as an artificial bridge# given that we can understand and interpret how and what the nervous system signals. A critical technological component in that chain is the bioamplifier used to amplify and enable capturing of the bioelectrical activity of the body. 9owever# a ma8or challenge that stands in the way between translation of advanced neuroprosthetics and practical clinical use is the high performance yet low4power consuming# portable signal processing computer needed to e:tract and interpret the neural traffic picked up by the nervous system. 'his need led me to e:plore unconventional computing techni;ues# to /r ills< !:tended Analog +omputer and the development of the !:tended =oltage anifold +omputer. &n 6> years of independent research in the field# & have carried out development of electrode structures# bioelectric interfaces# computer modeling# signal processing and interpretation of the neural data stream in acute and chronic animal work. 'he work was carried out through a series of successful completed research grants at the national -+anadian ? /anish. and !uropean levels. & have 21 years of e:perience with electrical stimulation and recording through implanted and surface neural and muscle based interfaces in animal models ranging from worms to pigs# and 61 years of e:perience with electrical stimulation and biomechanical / bioelectrical characteri@ation of muscle activity in humans. B. Positions an Honors
Positions an Em!lo"ment

17/53462/11 *esearch Assistant Professor# +enter for Sensory4 otor &nteraction# Aalborg ,niversity# /enmark 16/16415/16 Assistant Professor# +enter for Sensory4 otor &nteraction# Aalborg ,niversity# /enmark 61/16461/12 Associate Professor# /ept of 9ealth Science and 'echnology# Aalborg ,niversity# /enmark 61/124present Associate Professor# /ept of )iomedical !ngineering# &ndiana ,niv.4Purdue ,niv. &ndianapolis
Ot#er Pro$essional E%!erien&e an 'em(ers#i!

65354 65354 655>4 65534 21614

Honors

&!!! !ngineering in edicine and )iology Society -Senior ember. )iomedical !ngineering Society - ember. &nternational Functional !lectrical Stimulation Society -+harter ember. Society for Neuroscience - ember. =eterans Administration **?/ **/A grant panel# Ad49oc *eviewer. +anadian Network of +entres of !:cellence# NeuroScience Network Fellow. Alberta 9eritage Foundation for edical *esearch Fellow. 9ede4Nielsens Family Foundation Award for *esearch in )ioelectronics Sygekassernes 9elsefond "oung &nvestigator Award

65574655A 655>46553 2112 211B

C.Sele&te !eer)re*ie+e !,(li&ations -Selected from >2 peer4reviewed 8ournal publications. 'ost rele*ant to t#e &,rrent a!!li&ations 6. Qiao, S., Torkamani-Azar, M., Salama, P., Yoshida, K., Stationary Wavelet Transform and i!her "rder Statisti#al Analyses of $ntrafas#i#%lar &erve 'e#ordin!s(, )&*, +,-. 2. Ciao S.# %doemene# %.# "oshida# $.# D/etermination of electrode to nerve fiber distance and nerve conduction velocity through spectral analysis of the e:tracellular action potentials recorded from earthworm giant fibersE# )!+#>1-3.# pp.32A43A># 2162. B. Ciao# S.# "oshida# $.# F&nfluence of unit distance and conduction velocity on the spectra of e:tracellular action potentials recorded with intrafascicular electrodesF# !P# 2162. 7. Kamav%ako, &., )ensen, W., Yoshida, K., K%rst/ens, M., 0arina, 1., A #riterion for si!nal-2ased sele#tion of 3avelets for denoisin! intrafas#i#%lar nerve re#ordin!s(, ) &e%ros#i Met, 456,7., 88. 79: ; 75<, 7<4<. >. icera# S. .# *ossini# P. .# *igosa# G.# +iti# (.# +arpaneto# G.# *aspopovic# S.# 'ombini# .# +ibriani# +.# Assen@a# 0.# +arro@@a# .+.# 9offmann# $.P.# "oshida# $.# Navarro# H.# /ario# P.# D/ecoding of grasping information from neural signals recorded using peripheral intrafascicular interfacesE# JNER# 3->B.# 2166. P +&/I P +B6AA352 2. /8ilas# .# A@evedo4+oste# +.# 0uiraud# /.# "oshida# $.# DSpike sorting of muscle spindle afferent nerve activity recorded with thin4film intrafascicular electrodesE# Comp ntel Neurosci.# 2161 P +&/I P +237AA2B A. "oshida# $# Farina# /# Akay # Gensen J# D ulti4channel intraneural and intramuscular techni;ues for multi4unit recording and use in active prosthesesE# !roc EEE# 53-B.# pp. 7B2 K 775# 2161. 3. icera# S.# +iti# (.# *igosa# G.# +arpaneto# G.# *aspopovic# S.# /iPino# 0.# *ossini# (.# "oshida# $.# /ario# P.# *ossini# P. .# D/ecoding sensory and motor information from neural signals recorded using intraneural electrodesI towards the development of a neurocontrolled hand prosthesisE# !roc EEE# 53-B.# pp. 71A 4 76A# 2161. 5. /8ilas# .# A@evedo4+oste# +.# 0uiraud# /.# "oshida# $.# D&nterpretation of muscle spindle afferent nerve response to passive muscle stretch recorded with thin4film longitudinal intarafascicular electrodesE# EEEtN"RE# 6A->.# pp. 77>47>B# 2115. 61. +iti# (.# +arpaneto# G.# "oshida# $.# 9offmann# $.P.# $och# $.P.# /ario# P.# icera# S.# D%n the use of wavelet denoising and spike sorting techni;ues to process !N0 signals recorded using intra4neural electrodesE# G. Neu.Sci. eth# 6A2# pp.2574B12# 2113. 66. Farina# /.# "oshida# $.# Stieglit@# '.# $och# $.P.# D ulti4+hannel 'hin4Film !lectrode for &ntramuscular !lectromyographic *ecordingsE# J #pp. !hysiol.# 617-B.# pp.326432A# 2113. A itional re&ent !,(li&ations to t#e $iel -in &#ronolo.i&al or er/ "oshida# $.# Ciao S.# 9imebaugh# ).# Soliman# .# D!:tended Analog +omputer ApparatusE# ,S Provisional Patent Application No. 26/231#1AA# Filed 2 Aug 2162. "oshida# $.# Ciao S.# 9imebaugh# ).# D!:tended Analog +omputer ApparatusE# ,S Provisional Patent Application No. 26/212#A76# Filed > ar 2162.

Principal Investigator/Program Director (Last, first, middle): Salama, Paul

BIOGRAPHICAL SKETCH
NAME POSITION TITLE

Paul Salama, Ph.D.

eRA COMMONS USER NAME

Professor

psalama
EDUCATION/TRAINING INSTITUTION AND LOCATION DEGREE (if applicable) YEAR(s) FIELD OF STUDY

Purdue University, West Lafayette, IN, USA Purdue University, West Lafayette, IN, USA
A. Positions and Honors.

MSEE. Ph.D.

1992-1993 1994-1999

Electrical Engineering Electrical Engineering

Professional positions 1999-2005: Assistant Professor of Electrical and Computer Engineering, Department of Electrical and Computer Engineering, Indiana University Purdue University, Indianapolis, IN 2005 2013: Associate Professor of Electrical and Computer Engineering, Department of Electrical and Computer Engineering, Indiana University Purdue University, Indianapolis, IN, Indianapolis, IN 2013 present: Professor of Electrical and Computer Engineering, Department of Electrical and Computer Engineering, Indiana University Purdue University, Indianapolis, IN, Indianapolis, IN Awards and other professional activities Award: Senior Member of the IEEE, 2005 Associate Editor: IEEE Transactions on Circuits and Systems for Video Technology Ad hoc reviewer: The IEEE Transactions on Pattern Analysis and Machine Intelligence; The IEEE Transactions on Circuits and Systems for Video Technology; The IEEE Transactions on Image Processing; The IEE Proceedings on Vision, Image and Signal Processing; Real Time Imaging Journal; The IEEE Communications Letters; The IEEE International Conference on Multimedia and Expo; The IEEE International Multi-Conference on Systems, Cybernetics and Informatics; The IEEE International Conference on Acoustics, Speech, and Signal Processing; The IEEE International Conference on Image Processing Ad hoc reviewer: NSF
B. Selected peer-reviewed publications (in chronological order).

S. Qiao, M. Torkamani-Azar, P. Salama, and K. Yoshida, Stationary Wavelet Transform and Higher Order Statistical Analyses of Intrafascicular Nerve Recordings, Journal of Neural Engineering, vol. 9, 2012. K. S. Lorenz, P. Salama, K.W. Dunn, E.J. Delp, A Multi-Resolution Approach to Non-Rigid Registration of Microscopy Images, Proceedings of IEEE International Symposium on Biomedical Imaging, Barcelona, Spain, 2-5 May 2012. K. S. Lorenz, P. Salama, K.W. Dunn, E.J. Delp, "Digital Correction of Motion Artifacts in Microscopy Image Sequences Collected from Living Animals Using Rigid and Non-Rigid Registration," Journal of Microscopy, Volume 245, no. 2, pages 148160, February 2012

Robert G. Presson, Jr., Mary Beth Brown, Amanda J. Fisher, Ruben M. Sandoval, Kenneth W. Dunn, Kevin S. Lorenz, Edward J. Delp, Paul Salama, Bruce A. Molitoris, and Irina Petrache, Two-Photon Imaging within the Murine Thorax without Respiratory and Cardiac Motion Artifact The American Journal of Pathology, vol. 179, no. 1, pp. 75-82, July 2011. K. Lorenz, P. Salama, K. W. Dunn, E. Delp, Non-Rigid Registration of Multiphoton Microscopy Images Using B-Splines, Proceedings of the SPIE Conference on Medical Imaging, 12-17 February, 2011, Orlando, Florida, USA. R. Mack, M. Rizkalla, P. Salama, M. El-Sharkawy, VLSI Implementation for Low Noise Power Efficiency Cellular Communication Systems, Wireless Sensor Network, vol. 2010, no. 2, pp. 18-30. S. Assegie, P. Salama, and B. King, An Attack on Wavelet Tree Shuffling Encryption Schemes, SecurityEnriched Urban Computing and Smart Grid, Communications in Computer and Information Science, pp. 139-148, vol. 78, 2010. L. Siruvuri, P. Salama, and D. Kim, Adaptive Error Resilience for Video Streaming, International Journal of Digital Multimedia Broadcasting, Special Issue on Advances in Video Coding for Broadcast Applications, vol. 2009, no. 681078, pp. 29-38. L. Liang, P. Salama and E. J. Delp, Unequal Error Protection Techniques Based on Wyner--Ziv Coding, EURASIP Journal on Image and Video Processing, Special Issue on Distributed Video Coding, vol. 2009, no. 474689, pp. 112-124. K. Lorenz, F. Serrano, P. Salama, E. J. Delp, Segmentation and Registration Based Analysis of Microscopy Images, Proceedings of the IEEE International Conference on Image Processing, 7-9 November, 2009, Cairo Egypt. K. Lorenz, F. Serrano, P. Salama, E. J. Delp, Analysis of Multiphoton Renal and Liver Microscopy Images: Preliminary Approaches to Segmentation and Registration, Proceedings of the Workshop on Microscopic Image Analysis with Applications in Biology, 3-4 September, 2009, Bethesda, MD, USA. L. Liang, P. Salama, and E. J. Delp, Feedback Aided Content Adaptive Unequal Error Protection Based on Wyner-Ziv Coding, Proceedings of the 27th Picture Coding Symposium, 6-9 May 2009, Chicago, Illinois, USA. M. Torkamani-Azar, E. N. Kamavuako, P. Salama, and K. Yoshida, Multi-scale and higher order statistical analyses of intrafascicular nerve recordings, Proceedings of the Annual Conference of the International Functional Electrical Stimulation Society (IFESS), September 21-25, 2008, Freiburg, Germany P. Salama, A Least Squares Approach to Estimating the Probability Distribution of Unobserved Data in Multi-photon Microscopy, SPIE International Conference on Computational Imaging VI, January 28 31, 2008, San Jose, CA.

Please check any risk assurances that apply to this proposal: Animals (IACUC Study #): _________________ Human Subjects (IRB Study #): ____________________ r-DNA (IBC Study #): _____________________ Human Pathogens, Blood, Fluids, or Tissues must be identified if used: ______ Radiation : ______ Other : ______ 12) The center for Research and Learning generally shares the text of funded proposals on the web so that prospective students can learn about available MURI projects. Please let us know if it is OK with you to post your proposal on the CRL MURI webpage by checking one of the following answers: YES NO

Section IV: References/Bibliography (insert 1-2 pages as needed) Section V: CVs/Resumes (insert 2 pages per mentor for a maximum of 6 pages) Section VI: Support Letters (insert 1- 2 pages as needed) Section VII: Appendix Section VIII: Signature
Name and Signature of the Principal Mentor: Ken Yoshida 23 August 2013 ______________________________________________________________________ Name Signature Date

MURI Mentors Project Proposal Form, Updated: 9_10_12