Introduction to NeuroFuzzy Technologies

Tutorial and Workshop Constantin von Altrock Inform Software Corporation 2001 Midwest Rd. Oak Brook, IL 60521, U.S.A. German Version Available! Phone 630-268-7550 Fax 630-268-7554 Email: fuzzy@informusa.com Internet: www.fuzzytech.com
INFORM 1990-1998

Combining Neural Networks and Fuzzy Logic Neural Net Basics Training Neural Nets Combining Neural and Fuzzy Training Fuzzy Logic Systems Convergence of Technologies Examples
Slide 1

Neural Net Basics: - Neuron Model Multiple Inputs, One Output

Axon

The Output Signal is the Activation Level of the Neuron The Inputs Stem From Outputs of Other Neurons

: Exciting Synapses : Inhibiting Synapses

Inputs Wired to the Neuron Using Exciting Synapses Increase Activation Level
Inputs Wired to the Neuron Using Inhibiting Synapses Decrease Activation Level

WARNING: This Neuron Model is a Strong Simplification of Mother Nature

INFORM 1990-1998

Slide 2

Neural Net Basics: - Mathematical Model X1 X2 X3 X4

...

Inputs
w1 w2 w3 w4 wn

Output
Y

Xn
Propagation Function n Activation Function

f=
i=0
INFORM 1990-1998

wi . x i + O
f
Slide 3

Neural Net Basics: - Multilayer Nets Input Signal Output Signal

Input Layer
INFORM 1990-1998

1. Hidden Layer

2. Hidden Layer

Output Layer
Slide 4

Training Neural Nets: - Pavlovs Dogs Before Learning

Food Bell Food Bell Food

After Learning
Bell Food Bell

Training Increases the Weight of this Synapse

Dog Salivates

Dog Salivates

Dog Salivates

Dog Salivates

Hebbs Learning Rule: Increase weight to active input neuron, if the output of this neuron should be active,decrease weight to active input neuron, if the output of this neuron should be inactive.
INFORM 1990-1998 Slide 5

Combining Neural and Fuzzy

Neural Networks have their Strengths
Fuzzy Logic has its Strengths

Neural Nets Knowledge Representation Trainability Implicit, the system cannot be easy interpreted or modified (-) Trains itself by learning from data sets (+++)

Fuzzy Logic Explicit, verification and optimization easy and efficient (+++) None, you have to define everything explicitly (-)

Get best of both worlds: Explicit Knowledge Representation from Fuzzy Logic with Training Algorithms from Neural Nets
INFORM 1990-1998 Slide 6

Training Fuzzy Logic Systems

Fuzzification Inference Defuzzification

Many Different Ways Exist to Train a Fuzzy Logic System

NeuroFuzzy := Use Error Backpropagation Emulate Fuzzy Logic System as Neural Net Each Component of a Fuzzy Logic System is Represented as Part of a Neural Net Apply EPG to this Neural Net : EPG Requires Differentiability : Use Gradient Estimators

: Use Fuzzy Associative Memories

INFORM 1990-1998

Slide 7

Convergence of Technologies
Year: Computing:
1940 1945 1950 1955 1960 1965 1970 1975 1980 1985 1990 1995 2000 Relay/Valve Based Transistors Neuron Model (McCulloch/Pitts) Training Rules (Hepp)

Neural Networks:

Fuzzy Logic:

Small Scale Integration Delta Rule (Wirow/Hoff)

Seminal Paper (Zadeh) Large Scale Integration Multilayer Perceptron, XOR Fuzzy Control (Mamdani) Hopfield Model (Hopfield/Tank) Backpropagation (Rumelhart) Broad Application in Japan Bidir. Assoc. Mem. (Kosko) Broad Application in Europe Broad Application in the U.S. Soft Computing, NeuroFuzzy

Artificial Intelligence

INFORM 1990-1998

Slide 8