8/20/2016

INTRODUCTION TO SOFT
COMPUTING

Harshali Patil

Introduction

Evolution of Computing
Soft computing constituents
From conventional AI to Computational Intelligence
Machine Learning basics

8/20/2016

Problem Solving

Reasoning

New
Problem
1) What kind
of similar
problems you
have solved?

4) Is it
necessary to
retain the
knowledge?

Solution
2) How to reuse
the previous
knowledge?

3) Proposed
solution is
valid or not?

Case Based Reasoning

8/20/2016

Artificial Intelligence

If intelligence can be induced in machines it is

called as artificial intelligence.
Soft computing is a part of artificial intelligent
techniques
Closed related to machine
intelligence/computational intelligence

Soft Computing

Neural Networks

NeuroFuzzy
Computing

DerivativeFree
Optimization

Soft Computing

Fuzzy Inference
systems

8/20/2016

What is Soft Computing?

The idea behind soft computing is to model cognitive

behaviour of human mind.

Soft computing is foundation of conceptual

intelligence in machines.

Unlike hard computing , Soft computing is tolerant of

imprecision, uncertainty, partial truth, and
approximation.

Soft Computing
According to Prof.
Prof. Zadeh:
Zadeh:
"...in contrast to traditional hard
computing, soft computing exploits the
tolerance for imprecision, uncertainty, and
partial truth to achieve tractability,
robustness, low solution-cost, and better
rapport with reality

8/20/2016

Soft Vs Hard Computing

HARD COMPUTING

Precise Models

Symbolic
Logic
Reasoning

Traditional
Numerical
Modeling and
Search

SOFT COMPUTING

Approximate Models

Approximate
Reasoning

Soft Computing

Hard Computing
Conventional computing requires a Soft
precisely stated analytical model.

Functional
Approximation
and Randomized
Search

computing

is

tolerant

of

imprecision.

Often requires a lot of computation Can solve some real world problems in
time.

reasonably less time.

Not suited for real world problems for Suitable for real world problems.
which ideal model is not present.
It requires full truth

Can work with partial truth

It is precise and accurate

Imprecise.

High cost for solution

Low cost for solution

8/20/2016

Overview techniques of SC
Neural Networks
Fuzzy Logic
Genetic Algorithm
Hybrid Systems

Evolution of Computing
1940s

1947
Cybemetics

1943 McCulloach Pitts

neuron model

1950s

1956 AI

1957 Perceptron

1960s

1960 LISP
language

1960 Adaline Masaline 1965 Fuzzy

sets

1970s

Mid 1970s
knowledge
engineering
(expert system)

1974 Birth of back

propogation algorithm
1975 Cognitron
Neocognitron

1980s

1990s

1974 Fuzzy
controller

1980 self organizing

1985 Fuzzy
map
modelling
1982 hopfield net
1983 Boltzmann
machine
1986 Backpropogation
algorithm boom

1970s
Genetic
algorithm
Mid 1980s
Artificial life
Immune
modelling

1990s Neuro
1990 Genetic
fuzzy modelling programming
1991 ANFIS
1994 CANFIS

8/20/2016

SC constituents (the first three

items) and conventional AI
Methodology

Strength

Neural network

Learning and adaptation

Fuzzy set theory

Knowledge representation via fuzzy

if-then rules

Genetic algorithm and

simulated annealing

Systematic random search

Conventional AI

Symbolic manipulation

Character recognizer

8/20/2016

Features of Conventional AI

Conventional

AI manipulates symbols on the

assumption that human intelligence behavior can
be stored in symbolically structured knowledge
bases: this is known as: The physical symbol
system hypothesis

The

knowledge-based system (or expert system) is

an example of the most successful conventional AI
product

What is expert system?

An expert system is software that uses a knowledge

base of human expertise for problem solving, or to
clarify uncertainties where normally one or more
human experts would need to be consulted

8/20/2016

Expert system

Building blocks of expert system

Knowledge base: factual knowledge and heuristic

knowledge
Knowledge representation: in the form of rules
Problem solving model: forward chaining or
backward chaining
Note:
Knowledge

engineering:- building an expert system

Knowledge engineers:- practitioners.

8/20/2016

Definitions of AI

AI is the study of agents that exists in an

environment and perceive and act [S. Russel & P.
Norvig]
AI is the act of making computers do smart
things [Waldrop]
AI is a programming style, where programs
operate on data according to rules in order to
accomplish goals [W.A. Taylor]

Definitions of AI

AI is the activity of providing such machines as

computers with the ability to display behavior that
would be regarded as intelligent if it were
observed in humans [R. Mc Leod]
Expert system is a computer program using
expert knowledge to attain high levels of
performance in a narrow problem area [D.A.
Waterman]

10

8/20/2016

Definitions of AI

Expert system is a caricature of the human

expert, in the sense that it knows almost
everything about almost nothing [A.R. Mirzai]
AI is changing rapidly, these definitions are
already obsolete!

Applications of expert system

Diagnosis and Troubleshooting of Devices and

Systems of All Kinds
Planning and Scheduling
Configuration of Manufactured Objects from
Subassemblies
Financial Decision Making
Knowledge Publishing
Design and Manufacturing

11

8/20/2016

Machine Learning basics

Machine learning, a branch of artificial intelligence,

concerns the construction and study of systems that
can learn from data.

E.g. a machine learning system could be trained on email

messages to learn to distinguish between spam and nonspam messages. After learning, it can then be used to
classify new email messages into spam and non-spam
folders.

Research Areas
Intelligent Robots
 Bayesian inference and design
technique for uncertain scene
recognition
Combination Image filtering and
Bayesian inference
Navigation technique research for
autonomous mobile robot
Evolving a mobile robot controller

12

8/20/2016

Research Areas

Intelligent Agent
 Intelligent virtual secretary agent
Conversational agent
Intelligent assistants for smart
phone service

Research Areas

Bioinformatics
Bioinformatics: the collection, classification,
storage, and analysis of biochemical and biological
information using computers especially as applied
in molecular genetics and genomics
Classification techniques in Bioinformatics
Agent driven virtual cell modelling

13

8/20/2016

Research Areas

Ubiquitous
Developing an adaptation scheme in the context
of middleware and applications
Developing context-aware system for ubiquitous
systems
Developing basic theories and algorithms of the
advanced intelligent models for ubiquitous
environment

Research Areas

Intrusion Detection System (IDS)

HMM-based intrusion detection system
Generation of various intrusion patterns using
interactive genetic algorithm
Viterbi algorithm for intrusion type identification
Rule-based integration of multiple measure-models

14

8/20/2016

Research Areas

Biometrics
Analysis and evaluation techniques of fingerprint
recognition system
Development of classification and matching algorithm
for fingerprint recognition

Neuro Fuzzy and Soft

Computing Characteristics

With NF modeling as a backbone, SC can be

characterized as:
Human expertise (fuzzy if-then rules)

Biologically inspired computing models (NN)

New optimization techniques (GA, SA, RA)

Numerical computation (no symbolic AI so far, only
numerical)

New application domains: mostly computation
intensive like adaptive signal processing, adaptive
control, nonlinear system identification etc

15

8/20/2016

Neuro Fuzzy and Soft

Computing Characteristics

Model

free learning:-models are constructed based on

the target system only

Intensive computation: based more on computation

Fault tolerance: deletion of a neuron or a rule does not
destroy the system. The system performs with lesser
quality

Goal driven characteristics:- only the goal is important
and not the path.

Real world application:- large scale, uncertainties

16