Académique Documents
Professionnel Documents
Culture Documents
Introduction History Neural Network Model Characteristics Advantages Applications Strengths Limitations Conclusion Summary
Page 2
Introduction
An Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurons) working in unison to solve specific problems. An Artificial Neural Network is a network of many very simple processors ("units"), each possibly having a (small amount of) local memory. The units are connected by unidirectional communication channels ("connections"), which carry numeric (as opposed to symbolic) data. The units operate only on their local data and on the inputs they receive via the connections.
Page 3
Introduction(Contd)
A neural network (NN), in the case of artificial neurons called artificial neural network (ANN) or simulated neural network (SNN), is an interconnected group of natural or artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation. In most cases an ANN is an adaptive system that changes its structure based on external or internal information that flows through the network. Neural networks are non-linear statistical data modeling or decision making tools. They can be used to model complex relationships between inputs and outputs or to find patterns in data.
Page 4
History
The preliminary theoretical base for contemporary neural networks was independently proposed by Alexander Bain (1873) and William James (1890). In their work, both thoughts and body activity resulted from interactions among neurons within the brain. McCullouch and Pitts (1943) created a computational model for neural networks based on mathematics and algorithms. They called this model threshold logic. The model paved the way for neural network research to split into two distinct approaches. One approach focused on biological processes in the brain and the other focused on the application of neural networks to artificial intelligence.
Page 5
A Neural Network (Expert System) is like a black box that knows how to process inputs to create a useful output. The calculation(s) are quite complex and difficult to understand
Page 7
Characteristics
Supervised networks are universal approximators (Non recurrent networks) Theorem : Any limited function can be approximated by a neural network with a finite number of hidden neurons to an arbitrary precision Type of Approximators
Linear approximators : for a given precision, the number of parameters grows exponentially with the number of variables (polynomials) Non-linear approximators (NN), the number of parameters grows linearly with the number of variables
Page 8
Other properties
Adaptivity Adapt weights to environment and retrained easily Generalization ability May provide against lack of data Fault tolerance Graceful degradation of performances if damaged => The information is distributed within the entire net.
Page 9
General Advantages
Advantages Adapt to unknown situations Robustness: fault tolerance due to network redundancy Autonomous learning and generalization Disadvantages Not exact Large complexity of the network structure
Page 10
Page 11
Applications
Prediction: learning from past experience pick the best stocks in the market predict weather identify people with cancer risk Classification Image processing Predict bankruptcy for credit card companies Risk assessment
Page 12
Applications
Recognition Pattern recognition: SNOOPE (bomb detector in U.S. airports) Character recognition Handwriting: processing checks Data association Not only identify the characters that were scanned but identify when the scanner is not working properly
Page 13
Applications
Data Conceptualization infer grouping relationships e.g. extract from a database the names of those most likely to buy a particular product. Data Filtering e.g. take the noise out of a telephone signal, signal smoothing Planning Unknown environments Sensor data is noisy Fairly new approach to planning
Page 14
Page 15
Page 16
Page 17
Page 18
Conclusion
Past and Present
The development of true Neural Networks is a fairly recent event, which has been met with success. Two of the different systems (among the many) that have been developed are: the basic feed forward Network and the Hopfield Net. In addition to the applications featured here, other application areas include: Financial Analysis -- stock predictions . Signature Analysis -- the banks in America have taken to NNs to compare signatures with what is stored. Process Control Oversight -- NNs are used to advise aircraft pilots of engine problems. Direct Marketing -- NNs can monitor results from a test mailing and determine the most successful areas. Pen PC's.
Page 19
Summary
Neural network solutions should be kept as simple as possible. For the sake of the gaming speed neural networks should be applied preferably off-line. A large data set should be collected and it should be divided into training, validation, and testing data. Neural networks fit as solutions of complex problems. A pool of candidate solutions should be generated, and the best candidate solution should be selected using the validation data. The solution should be represented to allow fast application.
Page 20
Page 21