 Machine learning is a scientific discipline that

is concerned with the design and development of

algorithms that allow computers to evolve
behaviors based on empirical data, such as from
sensor data or databases.

 Data can be seen as examples that illustrate

relations between observed variables.

 A major focus of machine learning research is

to automatically learn to recognize complex
patterns and make intelligent decisions based on
data
 Algorithm types
Supervised learning generates a function that maps inputs to desired
outputs. For example, in a classification problem, the learner
approximates a function mapping a vector into classes by looking at
input-output examples of the function.

Unsupervised learning models a set of inputs, like clustering.

Semi-supervised learning combines both labeled and unlabeled

examples to generate an appropriate function or classifier.

Reinforcement learning learns how to act given an observation of the

world. Every action has some impact in the environment, and the
environment provides feedback in the form of rewards that guides the
learning algorithm.
Supervised learning is a machine learning technique for deducing a
function from training data. The training data consist of pairs of input
objects (typically vectors), and desired outputs. ...

Example: Lets start by talking about a few examples of supervised

learning problems. Suppose we have a dataset giving the living areas and
prices of 47 houses from Portland, Oregon:

Living area (feet2) Price (1000$s)

2104 400
1600 330
2400 369
1416 232
3000 540
. .
. .
. .
We can plot this data:

Given data like this, how can we learn to predict the prices of
other houses in Portland, as a function of the size of their
living areas?
 To establish notation for future use, we’ll use x(i) to
denote the “input” variables (living area in this
example), also called input features.

 y(i) to denote the “output” or target variable that we

are trying to predict (price).

 A pair (x(i), y(i)) is called a training example, and the

dataset that we’ll be using to learn—a list of m training
examples {(x(i), y(i)); i = 1, . . . ,m}—is called a training
set.
In supervised learning, we saw algorithms that tried to make their
outputs mimic the labels y given in the training set. In that setting, the
labels gave an unambiguous \right answer" for each of the inputs x.

For example, if we have just built a four-legged robot and are trying to
program it to walk, then initially we have no idea what the \correct"
actions to take are to make it walk, and so do not know how to provide
explicit supervision for a learning algorithm to try to mimic.
 In the four-legged walking example, the reward function
might give the robot positive rewards for moving forwards.

 Negative rewards for either moving backwards or falling

over.

 It will then be the learning algorithm's job to gure out how

to choose actions over time so as to obtain large rewards.
 Robot locomotion is the study of how to design robot appendages and
control mechanisms to allow robots to move fluidly and efficiently. Although
wheeled robots are typically quite energy efficient and simple to control.

A major goal in this field is in developing capabilities for robots to

autonomously decide how, when, and where to move. However, coordinating
a large number of robot joints for even simple matters, like negotiating stairs,
is difficult. Autonomous robot locomotion is a major technological obstacle
for many areas of robotics, such as humanoids (like Honda's Asimo).
 Speech recognition (also known as automatic speech
recognition or computer speech recognition) converts spoken
words to text. The term "voice recognition" is sometimes used to refer
to recognition systems that must be trained to a particular speaker—as
is the case for most desktop recognition software. Recognizing the
speaker can simplify the task of translating speech.

Speech recognition is a broader solution which refers to technology

that can recognize speech without being targeted at single speaker—
such as a call center system that can recognize arbitrary voices.
Speech recognition