Chapter 11 Integer Programming, Goal Programming, and Nonlinear Programming

Prepared by Lee Revere and John Large

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-1

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Learning Objectives
Students will be able to: 1. Understand the difference between LP and integer programming. 2. Understand and solve the three types of integer programming problems. 3. Apply the branch and bound method to solve integer programming problems. 4. Solve goal programming problems graphically and using a modified simplex technique. 5. Formulate nonlinear programming problems and solve using Excel.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-2

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Chapter Outline
11.1 Introduction 11.2 Integer Programming 11.3 Modeling with 0-1 (Binary) Variables 11.4 Goal Programming 11.5 Nonlinear Programming

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-3

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Introduction
Integer programming is the extension of LP that solves problems requiring integer solutions. Goal programming is the extension of LP that permits more than one objective to be stated. Nonlinear programming is the case in which objectives or constraints are nonlinear. All three above mathematical programming models are used when some of the basic assumptions of LP are made more or less restrictive.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-4

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Summary: Linear Programming Extensions

Integer Programming Linear, integer solutions Goal Programming Linear, multiple objectives Nonlinear Programming Nonlinear objective and/or constraints

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-5

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Programming
Solution values must be whole
numbers in integer programming . There are three types of integer programs: pure integer programming; mixed-integer programming; and 01 integer programming.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-6

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Programming
(continued)
1. The Pure Integer Programming problems are cases in which all variables are required to have integer values. 2. The Mixed-Integer Programming problems are cases in which some, but not all, of the decision variables are required to have integer values. 3. The ZeroOne Integer Programming problems are special cases in which all the decision variables must have integer solution values of 0 or 1.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-7

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Programming Example: Harrison Electric Company

The Company produces two products popular with home renovators: oldfashioned chandeliers and ceiling fans. Both the chandeliers and fans require a twostep production process involving wiring and assembly. It takes about 2 hours to wire each chandelier and 3 hours to wire a ceiling fan. Final assembly of the chandeliers and fans requires 6 and 5 hours, respectively. The production capability is such that only 12 hours of wiring time and 30 hours of assembly time are available.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-8

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Programming: Example (continued)

If each chandelier produced nets the firm $7 and each fan $6, Harrisons production mix decision can be formulated using LP as follows:
maximize profit = $7X1 + $6X2 subject to: 2X1 + 3X2 12 (wiring hours) 6X1 + 5X2 30 (assembly hours) X1, X2 0 (nonnegative) X1 = number of chandeliers produced X2 = number of ceiling fans produced

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-9

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Programming: Example (continued)

With only two variables and two constraints, the graphical LP approach to generate the optimal solution is given below:

6X1 + 5X2 30 + = Possible Integer Solution Optimal LP Solution (X1 = 33/4, X2 = 11/2, Profit = $35.25 2X1 + 3X2 12

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-10

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Solution to Harrison Electric Co.

Optimal solution

Solution if rounding off

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-11

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Solution to Harrison Electric Co.

(continued) Rounding off is one way to reach integer solution values, but it often does not yield the best solution. An important concept to understand is that an integer programming solution can never be better than the solution to the same LP problem. The integer problem is usually worse in terms of higher cost or lower profit.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-12

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method

Branch and Bound break the feasible
solution region into sub-problems until an optimal solution is found. There are Six Steps in Solving Integer Programming Maximization Problems by Branch and Bound. The steps are given over the next several slides.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-13

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method: The Six Steps

1. Solve the original problem using LP.
If the answer satisfies the integer constraints, it is done. If not, this value provides an initial upper bound.

2. Find any feasible solution that meets the integer constraints for use as a lower bound.
Usually, rounding down each variable will accomplish this.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-14

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method Steps: (continued)

3. Branch on one variable from Step 1 that does not have an integer value.
Split the problem into two subproblems based on integer values that are immediately above and below the non-integer value. For example, if X2 = 3.75 was in the final LP solution, introduce the constraint X2 4 in the first subproblem and X2 3 in the second sub-problem.

4. Create nodes at the top of these new branches by solving the new problems.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-15

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method Steps: (continued)

5.
a) If a branch yields a solution to the LP problem that is not feasible, terminate the branch. b) If a branch yields a solution to the LP problem that is feasible, but not an integer solution, go to step 6.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-16

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method Steps: (continued)

5. (continued)
c) If the branch yields a feasible integer solution, examine the value of the objective function. If this value equals the upper bound, an optimal solution has been reached. If it is not equal to the upper bound, but exceeds the lower bound, set it as the new lower bound and go to step 6. Finally, if it is less than the lower bound, terminate this branch.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-17

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Branch and Bound Method Steps: (continued)

6. Examine both branches again and set the upper bound equal to the maximum value of the objective function at all final nodes.
If the upper bound equals the lower bound, stop. If not, go back to step 3.

Minimization problems involve reversing the roles of the upper and lower bounds.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-18

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Harrison Electric Co: Revisited

Figure 11.1 shows graphically that the optimal, non-integer solution is X1 = 3.75 chandeliers X2 = 1.5 ceiling fans profit = $35.25 Since X1 and X2 are not integers, this solution is not valid. The profit value of $35.25 will serve as an initial upper bound. Note that rounding down gives X1 = 3, X2 = 1, profit = $27, which is feasible and can be used as a lower bound.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-19

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Integer Solution: Creating Sub-problems

The problem is now divided into two sub-problems: A and B. Consider branching on either variable that does not have an integer solution; pick X1 this time.
Subproblem A maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 4 Subproblem B maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 3
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-20

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Optimal Solution for Sub-problems

Optimal solutions are: Sub-problem A: X1 = 4; X2 = 1.2, profit=$35.20 Sub-problem B: X1=3, X2=2, profit=$33.00 (see figure on next slide) Stop searching on the Subproblem B branch because it has an all-integer feasible solution.
The $33 profit becomes the lower bound.

Subproblem As branch is searched further since it has a non-integer solution.

The second upper bound becomes $35.20, replacing $35.25 from the first node.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-21

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Optimal Solution for Sub-problem

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-22

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Sub-problems C and D
Subproblem As branching yields Subproblems C and D.
Subproblem C maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 4 X2 2 Subproblem D maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 4 X2 1
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-23

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Sub-problems C and D
(continued)
Subproblem C has no feasible solution at all because the first two constraints are violated if the X1 4 and X2 2 constraints are observed. Terminate this branch and do not consider its solution. Subproblem Ds optimal solution is X1 = 4 , X2 = 1, profit = $35.16. This non-integer solution yields a new upper bound of $35.16, replacing the original $35.20. Subproblems C and D, as well as the final branches for the problem, are shown in the figure on the next slide.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna 2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

11-24

Harrison Electrics Full Branch and Bound Solution

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-25

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Subproblems E and F
Finally, create subproblems E and F and solve for X1 and X2 with the added constraints X1 4 and X1 5. The subproblems and their solutions are:
Subproblem E maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 4 X1 4 X2 1 Optimal solution for E: X1 = 4, X2 = 1, profit = $34
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-26

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Subproblems E and F
(continued)
Subproblem F maximize profit = $7X1 + $6X2 Subject to: 2X1 + 3X2 12 6X1 + 5X2 30 X1 4 X1 5 X2 1 Optimal solution for F: X1 = 5, X2 = 0, profit = $35

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-27

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Using Software to Solve Harrison Electric Co. Problem

POM-QM for Windows Analysis of Harrison Electrics Problem Using Integer programming: Input Screen.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-28

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Using Software to Solve Harrison Electric Co. Problem (continued)

Output Screen Using POM-QM for Windows on Harrison Electrics Integer Programming Problem

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-29

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Goal Programming
Firms usually have more than one goal. For
example,

maximizing total profit, maximizing market share, maintaining full employment, providing quality ecological management, minimizing noise level in the
neighborhood, and meeting numerous other non-economic goals.

It is not possible for LP to have multiple goals

unless they are all measured in the same units (such as dollars),

a highly unusual situation.

An important technique that has been developed
to supplement LP is called goal programming.
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-30

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Goal Programming
(continued)

Goal programming satisfices,

as opposed to LP, which tries to
optimize. Satisfice means coming as close as possible to reaching goals.

The objective function is the main

difference between goal programming and LP. In goal programming, the purpose is to minimize deviational variables, which are the only terms in the objective
function.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-31

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Example of Goal Programming Harrison Electric Revisited

Goals Harrisons management wants to achieve, each equal in priority: Goal 1: to produce as much profit above $30 as possible during the production period. Goal 2: to fully utilize the available wiring department hours. Goal 3: to avoid overtime in the assembly department. Goal 4: to meet a contract requirement to produce at least seven ceiling fans.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-32

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Example of Goal Programming Harrison Electric Revisited

Need a clear definition of deviational variables, such as :
d1 = underachievement of the profit target d1+ = overachievement of the profit target d2 = idle time in the wiring dept. (underused) d2+ = overtime in the wiring dept. (overused) d3 = idle time in the assembly dept. (underused) d3+ = overtime in the wiring dept. (overused) d4 = underachievement of the ceiling fan goal d4+ = overachievement of the ceiling fan goal

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-33

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Ranking Goals with Priority Levels

A key idea in goal programming is that one goal is more important than another. Priorities are assigned to each deviational variable.

Priority 1 is infinitely more important than Priority 2, which is infinitely more important than the next goal, and so on.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-34

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Analysis of First Goal

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-35

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Analysis of First and Second Goals

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-36

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Analysis of All Four Priority Goals

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-37

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Goal Programming Versus Linear Programming

Multiple goals (instead of one goal) Deviational variables minimized
(instead of maximizing profit or minimizing cost of LP)

Satisficing (instead of optimizing) Deviational variables are real (and

replace slack variables)

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-38

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Initial Goal Programming Tableau

Cj 0 0 P1 P2 0 P4 0 0 P3 0 Solution x1 x2 d1- d2- d3- d4- d1+ d2+ d3+ d4+ Quantity Mix P1 P2 0 P4 d1d2d3d47 2 6 0 6 3 5 1 1 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 -1 0 0 0 1 1 0 0 0 0 0 30 12 30 7 7

0 -1 0 0 0 0 0 0

0 -1 0 0 0 0 0 0 -1 0 -1 0 -1 0 0

0 1 0 { Zj P4 Cj - Zj 0 -1 0 0 { Zj P3 Cj - Zj 0 2 { Zj P2 Cj - Zj -2 0 0

Pivot Column

0 3

0 0

0 1
0 0 0

0 0
0 0 0

0 0
0

0 0 1 0 -1 0
0 1 0 0 0

0 0
0 0 0

-3 0 1 0

1 2
3 0

7 6 { Zj P1 Cj - Zj -7 -6
To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

0 -1 0 0 1 0

11-39

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Second Goal Programming Tableau

Cj 0 0 P1 P2 0 P4 0 0 P3 0 Solution x x d - d - d - d - d + d + d + d + 1 2 1 2 3 4 1 2 3 4 Quantity Mix P1 P2 0 P4 x1 d2d3d41 6/7 1/7 0 0 9/7 -2/7 1 0 -1/7 -6/7 0 0 1 0 0 0 0 0 1 0 0 0 -1/7 0 0 0 0 30/7 24/7 30/7 7 7

0 +2/7 -1 0

0 6/7 0 -1 0 1 1 0 0 0 0 0 -1 0 -1

0 1 0 { Zj P4 Cj - Zj 0 -1 0 0 { Zj P3 Cj - Zj 0 0 0 0 0

0
0 0

0
0 0

0
0 0

0
0 0

0
0 0

0 +1
0 1 0 0 0

Pivot Column

Z 0 9/7 -2/7 1 P2 { j Cj - Zj 0 -9/7 +2/7 0

0 { Zj P1 Cj - Zj 0 0 0 0 1 0 0

0
0 0 0

0 2/7 -1 0
0 -2/7 +1 0 0 0 0 1 0 0 0 0

0 24/7
0 0 0 0

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-40

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Final Solution to Harrison Electrics Goal Programming

Cj 0 0 P1 P2 0 P4 0 0 P3 0 Solution x x d - d - d - d - d + d + d + d + 1 2 1 2 3 4 1 2 3 4 Quantity Mix P1 P2 0 P4 d2+ x2 d1+ d4+ 8/5 0 6/5 1 0 -1 3/5 0 0 0 1/5 0 0 0 1 0 0 0 0 0 0 0 1 -3/5 0 0 -1/5 0 0 -6/5 0 0 1/5 -1 0 1/5 -1 0 -1/5 -1 0 0 0 0 0 1 0 0 0 0 0 0 0 0 6 6 6 1 1

1/5 0 -1 0 6/5 0 -6/5 0 0 0 0 0 -1/5 1 0 -1/5 1 0 1/5 0 0 0 0 1 0 0 0 0 0 0 0 0

-6/5 0 { Zj P4 Cj - Zj 6/5 0 0 { Zj P3 Cj - Zj 0 0 { Zj P2 Cj - Zj 0

0 0 0 0 0 0 0 0

0 { Zj P1 Cj - Zj 0

0 0

0 1

0 0

0 0
11-41

0 0

0 0

0 0

0 0

0 0

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Harrison Electrics Goal Programming Using POMQM for Windows

Final Tableau for Harrison Electric Using POM-QM for Windows.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-42

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Harrison Electrics Goal Programming Using POMQM for Windows

Summary Solution Screen for Harrison Electrics Goal Programming Problem Using POM-QM for Windows.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-43

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
Nonlinear objective function, linear
constraints Nonlinear objective function and nonlinear constraints Linear objective function and nonlinear constraints

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-44

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
Nonlinear objective function, linear constraints
Max: Subject to: 28X1 + 21X2 + 0.25X22

X1 + X2 1000 0.5X1 + 0.4X2 500

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-45

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
An Excel Formulation of Great Western Appliances Nonlinear Programming Problem.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-46

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
Nonlinear objective function and nonlinear constraints.
Max: Subject to: 13X1 + 6X1X2 + 5X2 + X21 2X12+ 4X22 90 X1 + X23 75 8X1 2X2 61

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-47

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
The Problem has both Nonlinear Objective Function and Nonlinear Constraints. The solution to Great Western Appliances NLP Problem using Excel Solver:

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-48

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
The problem has both Nonlinear Objective Function and Nonlinear Constraints. An Excel Formulation of Hospicare Corp.s NLP Problem:

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-49

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
The problem has both Nonlinear Objective Function and Nonlinear Constraints. Excel Solution to the Hospicare Corp.s NLP Problem using Solver:

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-50

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
Linear objective function and nonlinear constraints
Max: 5X1 + 7X2 Subject to: 3X1+ 0.25X12 + 4X2 + 0.3X22 125 13X1 + X13 80 0.7X1 + X2 17

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-51

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
The problem has both Linear Objective Function with Nonlinear Constraints. Excel Formulation of Thermlocks NLP Problem:

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-52

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Nonlinear Programming
The problem has both Linear Objective Function with Nonlinear Constraints. The solution to Thermlocks NLP Problem Using the Excel Solver:

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-53

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458

Computational Procedures -Nonlinear Programming

Gradient method (steepest descent) Separable programming - linear representation of nonlinear problem Separable programming deals with a class of problems in which the objective and constraints are approximated by linear functions. In this way, the powerful simplex algorithm may again be applied. In general, work in the area of NLP is the least charted and most difficult of all the quantitative analysis models.

To accompany Quantitative Analysis for Management, 9e by Render/Stair/Hanna

11-54

2006 by Prentice Hall, Inc. Upper Saddle River, NJ 07458