Comparing Performance

Tom Kelliher, CS 220

Nov. 2, 2005

Administrivia

Announcements

Assignment

Read 5.1-3.

Homework due Nov. 9: 3.9, 3.30, 4.10, 4.14, 4.15.

From Last Time

Measuring performance.

Outline

1. More definitions and terms.

2. Practice.

Coming Up

Building a simple MIPS datapath.

More Definitions and Terms

1. How should we summarize several benchmarks?
   1. Should we summarize?

   2. Use sum of execution times.

   3. Arithmetic mean is proportional.

   4. See CD (In More Depth) for interesting discussion of use of geometric means.

   Example:

   	Machine A	Machine B
   Program 1 (seconds)	1	10
   Program 2	1000	100
   Total time	1001	110

   1. Which machine is faster on Program 1? Program 2? Combined?

   2. Would your answer vary depending on execution frequency? How could we account for this? (Weighted average.)

2. Native MIPS:
   
   $$\rm MIPS = \frac{Instruction~Count}{Execution~time \times 10^6}$$
   
   
   As opposed to peak MIPS or relative MIPS.

   Native MIPS can vary inversely with CPU time!

3. Useful design principle: Make the common case fast.

Practice

Problems 4.38-4.44.

Tom Kelliher