Information for Spring 07 CS239 --- Experimental Methodology for System Software

This page contains pointers to Postscript versions of slides used in CS239, Experimental Methodology for System Software. It also contains reading assignments from the textbook and pointers to other reading assignments, links to the homework assignments, and other material related to the class.

This page is organized by the weeks of the quarter in which lectures were given and papers assigned. The weeks are in inverse order, on the assumption you will most often be looking for the most recent week.

This class will be taught by Peter Reiher. The textbook is The Art of Computer Systems Performance Analysis, by Raj Jain. Assigned readings are from this book, unless otherwise indicated.

I will be lecturing on these subjects during the class.

Week 9 (May 28 - June 1)

Thursday, May 30

Slides:

Lecture 16.

Assigned readings:

Paper:

A Framework for a Collaborative DDoS Defense,, George Oikonomou, Peter Reiher, Max Robinson, and Jelena Mirkovic, 2006 Annual Computer Security Applications Conference (ACSAC 22). The point of assigning this paper isn't to teach you about DefCOM, but to give the full information on the actual experimentation and data presentation used for this system.

Tuesday, May 28

Slides:

Lecture 15.

No new reading assignment for today.

Week 8 (May 21 - May 25)

Thursday, May 24

Slides:

Lecture 14.

No new reading assignment for today.

Tuesday, May 22

Slides:

Lecture 13.

Assigned readings:

Textbook: Chapters 10 and 11 (pp 139-174).

Week 7 (May 14 - May 18)

Thursday, May 17

Slides:

Lecture 12. PPT again, due to a single equation.

No reading assignment for today.

Homework

No homework assignment this week.

Here are the answers to homework 3.

I neglected to post the answers to homework 2 earlier. Here they are.

Tuesday, May 15

Slides:

Lecture 11. Back to PDF handouts.

Assigned readings:

No textbook assignment for today.

Paper:

Planetlab: An Overlay Testbed for Broad-Coverage Services,, Brent Chun, David Culler, Timothy Roscoe, Andy Bavier, Larry Peterson, Mike Wawrzoniak, and Mic Bowman.

Web link:

The Emulab Tutorial.

Week 6 (May 7 - May 11)

Thursday, May 10

Homework

The fifith homework assignment is now available. It is due by the start of class one week from today, May 17. You may turn in a hard copy or submit your answers by email.

Slides:

Lecture 10. More equations, so this is in Powerpoint.

Assigned readings:

Textbook: Chapters 20 and 21 (pp 327-366).

Tuesday, May 8

Slides:

Lecture 9. More equations, so this is in Powerpoint.

Assigned readings:

Textbook: Chapters 18 and 19 (pp 293-326).

Week 5 (April 30- May 4)

Thursday, May 3

No lecture today because of the experimental design presentations.

Homework

The fourth homework assignment is now available. It is due by the start of class one week from today, May 10. You may turn in a hard copy or submit your answers by email.

Tuesday, May 1

Slides:

Lecture 8. More equations, so this is in Powerpoint.

Assigned readings:

Textbook: Section 15.1 (pp 244-254) and Chapters 16 and 17 (pp 275-292).

Data:

Here's the data and calculations for the extended example of IMDB movie rankings that I used in class.

Week 4 (April 23-27)

Remember, your project proposal is due on Thursday!

Thursday, April 26

Homework

The third homework assignment is now available. It is due by the start of class one week from today, May 3. You may turn in a hard copy or submit your answers by email.

Here are the answers to homework 1.

Slides:

Lecture 7.

Assigned readings:

Textbook: Chapters 7-9, pages 93-138.

Tuesday, April 24

Slides:

Lecture 6.

Assigned readings:

No textbook reading for today. Instead, . . .

Paper:

Tracefs: A File System to Trace Them All, A. Arnaya, C. Wright, and E. Zadok, FAST 04, 2004.

Week 3 (April 16-20)

Remember, your project proposal is due one week from today!

Thursday, April 19

Homework

The second homework assignment is now available. It is due by the start of class one week from today, April 26. You may turn in a hard copy or submit your answers by email.

Slides:

Lecture 5. No equations today, so we're back to the PDF form.

Assigned readings:

Textbook: Chapters 4,5, and 6, pages 47-91.

Tuesday, April 16

Dr. Reiher will be out of town, so there will be no class today. We will meet again on Thursday.

Week 2 (April 9-13)

Thursday, April 12

Homework

The first homework assignment is now available. It is due by the start of class one week from today, April 19. You may turn in a hard copy or submit your answers by email.

Slides:

Lecture 4. Note that these slides are in Powerpoint, not PDF. The PDF renderings of some equations in previous lectures were unusable, so I'm putting up the original Powerpoint version, instead. I have also made the Powerpoint versions of lectures 2 and 3 available, listed under those lectures below.

Assigned readings:

Textbook: Chapter 14. sections 15.5 and 15.6. You might find it helpful to read all of chapter 15, which is on multiple linear regression and other issues in regression modeling.

Tuesday, April 10

Slides:

Lecture 3

Lecture 3 in Powerpoint

Assigned readings:

Textbook: Chapter 13.

Week 1 (April 2-6)

Thursday, April 5

Slides:

Lecture 2

Lecture 2 in Powerpoint

Assigned readings:

Textbook: Chapter 12.

Tuesday, April 3

Slides:

Lecture 1

Assigned readings:

Textbook: Chapters 1-3.

Paper:

Should Computer Scientists Experiment More?, Walter F. Tichy, IEEE Computer, May 1998.