IBM Journal of Research and Development
IBM Skip to main content
  Home     Products & services     Support & downloads     My account  

  Select a country  
Journals Home  
  Systems Journal  
Journal of Research
and Development
    Current Issue  
    Recent Issues  
    Papers in Progress  
    Recent publications  
    Author's Guide  
  Contact Us  
  Related links:  
     IBM Research  

IBM Journal of Research and Development  
Volume 25, Number 6, Page 848 (1981)
Computer System Performance Evaluation
  Full article: arrowPDF   arrowCopyright info


Design of Experiments in Computer Performance Evaluation

by M. Schatzoff
Techniques of statistical design of experiments have been successfully employed for many decades in a variety of applications in industry, agriculture, medicine, psychology, and other physical and social sciences. Their aim is to provide scientific and efficient means of studying the effects, on one or more variables of interest, of varying multiple controllable factors in an experiment. These techniques have not been widely used in the study of computer systems, although they can potentially have as large an impact as they have had in other fields. The purpose of this paper is to review some of the basic concepts underlying the statistical design and analysis of experiments and to illustrate them by means of examples drawn from studies of computer system performance. The examples include comparisons of alternate page replacement and free storage management algorithms, optimization of a scheduler, and validation of a system simulation model.
Related Subjects: Mathematics (applied); Performance analysis; Statistics