Literature: Study Design and Analysis in General

List of books and articles on empirical studies and statistics in general. Some of the references have been adopted from David Chin's tutorial at UM2003.

Quick index:

Books

Kirk, R. E. (1995). Experimental Design: Procedures for the behavioral sciences. Pacific Grove, CA: Brooks/Cole.

Comment

Text and reference book for students and researchers in the behavioral sciences and education.

Keppel, G. & Wickens, T. D. (2004). Design and Analysis: A Researcher's Handbook. Englewood Cliffs, NJ: Prentice-Hall.

Robson, C. (1973, 1983, 1994). Experiment, Design and Statistics in Psychology. Penguin Group (USA) Incorporated. Latest edition: 3rd (1994).

Comment

A kind of cook-book for experimental studies with step-by-step precedures and examples.

Stevens, J. (1992). Applied Multivariate Statistics for the Social Sciences. Hillsdale, NJ: Lawrence Erlbaum.

Comment

From the publisher's website: This book "is written for those who use, rather than develop, advanced statistical methods. Dr. Stevens focuses on a conceptual understanding of the material rather than proving results. Helpful narrative and numerous examples enhance understanding, and a chapter on matrix algebra serves as a review."

Kutner, M.H., Nachtschiem, C., Wasserman, W., Neter, J. (1996).Applied Linear Statistical Models. McGraw-Hill:Irwin (4th edition).

Comment

Text and reference book for students and researchers in the behavioral sciences and education.

Journal articles

Kitchenham, B., Pfleeger, S.L., Pickard, L.M., Jones, P.W., Hoaglin, D.C., El Emam, K. & Rosenberg, J. (2002). Preliminary Guidelines for Empirical Research in Software Engineering. IEEE Transactions on Software Engineering, 28(8), 721-733

Comment

Collection of guidelines for conducting and reporting empirical research on software engineering. Most of these guidelines are applicable to user modeling as well.

Cohen J. (1994). The earth is round (p<.05). American Psychologist 49, 997-1003.

Comment

Most textbooks on statistical analysis do not explain why and how to analyse the power of statistical tests. Thus, this is an important complement to the standard books.

Erdfelder, E., Faul, F., & Buchner, A. (1996). GPOWER: A general power analysis program. Behavior Research Methods, Instruments, & Computers, 28, 1-11.

Comment

G*Power is a small program for power analysis of the most frequent statistical tests. It helps you to plan your sample size apriori or to check the test power post hoc. Moreover it can be used to calculate effect sizes.

Other resources

Wilkinson, L. and Task Force on Statistical Inference (1999). Statistical Inference in Psychology Journals: Guidelines and Explanations, American Psychologist, 54 (8), 594-604

Comment

Guidelines published by the American Psychological Association for writing journal articles that contain statistical data. Full text is available online.

Do you know a good textbook or online tutorial on statistics? Don't hesitate to add a comment here and we will include it in the list.