Quantitative Research Methods 

 

                

 

 

Sociology 101

Pitzer College

Fall 2007                                        Tues/Thurs 12-1:10

 

Peter M. Nardi

 

Office: Broad Center 205, ext. 73824

e-mail: peter_nardi@pitzer.edu

Tu/Th 10:00-11:00; 2:30-4:00

Other times by appointment

 

Course Description

How we come to know about the social world and the ways people think and act depends a great deal on how we conduct research. This course is an introduction to the various methods and techniques used by sociologists to gather and evaluate data. We focus on the quantitative methodologies: survey research, questionnaire design, content analysis, and statistical data analysis. Learning how to collect reliable and valid data, how to analyze data statistically with a computer, and how to read statistical tables of data are the goals of the course.

Required Readings                           

Doing Survey Research, Second Edition, Peter Nardi (Allyn & Bacon, 2006)

Interpreting Data, Peter Nardi (Allyn & Bacon, 2006)

Course Requirements     

Since the goal of the course is to develop quality research skills in quantitative methods, your work this semester focuses on learning to do research that can be carried out with minimum costs and time. You will be asked to develop a questionnaire, collect data, and analyze the findings statistically.

There are six homework assignments and three exams on the material. There is no final exam. Exams are based on all material covered in the book and in class since the last exam. You are primarily responsible for what is discussed in class. Homework accounts for 50% of your grade and exams for 50%; class participation is used to decide “borderline” grades. There is no “extra credit.” The last homework is a final project which counts as two homeworks. Homework is penalized a half grade for every day it is late. Make-up exams are only available when there has been some emergency which must be documented by the Dean of Students Office.

 

Important: Do not fall behind in this class: late assignments will be penalized and, after one week, will not be accepted. It’s important that you keep up with the assignments since each unit depends on the previous material. You can not play “catch-up” in this class. There will be lots of hands-on work during class hours, so class participation and regular attendance are necessary to do well in the course. In addition, you must plan to spend time each week practicing on the computer and planning ahead.

If you miss any classes, you are responsible for obtaining the class notes; do not expect me to give make-up lectures in my office. However, you are encouraged to come to speak with me about any of the material and ask any questions about the classes you attend. Do not fall behind just because you don’t understand the material! It pays to ask questions, to ask for help. I do not bite.

And remember: whenever you deal with computers, expect some problems. Do not plan to do your work the night before; prepare well in advance. You may help out one another, but you must do your own work, using different variables, hypotheses, and ideas. Plagiarism – copying work that belongs to someone else – results in receiving an F for the assignment or exam, and may result in a hearing before the Judicial Council.



Course Schedule: Topics and Assignments

Week:  Sept. 4                               Science & Sociology

 

Goals: The differences between everyday thinking and scientific thinking are discussed. An argument is made about the advantages of doing survey research and understanding various kinds of research: exploratory, descriptive, explanatory, and evaluation.

                                                         Finding Ideas to Research

 

Goals: Discovering topics to study by searching for research ideas and finding existing studies. Learning to write a good literature review is discussed, especially in the context of using theory to guide your research. The ethical issues involved in doing research are raised.

 

Assignments: SR Chs. 1-2

 

 

Weeks: Sept. 11 & 18                   Concepts, Hypotheses, and Measurement

 

Goals: Central to doing survey research is understanding the idea of operationalization and how to go from ideas to concepts to variables. Learning the various levels of measurement is also essential for analyzing data.

 

Assignments: SR Ch. 3, Homework #1 (Thurs, Sept. 20)

 

 

Weeks:  Sept. 25 & Oct. 2           Descriptive Statistics

 

Goals: Understanding how to describe your findings using graphs, tables, and statistics in SPSS is the focus. In addition, you will learn the mean, median, mode, standard deviation for presenting data. The concepts of the normal curve, z-scores, probability, and statistical significance are discussed.

 

Assignment: SR Ch. 6 & ID Chs. Intro & 1; Homework #2 (Thurs, Oct. 4)

 

 

Week:  Oct. 9                                Developing a Questionnaire

          

Goals: To learn how to design a questionnaire: how to write attitude, behavior, and demographic questions and format a survey. Coding responses and preparing data for computer analysis are important skills discussed as well.

 

Assignments: SR Ch. 4; Exam #1 (Tues. Oct 9)

 

 

Week:  Oct. 16                              Sampling

 

Goals: To understand random probability sampling and the different methods for obtaining samples. You will also learn about longitudinal and cross-sectional research designs.

 

Assignment: SR Ch. 5, Homework #3 (Tues, Oct. 16 & Thurs, Oct. 18)

 

 

Weeks: Oct. 25, 30, Nov. 6         Analyzing Data: Bivariate Relationships

Fall Break (Oct. 23 Tues)

 

Goals: Understanding bivariate statistical analysis is the focus. Central to this is learning how to read and construct cross-tables of data and deciding which statistics to use to measure association and correlation.

 

Assignments: SR Ch. 7 & ID Chs. 2-3; Exam #2 (Thurs, Nov. 1); Homework #4 (Thurs, Nov. 8)

 

 

Week: Nov. 13                              Analyzing Data: Comparing Means

 

Goals: Learning how to assess differences between means using t-tests and analysis of variance. As with other bivariate data analysis, knowing when to use these statistical procedures and how to interpret them is central to testing hypotheses.

 

Assignments:  SR Ch. 8 & Ch. ID 4

 

 

Week: Nov. 20, 27, & Dec. 4      Analyzing Data: Multiple Variables

T-giving (Nov. 22 Thurs)

 

Goals: The analysis of three or more variables to answer more complex research questions is described. When to use various kinds of multivariate analyses, such as multiple regression, and how to elaborate your findings with additional control variables are discussed.

 

Assignment: SR Ch. 9 & ID Ch. 5; Homework #5 (Tues, Nov. 27), Exam #3 (Tues, Dec. 4)

 

 

Week: Dec. 11                              Presenting Results & Sharing your Findings

 

Goals: Learning to write a report of the research project is emphasized, along with the key elements that go into a presentation of your study. Understanding the different audiences reading a report guides the preparation of the findings.

 

Assignments: SR Ch. 10, Homework # 6: Final Projects due no later than Thursday. Dec. 13.  Share your research in an oral presentation on Tues. Dec. 11

 

 

Links to other quantitative methods and statistics guides

 

 

 

 


 

 

 

 

 

Homework

 

 

When submitting homework, pages must be stapled together and typed. If submitting computer output, please give only the relevant tables, number the items clearly, and be sure the text goes on the same page as the appropriate tables.

 

Whenever you deal with computers, expect some problems. Do not plan to do your work the night before; prepare well in advance. You may help out one another, but you must do your own work, using different variables, hypotheses, and ideas.

Plagiarism – copying work that belongs to someone else – will result in receiving an F for the assignment or exam, and may result in a hearing before the Judicial Council.

 

Ø      Please review all the exercises at the end of each chapter, especially the material for Review, Interpret, and Consult. You may be asked in class and on exams to provide answers for the questions not used in the homeworks.

Ø      Suggested answers to questions available Doing Survey Research exercise answers

 

Homework #1: due Sept. 20 (Thurs)

 

(1) Briefly provide answers to the following questions:

 

(a) p. 40, Consult questions 2, 6, 7

(b) p. 63-4, question 1

 

(2) Using the data from the General Social Survey (GSS), available in SPSS,

 

      (a) select 4 variables and label the level of measurement for each one;

      (b) write two hypotheses: one using 2 of the variables you selected, the second using the other two variables;

      (c) label the type of hypothesis you wrote (null, etc.);

      (d) identify the independent and dependent variable; and

      (e) suggest what you think the hypothesis will show when you look at the data.

 

 

 

DO NOT DUPLICATE EXAMPLES USED IN THE TWO BOOKS or in CLASS for any of the homework assignments!

 

 

 

Homework #2: due Thurs (Oct. 4)

 

1. Submit answers to the 4 questions on p.17 of ID (Box 1.2 which begins on p. 16))

 

2. Using the two hypotheses from Homework #1:

 

(a)  Present a frequency table, an appropriate graph, and the relevant measures of central tendency for each of the variables in your hypotheses. This means: four frequency tables, four graphs, and four sets of relevant statistics (circle the measures of central tendency you are using and cross-out those that are not relevant).

 

(b)  Describe in words what you have learned from these statistics and graphs. Are these all variables that can be used for further data analysis? Is there some variation or are they close to being constants? What do the measures of central tendency indicate? Do not simply repeat what is in the tables – interpret them!

 

NOTE: The stapled homework must be submitted for one hypothesis at a time, that is, state the hypothesis, present the graphs and measures of central tendency, and interpret the relevant table and statistics. Then start the next hypothesis on a new page and present the same information for those two variables.

 

 

Homework #3: due Oct. 16 (Tues) and Oct. 18 (Thurs)

 

Write a 2 page questionnaire that includes 4 measures each of behavior, attitudes, and demographics. Design and format it as if it were ready to be distributed.

 

Bring TWO copies of the questionnaire to class on Oct. 16

On Thurs (Oct. 12), submit a revised version.

 

 

Homework #4: due Nov. 8 (Thurs)

 

1. Submit answers to the 7 questions on p. 66 of ID (Box 3.4, which begins on p. 65)

 

2. Submit answers to the 3 “Consult” questions on p. 175 of SR.

 

3. Using the SPSS data sets:

(a) Present one cross-tab using ordinal or nominal variables with the relevant statistics, and then one Pearson r correlation with another two appropriate variables.

 

(b) Label the independent and dependent variables and state the levels of measurement for each variable.

 

(c) Interpret the statistics (value, probability level).

 

(d) Put into everyday words what you have found. What do you conclude?

 

Remember: you should be distributing your questionnaires by now.

 

 

Homework #5: due Nov. 27 (Tues)

 

1. Submit answers to the 7 questions on p. 88 of ID (Box 4.3)

 

2. Submit answers to “Consult” question #1 on p. 191 of SR.

 

3. Using the SPSS data sets:

 

(a) Write one hypothesis to test the differences between means that can be tested using ANOVA.

 

(b) Write a second hypothesis suitable for a t-test, either paired samples or independent samples t-test.

 

(c) Label all the variables in terms of levels of measurement. Do not reuse the same variables – choose different ones for each hypothesis and do not duplicate any that appear in the book or used in class.

 

(c) Interpret the statistics and significance level for each hypothesis. Do you accept or reject your hypotheses?

 

(d) Put into everyday words what these results tell you.

 

NOTE: The stapled homework must be submitted for one hypothesis at a time, that is, give the hypothesis, label the variables, present the statistics. Then start the next hypothesis on a new page and present the relevant information for it.

 

 

Remember: you should be coding your questionnaires by now.

 

 

 


 

Homework #6: Final Projects due no later than Dec. 13 (Thurs)

 

The final project counts double.

 

(1)  State your research topic clearly: what was your objective? What did you want to know?

 

(2)  Explain your sampling strategy and some relevant characteristics (demographics) of your respondents (for example, what percentage are men/women, how many are sophomores, etc.?).

 

(3) Describe two of these demographic variables by presenting relevant graphs and measures of central tendency for them.

 

(4)  Write four hypotheses to be tested:

 

a.                              one should test a difference in means,

b.                              another should be suitable for a regression analysis with at least three independent variables,

c.                              the third should be presented as a crosstabulation of nominal or ordinal data with relevant statistics, and 

d.                              the fourth is your choice.

 

F       The homework must be submitted for one hypothesis at a time, that is, give the hypothesis, label the variables, present the statistics and interpretations. Then start the next hypothesis on a new page and present the relevant information for it.

 

(5) As you did with earlier homeworks, label each of the independent and dependent variables and state the levels of measurement for each variable. Do not reuse the same variable more than two times (for example, do not use “gender” in more than two hypotheses).

(6)  Present the appropriate tables and statistics for each of your hypotheses and interpret the results statistically.

 

(7)  Put into everyday words what you have found.

 

(8)  Make some final conclusions about your project (what you would do differently, any problems, what you would recommend future researchers studying your topic should do, etc.).

 

(9)  Prepare a summary of your study for a five-minute in-class oral presentation.

 

 

 

 

Doing Survey Research exercise answers

Doing Survey Research: A Guide to Quantitative Methods

2006, Allyn & Bacon Publishers

 

Suggested Answers to Exercises

 

© Peter M. Nardi

 

Note: Many of these exercises have multiple correct answers and these are just some of the possible ones.

 

Chapter 1                                                                    Chapter 6

Chapter 2                                                                    Chapter 7

Chapter 3                                                                    Chapter 8

Chapter 4                                                                    Chapter 9

Chapter 5                                                                    Chapter 10

 

CHAPTER 1:

Interpret: What Do These Real Examples Tell Us?

 

1a.  Faulty reasoning and cause-effect: It assumes that the teacher training is the source of the problems in public schools today. While it might be a factor, alternative causal explanations (such as per pupil expenditures, quality of the school building, social class background of the children, availability of classroom resources like computers and textbooks, and salaries) might be stronger explanations of the “bad education public school kids” get. Also, incorrect generalization: not all public school education is bad and perhaps the media stories are focused more on the problem schools than the good ones.

 

1b.  Another untested cause and effect (If…then) relationship: It assumes that requiring national standardized tests will result in teachers emphasizing the test content and preparing students to pass tests. This logic may be accurate, as some studies are beginning to suggest, but what is the evidence for this? How might it be verified.

 

2a.  Since the goal is to understand “why” variations in drug use occur, the study is seeking explanations and can be considered an “explanatory” study.

 

2b.  The excerpt illustrates “descriptive” research since it focuses on providing the demographic characteristics of those who are caregivers. It does not tell us why they are caregivers.

 

2c.  This finding is primarily an example of explanatory research since it tell us the reasons why some people are less likely to fear crime and perceive themselves more vulnerable to assaults. The “cause” is how well integrated they are in the community. Although the findings describe those who are less fearful as being happy with neighbors and more satisfied with their city, it does not tell us the demographic characteristics of them, that is, male or female, race/ethnicity, social class, or age, to name a few.

 

 

 

Consult: What could be done?

 

1.  This is faulty cause and effect reasoning. It implies that moving into the dorm will cause you to get higher grades.

 

2.  It does not take into account alternative explanations or other plausible causes. Research would tell us what other factors are involved, such as describing who actually lives there. What if more women are in the dorm and on this campus, women tend to have higher GPAs and better study skills? What if there is a racial/ethnic factor to explain the grades or how well the students bond together in a sense of community?

 

3.  Perhaps the cause-effect direction is the other way: the dorm attracts the best students. We need to do some research on this and not just base it on rumor.

 

 

Decide: What Do You Do Next?

 

1.  Perhaps you heard that those who watch more TV tend to believe in stereotypes more. We know from research that heavy TV viewers for example believe they will more likely be a victim of stranger violence even though more people are victims of violence from people they know. Everyday thinking problems of overgeneralizing, faulty samples, and incorrect cause and effect relationships could result in racist conclusions.

 

2.  (a) Explore: carry on some focus groups simply asking people what images they get from TV of various ethnic/racial groups or conduct some content analysis of the highest rated prime time TV shows. (b) Design a questionnaire to find out which kinds of people are more likely to believe the stereotypes and media depictions: men or women, higher educated or less educated, people of color or whites, etc., and find out what their opinions are. (c) Interview heavy and light TV viewers and compare the results of their opinions toward different groups and see if there is a relationship between the number of hours watching TV and their attitudes.

 

3.  You would need to rule out other possible reasons that might explain their opinions, for example their own race/ethnicity and educational levels, and show that their attitudes were there before they watch the shows.

 

 

CHAPTER 2

 

Interpret: What Do These Real Examples Tell Us?

 

1a.  The authors use such ideas as strain theory, cultural deviance theory, and social disorganization theory to generate ideas for investigating the links between immigratin and crime. Note that the theories are not about immigration but focus on the origins of crime.

 

1b.  Deductive since the theories are being used to generate ideas for a study on immigration and crime.

 

1c.  For example, using Sutherland’s cultural deviance theory, if the immigrant group has distinctive cultural traditions that promote or accept criminal behavior, then we can expect a higher crime rate.

 

1d.  For example, using strain theory, we could ask what are the blocked socioeconomic opportunities faced by immigrants, such as access to education and good schools, discrimination in the job market, or getting lower wages at work.

 

1e.  What is the impact on the immigrants of asking questions about their attitudes toward crime? What if they are illegal immigrants, how can confidentiality be assured? How confidential can we be when asking people about criminal behavior? What privacy issues are at stake if seeking public records or police files?

 

 

2a.  Anonymity is assured, use of opaque envelope demonstrates that the answers from individuals cannot be seen or read by others and thereby linked to a particular person, people not connected to the particular school are proctoring the survey so confidentiality is further emphasized since they don’t know the students personally, permission from parents was sought for their children’s participation, names were not recorded again assuring anonymity, respondents were told they could skip questions and thus not forced to participate either in the study or parts of it.

 

2b.  Other ethical concerns: how will the findings be used, given the sexual nature of the survey? How will it be handled for those students who were denied permission by parents to participate, especially if most do complete the survey?

 

2c.  The absence of a signed form could possibly mean that the parents never even saw the form, and never had the chance to deny permission. But asking to deny permission probably results in more students participating. On the other hand, having parents sign to give permission could result in forged permission slips, or forms never returned on time and thus result in fewer participants.

 

 

Consult: What could be done?

 

1.  This is a sensitive topic that could be raising issues in the respondents yet to be worked out. Confidentiality needs to be assured and informed consent has to be present before proceeding with such a topic.

 

2.  Is this really voluntary? How safe are they from physical or mental harm?

 

3.  Is this really voluntary when extra credit is offered by a teacher?

 

4.  It would be unethical if respondents did not know what the topic of the survey was and did not have the option of opting out or skipping questions. Otherwise, these are legitimate topics for research.

 

5.  Has permission been granted by parents or guardians for these minors? Given the topic of drug use, is there informed consent, guarantees of anonymity or confidentiality, and discussions of how the findings will be used. Monetary incentives might lead those from lower income backgrounds to participate, thereby making it less voluntary.

 

6.  Is there physical harm in giving people high fat foods, especially if they have not been screened for previous health concerns? Are they participating with informed consent?

 

7.  Nothing unethical unless control group subjects were not debriefed about the placebo. Some people feel that any experiment involving a group of subjects not receiving the treatment is deceptive and should stop as soon as evidence is available that the treatment works. It then should be offered to those in the control group.

 

 

Decide: What Do You Do Next?

 

1.  Communications and media journals, sociology and psychology databases, ethnicity/race sources

 

2.  Television and race and attitudes; media images and race; stereotypes and television

 

3.  Students should search for media web pages and studies on racial images,

 

4.  Different racial/ethnic categories, types of TV shows monitored (news, sitcoms, dramas, TV movies), portrayal of characters (criminals, leaders, power roles, targets of violence or jokes, lead characters or secondary roles), attitudes towards minorities (favor equal treatment, reinforce negative stereotypes, believe positive images)

 

 

CHAPTER 3:

 

Interpret: What Do These Real Examples Tell Us?

 

1.         Age: interval/ratio

 

            Ethnicity: dichotomous nominal measure, could be used as dummy ordinal or interval/ratio measure

            Education: if years of schooling expressed in grades (such as tenth grade, or eight grade), then interval/ratio. If expressed as “some high school,” “high school graduate,” “some college,” “college graduate,” and so on, then it’s an ordinal measure.

 

            Income: ordinal categories

           

Religious: dichotomous nominal measure, could be used as dummy ordinal or interval/ratio measure

 

 

2a.  one-directional; independent variable is age of organization, dependent variable is likelihood of adopting technology.

 

2b.  one-directional; independent is number of personnel with technical backgrounds, dependent is when (perhaps number of years ago) they adopted technology.

 

2c.  two-directional, independent is size and complexity of organizations, dependent is usage of technology.

 

 

3.  Criterion validity of the concurrent type was established by using an external measure to verify the accuracy of the results from the LPT, namely the Barnell-Loft Series of reading. It is valid for the at-risk groups listed. Reliability was demonstrated presumably by giving 46 students the LPT at two different times. The results were compared and the result was close to the perfect relationship of 1.0.

 

 

Consult: What could be done?

 

1.  First they need to develop some research questions or hypotheses and construct a research design. They need to make a list of variables to measure the concepts: plans to go to college, grades, and self-esteem. How will they operationalize the variables?

 

2.  The school administrators need to consider the reliability and validity of the measures they will develop, and find out what they are for various standardized self-esteem scales. Use the Internet or a resource book in the library to find scales and compare the reliability and validity of the available self-esteem scales, such as the Rosenberg self-esteem scale.

 

3.  You need to advise the administrators about the ethics of studying minors who need permission of parents to participate in the research. It is also important to consider what the impact would be on them if asked questions about self-esteem and what you will say to allow them informed consent to participate. They need to be told about the confidentiality or anonymity of the study.

 

 

 

CHAPTER 4

 

Interpret: What Do These Real Examples Tell Us?

 

1a.  Good that it specifies a time frame (“during the past week”), but question implies that one was read (“which newspaper was that?”). Should prompt the interviewer to skip the second part if respondent says “none.” A self-administered survey would have to indicate some branching either visually or in words.

 

1b.  Like the previous one, some prompts should be given to the interviewer if respondent says “no” to seeing or hearing a show. “Political or social issues” might need to be defined with an example or two. A self-administered survey would also have to indicate some branching.

 

1c.  Might be necessary to specify that you are asking about a political party, or who they voted for in the last election, or if they are actually registered with a party. But

it does say “generally speaking” so it should be clear that this is about an identity. On a self-administered survey, it should be made specific since there is no one to ask to clarify.

 

1d.  Some might see this as a double-barreled item in that they could consider government and public affairs as two separate things. A self-administered questionnaire would use a Likert scale format for the choices (“most of the time” = 1, etc.).

 

 

2a.  If living with both their own mother and father, the interviewer must skip to question 8 about what kind of work the father did, otherwise ask item A for the remaining answers to find out what happened to parents.

 

2b.  closed-ended items are also provided in Item A, and for 8 E. Open-ended items are asked about occupation and place of work (Items for 8).

 

2c.  Could be confusing, especially the box (IQ-3 Interviewer) with further instructions to check back on Q. 7.

 

2d.  It is important that an interviewer rehearse this section given all the contingency items and branching. It also saves time during the interview and prevents the respondent from feeling that the interviewer doesn’t know what he or she is doing, and thus call into question the reliability and validity of the study.

 

 

Consult: What could be done?

 

1.  Such things as: bad format and biased instructions (assumes quality of service and food needs improving), items not numbered, more than one per line, vague questions without time frames (ate how often in the past week? Month? When?), items often have more than one “right” answer, options not mutually exclusive (cereal is a vegetarian meal and fruit can be a dessert; what if you are 5’ 5” tall?) or exhaustive (other items available in cafeteria), double-barreled items (ham and eggs), wordy biased items (“Some people feel…”), invoking an authority biases item (“a nutritionist from the Department of Health”), no branching (last item “Why do you thing she is not wrong” not only is poorly worded but assumes previous answer is “No”), no date when survey is due to be returned, invites comments but doesn’t say about what, scale from 1 to 10 doesn’t specify if 1 or 10 is the best quality food, and so on. Numerous mistakes to find.

 

Here is an example of a much better survey:

 

Cafeteria Food Survey

 

We are interested in hearing your candid opinions about the food and service in the cafeteria. Your responses are anonymous.

 

A. Here are some questions about the cafeteria. Please circle the responses that best capture your experiences.

 

1. Within the past week, did you go to the cafeteria at least once for a meal?

What was your main reason for not going this past week?

 

 

 

 

 

Skip to Question 3

 
 


            (1)  Yes                                    (2) No 

 

 

 

 

 

 

 

 

2. For each of these meals, please indicate how frequently you went to the cafeteria for a meal this past week:

 

                                                None       1 to 3 times      4 to 6 times      Every Day   

 

(a) Breakfast                               0                   1                         2                   3                     

 

(b) Lunch                                    0                   1                        2                   3

 

(c) Dinner                                    0                     1                       2                   3

 

 

 

3.  On a scale of 1 to 7, where 7=Terrific, please evaluate the following based on your last visit to the cafeteria:

 

(a) quality of the food   (terrible)  1           2          3          4          5          6          7 (terrific)

 

(b) selection of foods        1     2          3          4          5          6          7  

 

(c) friendliness of staff        1     2          3          4          5          6          7  

 

(d) layout of the room       1     2          3          4          5          6          7  

 

 

 

 

 

4. Now we’d like to get your opinions about the cafeteria.

 

                                                            Agree               Agree               Disagree           Disagree

                                                                                    Somewhat        Somewhat

                                                           

(a) I look forward to eating here.       1              2                      3                      4

 

(b) The food needs much

improvement                               1                    2                      3                      4

 

(c) The people who work there

are friendly                                 1                    2                      3                      4

 

(d) The place is too dirty                         1                    2                      3                      4

 

(e) There are not enough choices

 in the food served                      1                    2                      3                      4

 

(f) It is a comfortable place to eat            1                    2                      3                      4

 

 

 

B. Finally, we’d like to know a little about you.

 

5. Gender:        Male……… 1

                        Female……2

 

6. Your age:  Under 21………..…1

                        21-25……………...2

                        26-30……………...3

                        31-35……………...4

                        36-40……………...5

                        41-45……………...6

                        46-50……………...7

                        51 or more………..8

 

 

7. Please add any additional comments you have about your experiences in the cafeteria.

 

 

 

 

 

Please return your survey to the Human Resources Office by November 10.           

 

 

 

CHAPTER 5:

 

Interpret: What Do These Real Examples Tell Us?

 

1.  A probability sample using some (unspecified) interval: given the special listing of subscribers, there could already be a bias in the original list, unless the study is focusing on subscribers. Strength is that it is a random sample.

 

2.  Random digit dialing is a good way of generating a random probability sample, although it excludes those who cannot afford telephones. An adult member willing to participate, however, may create a volunteer bias and limit the generalizability.

 

3.  Two stages or clusters used in this probability technique, resulting in a potentially good random sample, given the high response rate.

 

4.  Starting out as a random sample is a strength, but a longitudinal panel design resulted in a high attrition rate, calling into question the generalizability of findings from the more recent sample.

 

5.  Probability random sampling within strata of sex and job category seems appropriate for a study on salaries, especially since pay differs by sex and type of job. This technique guarantees finding people randomly within different jobs and gender.

 

6.  Small convenience sample of volunteers at a university limit how much the findings can be generalized to other students or non-students.

 

7.  First convenience sampling is used by finding respondents from organizations that are not selected randomly. Then, snowball sampling is a non-probability technique used to generate respondents in difficult to find groups. Although this resulted in a sample of people needed for a study on Asian issues, the results cannot be generalized beyond the 64 people who participated.

 

 

Consult: What could be done?

 

1.  A population study was done and if everyone (or at least a very large majority of them) completed the survey, then it would be accurate to make conclusions about the entire campus. However, with only 25 percent responding, it is possible that only the drug users and alcohol drinkers took an interest in the topic and answered the questionnaire. This could result in an over-sampling of users.

 

2.  The conclusions should be made only about the 25 percent who responded, not about the entire campus. Demographic data should be reviewed to see if there is a

pattern as to who completed the questionnaires and compare that information to a profile of the university. Is the sample at least representative then?

 

3.  The university should be advised to conduct a random sample of students, or to send follow-up notes and surveys to increase the initial response rate, or to employ convenience sampling methods and distribute surveys in large classes, again with the intention of increasing the response rate.

 

 

CHAPTER 6

 

Interpret: What Do These Real Examples Tell Us?

 

1a. The variables are ordinal levels of measurement with equal-appearing intervals typical of Likert-type scales. These are suitable for means and standard deviations.

 

1b.  For Blacks, racial-ethnic identity is more important when at work then when at home (2.89 versus 2.42), more important when at home for multiracials, and about the same at home and at work for whites. Compared to whites and multiracials, racial-identity is more important for Blacks at work (2.89 versus 1.82 versus 1.95) and at home. The standard deviations tell us that Blacks also are more dispersed on these measures than multiracials and whites, that is, their scores on these measures vary more than it does for others.

 

 

2a.  The number of partners is not normally distributed and more than likely positively skewed, namely very few people at the higher end of number of partners (that is with 1,016 partners!).

 

2b.  Half of the 3126 respondents (that is, 1563) had under 3 partners and the other half had more than 3. The most common response is 1 partner.

 

2c.  The range is 1016 – 0 = 1016. Other useful information might be interquartile range and a frequency graph.

 

 

3a.  Because the mean, median, and mode are virtually the same, it is very close to a normal curve.

 

3b. i.  68 percent, because 63.3 is 4 inches below the mean, and 71.3 is 4 inches above the mean, that is, one standard deviation unit above and below the mean. 68 percent of all scores on a normal distributions are within one standard deviation unit plus and minus.

 

3b. ii.  any height shorter than 63.3 inches, because 16 percent of a normal distribution are more than 1 standard deviation units away.

 

3b. iii.  50 percent since 67 inches is the median height.

 

3b. iv.  People either shorter than 59.3 inches or taller than 75.3 inches would be statistically different from the mean because they are more than two standard deviation units (8 inches) above or below the mean.

 

3b. v.  Between 59.3 and 75.3 inches, since around 95 percent of all the scores fall between those heights.

 

 

Consult: What could be done?

 

1.  First step is to review frequency distributions (tables, graphs) for each variable to make sure that they are all variables and not constants. Any variable that does not have an adequate distribution cannot be used for further data analysis.

 

2a.  mode, bar graph or pie chart

 

2b.  mean, median, standard deviation, histogram or frequency graph

 

2c.  median, pie chart or bar graph  [ordinal measure]

 

2d.  median (mean if normally distributed), frequency graph or histogram

 

2e.  mode, bar graph or pie chart

 

 

CHAPTER 7:

 

Interpret: What Do These Real Examples Tell Us?

 

1a.  -.255, the minus sign does not make it weaker than .098.

 

1b.  An inverse relationship, so those respondents with more education tend to watch less television, or conversely, those with less education watch more TV.

1c.  A correlation of .098 is virtually zero, therefore almost no correlation exists. Low correlation coefficients can be significant when sample sizes are large.

 

 

2a.  There is no relationship between companies having political action committees and lobbying the government. There is no relationship between companies having political action committees and donating to charities.

 

2b.  67% of companies without PACs do not lobby the government, compared with 75% of companies with PACs that do lobby the government. In words: having a PAC is related to lobbying. Not having a PAC is related to not lobbying and not giving to charity.

 

2c.  The number of the chi-square itself does not give any information, although since the number of cells and units of analysis are the same for each table, they are comparable with each other. The one for lobbying is larger, and therefore indicates a more significant finding. Yet, both are statistically significant: the probability of these chi-squares occurring by chance is less than 1 in 1,000. Df was calculated by calculating the number of rows minus 1, multiplied by the number of columns minus 1, that is, (2-1) x (2-1) = 1 x 1 = 1.

 

2d.  Reject the null hypotheses and conclude that there is indeed a relationship between companies having PACs and lobbying and giving to charity. Those who have PACs tend to lobby more and are slightly more likely to give to charity than those without PACs.

 

2e.  Because these are dichotomous measures, gamma could be used and even a Pearson r correlation.

 

 

 

 

CHAPTER 8:

 

Interpret: What Do These Real Examples Tell Us?

 

1a.  It is a comparison of means between two categories (male and female).

 

1b.  There is no difference in age, years of education, and days trained between men and women. For age and days trained, the probability of the t-test values occurring by chance is less than 1 in one thousand, and for years of education it is less than 5 in one hundred. In short, they are all statistically significant and the null hypotheses would be rejected.

 

1c.  There is a difference in age, years of education, and days of training between men and women: Men are older, have more education, and required more days of on-the-job training.

 

2a.  It is comparing autonomy and conformity scores among five different social class groups of Chinese workers.

 

2b.  There is no difference in mean autonomy scores and mean conformity scores among the different social classes (cadre, professional, etc.). Both F values are statistically significant at the .001 level, and the null hypotheses can be rejected.

 

2c.  There are significant differences in autonomy and conformity among the social classes: Nonmanual, cadre, and professionals are higher in autonomy, while supervisors and manual workers value conformity more.

 

 

           

Consult: What could be done?

 

 

2.  Ask for confidential data of employees’ years of education and salaries. No names need be attached. Alternatively, you could ask employees to self-report their years of education and salaries on an anonymous survey. If data remain in interval/ratio form, then a Pearson r correlation could be calculated, but to answer the specific question of higher educated versus lower educated, the employees would be divided into two groups (higher and lower educated, perhaps determined by cutting at the median, or deciding to take those with less than college education and compare to those with some graduate education). Then a mean salary (assuming it is in interval/ratio form and not

ordinal categories) would be calculated for the two groups and a t-test would be used to statistically test the difference in salaries.

 

 

CHAPTER 9:

 

Interpret: What Do These Real Examples Tell Us?

 

1a.  There is no relationship between Asian American’s GPA and how academically prepared they are, how confident they are in finishing their degree, and their employment status. Regression is used since there is more than one independent variable and all are measured as either equal-interval ordinal or ratio/interval measures.

           

1b.  Academically prepared and confidence are statistically significant, while employment status is not. Academically prepared is very strong, almost twice that of confidence.

 

1c.  It says that 26% of the reasons why Asian Americans vary in their GPA can be explained by these three independent variables. R is a PRE when squared.

           

1d.  Those Asian Americans with the highest GPA tend to be better prepared academically and have higher confidence in finishing their degree. It does not seem to matter what their employment status is.

 

 

2a.  Women are more likely to graduate than men, or men are less likely to graduate than women.

 

2b.  This relationship is statistically significant. Getting a chi-square value of 6.79 for a table with 1 degree of freedom could occur by chance nine times in 1000.

 

2c.  The first table (those with a B grade or lower) shows that there is very little difference between graduation rates of men and women. 59.8% of women graduate compared with 54.6% of men. For those with higher grades, 71.8% of women graduate compared with 60% of the men, a much larger difference.

 

2d.  The chi-squares confirm that the relationship between sex and graduation rates is statistically significant only for those with grades of B+ or higher.

 

2e.  Specification: The control variable of grades specifies the original relationship. It disappears for those with grades of B or under, and is replicated for those with grades of B+ or higher. 

 

           

Consult: What could be done?

 

1.  Before you can declare a cause and effect relationship, it is necessary to first establish that a correlation exists between income and political party and that alternative variables do no alter the original relationship. One can calculate ANOVA to compare the average incomes among respondents from different political parties, or if income is in ordinal categories, to construct a crosstable and test with lambda and chi-square. Then introduce a control variable, such as educational level or age, and see if the original relationship remains.

 

 

2.  The dummy variable of Democrat and Republican can be used as a dependent variable in a regression analysis, and income, age, educational level could be entered as independent variables. Beta weights will tell us which are good predictors of voting Republican or Democrat.

 

 

CHAPTER 10:

 

Interpret: What Do These Real Examples Tell Us?

 

1.  Clearly specifies the time and location of gathering a census of homeless people, both in shelters and on the street. The use of the word “census” implies that this is an attempt to document the population from which a sample could later be drawn. As described in the next paragraph, a stratified random probability sample was used (here called a random quota). Interviews were conducted with a structured and open-ended questionnaire. It specifies the sampling strategy and the types of questions being asked. In general, a decent summary of the methods, although it might specify who (race, gender, etc.) is conducting the interviews, how they were trained, and more about the survey questions and their validity and reliability.

 

2.  It begins by describing the location of the study, then discusses the exploratory early stage of the project which used focus groups and interviews with key informants. These were preliminary to developing the main part of the research design: focus groups, in-depth interviews, and participant observation (qualitative methods) with respondents recruited from two villages. Clearly the sample is not a random one, but a convenient sample. Some discussion of the limitations of this sample should be presented. Details of the focus groups and interviews are provided, although information (race, sex) about the authors and graduate students who collected the data is not provided. Examples of the type of questions asked would be helpful.

 

           

Consult: What could be done?

 

1.  They should ask about the sampling used, who conducted the survey, what kinds of official data were made available by the school, how reliable and valid were the questions, and was it a self-report survey or interviews. They should also inquire about definitions used (what is considered “truancy” or “substance abuse” for example?).

 

2.  Given the potentially damaging information, it is important for the researchers to specify clearly how the data were gathered and what the limitations of the study may be. The study will likely be attacked as unreliable and invalid, and problems with sampling will be suggested, so anticipating these criticisms is important.

 

3.  Executive summaries of the report (the most likely way of distributing information in a concise way to media) should specify the sample, the questions asked, the official data used, the purposes of the study, and the recommended policies to emanate from the findings. It should avoid finger-pointing and come across as constructive.