Wednesday, Nov 25
CDS Guide | Time Diary | Bibliography | Contact Us

THE CHILD DEVELOPMENT SUPPLEMENT
TO THE PANEL STUDY OF INCOME DYNAMICS

1997 USER GUIDE

Chapter 7
Pretests


Household Pretest 1 - June, 1996

Household Pretest 1 was not a normal pretest, because its major purpose was not primarily to test the questions. The items in the questionnaires for this study have been used extensively in other studies. While we did test the questions, the main goal of Pretest 1 was to test the procedures for this study. Specifically, we were trying to find ways to help minimize the burden on both the interviewer and respondent and to make things go as smoothly as possible to help achieve a high response rate. The pretest was used to find ways to improve the order of administration, to develop tools to help keep track of things, and to develop procedures for production data collection. The pretest consisted of 23 households with 45 children.


Teacher Pretest 1 - July, 1996

The respondents for Teacher Pretest 1 were teachers who were attending summer school classes at Teachers College, Columbia University. Presentations were made in four summer school classes, four professors were given flyers, and flyers were posted around the campus. In addition, to recruit more preschool teachers, local preschools were called. The results were as follows:

TABLE 8. Number of Interviews, Teacher Pretest

Type of school

# completed by mail

# completed by phone

# refused

Total complete

Elementary

3

2

1

6

Middle

3

2

0

5

Preschool

2

0

0

2

Totals

8

4

1

13

As a result of this pretest, we learned that the respondent burden was very high. The instruments were scaled back in length to help alleviate this burden. We also learned that only three of the responding teachers had any concerns regarding confidentiality. The majority of the teachers felt comfortable completing the questionnaire.


Pretest 2 - October - November, 1996

The number of household interviews completed in Pretest 2 was 51. For the following tables data from up to 49 households (with 85 children) were used; the information from 2 households was not complete.

N=19 households (30 children) from households that were included from the immigrant PSID pretest.

N= 9 households (15 children) from households that were included from the Core PSID pretest.

N=21 households (40 children) from Achild-only households (where no PSID interview was taken).


In preproduction, up to three children could be selected from each sample household. The following table shows the percentage of households where one, two, and three children were included in the study.


Table 9. Number of Household Interviews, Pretest 2

# of Children

% of Households

# HH

# Children

1 child

36.7%

18

18

2 children

53.1%

26

52

3 children

10.2%

5

15

Total

100.0%

49

85

The next table shows the distribution of the children's ages for Pretest 2.

Table 10. Distribution of Children's Ages, Pretest 2

Age of Children

% of Children

(N)

0-2 years

18.8%

16

3-5 years

22.4%

19

6-9 years

37.6%

32

10-12 years

17.6%

15

DK Age

3.5%

3

Total

99.9%

85

The following table shows the average length of each interviewer-administered instrument in Pretest 2.


Table 11. Length of Interviews, Pretest 2

Questionnaire

Avg Minutes

(N)

Range

Child Interview

13.7

58

2-42

Prim. Caregiver-Child

42.0

69

5-81

Father Out-Child

24

1

 

Father Out-HH

18

1

 

The next table shows the eligibility rates and response rates for each questionnaire.

Table 12. Eligibility Rates, Pretest 2

Questionnaire

# Eligible

% Eligible*

(N)

Response Rate (% of eligibles)

Primary Caregiver-Child

85

100%

84

98.8%

Primary Caregiver-HH

49

100%

44

89.9%

Other Caregiver-Child

66

76.5% of kids

65

98.5%

Other Caregiver-HH

39

77.6% of HH

38

97.4%

Father Out-Child

15

17.6% of kids

4

26.7%**

Father Out-HH

8

25% of HH

2

12.5%**

Elementary Teacher

55

64.7% of kids

24

43.6%

Elementary Diary

49

57.6% of kids

16

32.7%

Preschool Teacher

13

15.3% of kids

6

46.2%

Preschool Diary

13

15.3% of kids

7

53.8%

Elementary Admin

56***

65.9% of kids

22

39.3%

Preschool Admin

13

15.3% of kids

3

23.1%

*Base N = 49 Households; 85 children
**2 refused to give information; 2 did not know where father was.
***Elementary Admin includes duplicate administrators (1 admin for 2 kids); Don't know (DK) why the number eligible is different from elementary teachers.

The following table summarizes the contact attempts for the Pretest 2 households.

Table 13. Contacts, Pretest 2

Household Contacts

Total contacts

In person visits

Average number of contacts

5.4

2.5

Minimum

1

1

Maximum

15

6

(N)

34

34

The second test of the teacher questionnaires occurred concurrently with the full pretest of the household questionnaires. After the household portion of the interview process was completed, the field interviewer asked for the respondent's signed permission form allowing us to contact the child's teacher and administrator. The interviewer then mailed self-administered questionnaires to both the teacher and administrator. In Pretest 2, the Survey Research Center followed up to increase the response rate. This consisted of mailing a reminder postcard to the teacher and administrator one week after the field interviewer mailed the questionnaire packets. If the teacher or administrator had not returned the questionnaire one week after the postcard had been sent, the research technicians began to conduct reminder calling. Up to six calls total could be placed to each teacher and administrator.

Table 14 presents the results of Pretest 2. There were 85 eligible children in this pretest. Sixty-eight children were either in elementary/middle school or preschool/daycare. Teachers of middle school children did not receive the time diary because the children change classes and they would not know what the children do all day. Instead, the middle school children filled out the time diaries as part of the household interview.

TABLE 14. RESPONSE RATES, PRETEST 2

Questionnaire Type

# of questionnaires sent

# of questionnaires received

Response Rate

Elementary/Middle School Teacher

55

28

50.9%

Elementary School Time Diary

49

20

40.8%

Preschool/Daycare Teacher

13

7

53.8%

Preschool/Daycare Time Diary

13

7

53.8%

Elementary/Middle School Administrator

56

23

41.1%

Preschool/Daycare Administrator

13

3

23.1%

Total Questionnaires sent & received

199 sent

88 received

44%

Reminder/thank you postcards were sent to all teachers and administrators. Forty-five schools were called. The average number of calls per school was 2.5 calls. The minimum number of calls to a school was zero and the maximum number of calls was six calls.

As a result of this pretest, the teacher time diaries were combined into the teacher questionnaires so that the teachers would be more willing to complete both instruments. A question was added to the elementary/middle school teacher questionnaire to skip middle school teachers over the time diary portion of the questionnaire. A separate questionnaire for home-based care providers or "baby-sitters" was developed for use in production to capture this type of care arrangement as well. A corresponding administrator questionnaire was not needed for this type of care arrangement.

The respondent burden still proved to be high in the second pretest. In response, the instruments were further scaled back to help alleviate respondent burden and the questionnaires were tested to determine if they could be administered over the phone. It was thought that administering the questionnaire over the phone would be easier for the respondent. The questionnaires were successfully completed over the phone but were even more time-consuming. The time diary in particular was cumbersome when administered over the phone. As a result, we decided not to change the data collection method. The procedure for the teacher and administrator questionnaires remained the same for production.

Results of Pretest 2
The following procedures changed after Pretest 2 for production data collection.


BACK | NEXT

CONTENTS | PREFACE | CH. 1 | CH. 2 | CH. 3 | CH. 4 | CH. 5 | CH. 6 | CH. 7 | CH. 8 | CH. 9 | REFERENCES

 



Institute for Social Research | University of Michigan | Privacy | Conditions of Use