|Year : 2016 | Volume
| Issue : 1 | Page : 124-128
Validity and reliability of the developmental assessment screening scale
Ajay Singh1, Jane Squires2, Chia Jung Yeh3, Kay H Heo4, Hui Bian5
1 College of Education and Technology, Eastern New Mexico University, New Mexico, USA
2 Department of Special Education and Clinical Sciences, College of Education, University of Oregon, Oregon, USA
3 Department of Human Development and Family Science, College of Health and Human Performance, East Carolina University, NC, USA
4 Office of Faculty Excellence, East Carolina University, NC, USA
5 Department of Early Childhood Education, Chongshin University, Seoul, South Korea
|Date of Web Publication||24-Jun-2016|
College of Education and Technology, Eastern New Mexico University, Portales, NM 88130
Source of Support: None, Conflict of Interest: None
Objectives: To develop and validate the 6-year Ages and Stages Questionnaire (ASQ) for school-age children. Methods: Parents/caregivers of children 66-78 months were recruited from 6 countries and 15 states in the United States. Similar to other ASQ intervals, the 6-year ASQ has five developmental domains targeted for children from 66 months to 78 months of age. We assessed internal consistency reliability, test-retest reliability, the scale structure, validity (correlation coefficients), and utility of the 6-year ASQ. The 6-year ASQ screens development in five domains using 30 items. Results: Coefficient alpha measuring internal consistency was 0.97. Test-retest reliability was estimated by having parents complete two ASQ's on the same child within a week interval. Correlations between scores of the two ASQ's reflected stability of scores. Test-retest reliability results were robust with an intraclass correlation coefficient of 0.94. Factor analysis results resulted in a five factors structure. The Pearson correlations coefficients between the latent variables were moderate to large and statistically significant, P < 0.0001. The 6-year ASQ screens development in five domains using 30 items. The administration time varied from 10 to 60 min with a mean of 15.17 min. General utility result shows that the 6-year ASQ can be used with satisfaction by caregivers, pediatricians, professionals, and parents. Conclusions: Preliminary data on the 6-year ASQ reflected promising results. An easy-to-administer, accurate caregiver-completed screening tool may increase the frequency of screening for school-age children.
Keywords: Developmental screening, primary care, screening tools
|How to cite this article:|
Singh A, Squires J, Yeh CJ, Heo KH, Bian H. Validity and reliability of the developmental assessment screening scale. J Family Med Prim Care 2016;5:124-8
|How to cite this URL:|
Singh A, Squires J, Yeh CJ, Heo KH, Bian H. Validity and reliability of the developmental assessment screening scale. J Family Med Prim Care [serial online] 2016 [cited 2019 Sep 21];5:124-8. Available from: http://www.jfmpc.com/text.asp?2016/5/1/124/184636
| Introduction|| |
Early identification of developmental disabilities in school-age children in the community is essential for timely remedial intervention and often leads to early treatment and ultimately improved long-term outcomes. ,,, Early detection of developmental disabilities is critical to the welfare of children and their families because it allows access to timely diagnosis and treatment.  It has been estimated that only about half of the children with developmental problems are detected before they begin the school. , Developmental screening and developmental surveillance constitute an ongoing process of monitoring the status of a child by gathering information about child's developmental status from multiple sources, including skillful direct observation from parents/caregivers and relevant professionals. ,, Parents' reports of current attainment of developmental tasks have been shown to be accurate and reliable.  In keeping with recommendations from the American Academy of Pediatrics,  and National Screening Committee,  consideration should be given to the use of standardized screening measures utilizing parental reports as a part of the assessment process.
The AAP policy statement emphasized the use of standardized screening tools that are practical, easy to use, and culturally appropriate, and make use of the considerable knowledge parents have about their child. ,, A second AAP policy statement set forth screening algorithms and methods, including those that use standardized parent-completed tools such as the Ages and Stages Questionnaire® (ASQ). ,
The ASQ is a parent-completed questionnaire that may be used as a general developmental screening tool, evaluating five developmental domains: Communication, gross motor, fine motor, problem-solving, and personal adaptive skills for children from the ages of 1-66 months.  In most cases, these questionnaires accurately identify young children who are in need of further evaluation to determine whether they are eligible for early intervention services. , The ASQ meets the requirement of Level 1 screening stated by the AAP in terms of the comprehensiveness of ASQ results, and can be used for producing general findings of children's skills and monitoring children's developmental status. The ASQ is cost-effective and widely used in the United States and other countries.  It is recommended by pediatricians for early identification in the United States.
The usefulness of the ASQ has been demonstrated in many contexts, and international interest has been aroused by the demonstrated benefit of early intervention for children with developmental delays. The ASQ developers designed the 6-year ASQ to answer the need for a screening tool for children approaching school-age.  The 6-year ASQ evaluates developmental skills in children from the ages of 66-78 months.  This new interval will assist with establishing a mechanism for identifying school-age children early on and improving outcomes during the school years.
| Methods|| |
Development and design of the 6-year Ages and Stages Questionnaire®
The 6-year ASQ was developed by ASQ authors and initially studied in four phases; the first phase included 18-26 test items/domain. Initially, test items were randomly arranged (i.e., not placed in chronological order) to decrease any possibilities of order effect and to address the item functioning questions (e.g., item difficulty test items which estimate the difficulty of each test item based on the participants' ability to correctly respond to each test item). In the second phase, test items per domain were selected by using item response theory analysis and were investigated for technical adequacy and item functioning. In the third phase, test items and item difficulty were evaluated by a panel of 13 national and international experts with previous work experience with young children. The experts were academicians/professionals with relevant experiences between 2 and 25 years in their expertise areas. The range of experiences provided a wide and relevant perspective on the appropriateness and validity of the items to be included. In the fourth and final phase, 6 test items/domain for a total of 30 test items were included.
One hundred and sixty-nine participants were recruited and written informed consent was obtained based on approved protocol from the research compliance services, University of Oregon. Subjects completed the Demographic Questionnaire (DQ), the 6-year ASQ, and Utility Questionnaire (UQ).
Participants were parents/caregivers of children ages between 66 months and 78 months. ASQ and other research measures were completed by parents/caregivers either online or via pencil and paper.
A DQ was used to collect general family information about child's gender, disability status, ethnicity, child's birth weight, mother's education, yearly family income, and the child developmental status (i.e., previously identified with disability).
The 6-year Ages and Stages Questionnaire®
The 6-year ASQ has five developmental domains (i.e., personal social, gross motor, fine motor, problem solving, and communication) comprising thirty items for children of 66 months to 78 months of age. Three response options are included: "Yes," "sometimes," and "not yet" and numeric values are assigned at 10, 5, and 0, respectively. The 6-year ASQ follows the content and format from the previously developed ASQ-3™ .
A UQ was used to collect information about degree of satisfaction from parents and caregivers with the 6-year ASQ. The UQ included the length of time, understanding test items, and any assistance needed when completing the 6-year ASQ.
Statistical and psychometric analyses
The psychometric properties of the 6-year ASQ were investigated. Regarding psychometric properties, we first computed the internal consistency (Cronbach's alpha), then examined the fit between the scale structures and observed the data with confirmatory factor analysis (CFA) using Analysis of Moment Structures (AMOS) structural equation modeling. In the CFA, the models were considered to be a good fit. Results suggest that a CFA model provides more accurate results, and another important design factor is the selection of the sample size.  The CFA procedure is designed to determine what the common factors are that account for item variance. The 6-year ASQ interval was modeled with five latent variables, which were: (a) Communication, (b) gross motor, (c) fine motor, (d) problem solving, and (e) personal social. These five factors were labeled, as on the original ASQ: Factor 1, personal social; factor 2, problem solving; factor 3, fine motor; factor 4, gross motor; and factor 5, communication. The results of the goodness of fit model indicates were χ² =1430.04, degree of freedom was 395, probability level was 0.000, and root mean square error of approximation for CFA model was 0.12. Therefore, the implied model showed an acceptable level of fit, so its parameters were interpretable.  The normed fit index (NFI), comparative fit index (CFI), and Tucker-Lewis index (TLI) were 0.74, 0.80, and 0.77, respectively. The possible values of CFI and TLI range from 0 to 1, with values close to one demonstrate a good fit. 
| Results|| |
We recruited participants from six different countries and 15 states from the United States. Parents/caregivers of more boys (54.4%) than girls (45.6%) participated. The majority of diverse participants were highly educated. [Table 1] summarizes participant demographic characteristics.
Pearson correlations coefficients between the latent variables were moderate to large and statistically significant, P < 0.0001. [Table 2] shows the bivariate correlation between the latent variables of the 6-year ASQ. [Table 3] shows the CFA correlation matrix and CFA principal component analysis matrix. The Kaiser-Meyer-Olkin (KMO) measure was 0.87, which was great.  The value in this study was 0.87, which was into the range of great, reflecting confidence that the sample size was adequate for factor analysis. Therefore, the implied model showed high level of fit and for our data, the significant alpha was (0.00) highly significant. 
|Table 2: Bivariate correlation among the latent variables of the 6-year Ages and Stages Questionnaire® |
Click here to view
Test-retest reliability or agreement between two ASQ was measured by intraclass as well as and Pearson r correlations. Result depicted that the Cronbach's alpha value for the questionnaire was 0.97, reflecting a high level of consistency (above 0.85). , Reliability between two ASQ's was computed using Statistical Package for the Social Science 21 (SPSS 21) to compute the intraclass correlation coefficient (ICC) using a two-way mixed effects model and type consistency. , The average measure ICC was 0.94 with a 95% confidence interval from 0.91 to 0.97. The extraversion subscale consisted of 60 items (α =0.95) [Table 2] and [Table 3].
|Table 3: Confirmatory factor analysis correlation matrix and confirmatory factor analysis principal component analysis matrix |
Click here to view
The 6-year ASQ scores correlated significantly with the latent variables. The NFI, CFI, and TLI were 0.74, 0.80, and 0.77, respectively. The possible values of CFI and TLI range from 0 to 1, with values close to one demonstrate a good fit.  The KMO measure was 0.87, which was great. 
Satisfaction is measured by consumers' responses to the usefulness, time, and overall impression of questionnaires. , The 6-year ASQ parent satisfaction survey included six questions related to administration time, ease of completion, difficulty in completion, benefits from completion, and any recommended changes. Most parents said the 6-year ASQ took 10-20 min to complete and the majority (87%) said it was easy to understand. More than half (58.3%) specified that it helped them to think about their child's behavior and 33.3% responded that it was interesting to complete. None of the participants provided suggestions for making it better.
| Discussion|| |
This study examined the 6-year ASQ and is the first to investigate the psychometric properties of this interval. The 6-year ASQ was modeled with five latent variables and each measured by six items. The CFA models of the 6-year ASQ were theoretically grounded. Both goodness of fit and the item loadings supported the hypothesized structure of the 6-year ASQ with five latent variables. The items were largely loaded in their latent variables. The goodness of fit indicated that the implied model showed an acceptable level of fit.  Pearson correlation coefficients between the latent variables showed CFA significant. The correlation between the scores of the two ASQ's reflected stability of the 6-year ASQ. The Pearson correlations coefficients between the latent variables were moderate to large and statistically significant. In summary, the 6-year ASQ showed a well-established factor structure, which was represented by five latent variables. The item loadings demonstrated their strong relatedness to the latent variables.
The current findings should be considered in light of several limitations. A relatively small number of parents/children participated in this research study. A larger sample size might have better results for the CFA model. A second and related limitation pertains to the size and distribution of the sample. The total sample was collected only from 15 states in the United States and from six different countries. This sample may not be representative of all of the children in the US. A larger and more representative sample might better reflect the US population.
Developmental assessment of school-age children is a challenging task. Screening tools are required to identify children for further testing, follow-up, and progress monitoring. Our research study provides initial evidence for expanding the age range of the ASQ. Early identification of developmental status in school-age children in the community is essential for remedial intervention. Pediatricians and service providers advocate a family-centered care model.  Early identification can be completed by pediatricians, parents, and service providers, using clinical impression and/or standardized screening tools, and studies have shown that parent-completed standardized questionnaires are at least equal or superior to the pediatrician's formal screening.  The ASQ appears to be a suitable screening tool for developmental delays in primary care settings and research findings support the recent AAP recommendations for routine use of the ASQ as a screening tool in primary care settings. , The ASQ has shown to be reliable and cost-effective as well as correlate well with pediatricians' and service providers' assessment. ,, The new age interval will assist with establishing a common mechanism for identifying children early on through school entry, perhaps improving screening rates. The results of this research study support the feasibility of appropriate and effective screening questionnaire for school-age children. To ensure the questionnaires, maintain their psychometric properties, test-retest reliability, sensitivity, and specificity, and regular research is required. Initial studies have been completed on the 6-year ASQ. This tool can be used in kindergarten as it is easy to administer and score and many children can be screened at low cost. Pediatricians, professionals, and parents can use it to learn about skills the child has mastered, skills that are emerging and skills the child is not yet doing.
| Conclusions|| |
The results of this study show initial evidence that the 6-year ASQ may be useful for the early identification of the at-risk population and used to improve the early identification of school-age children and improve outcomes before disabilities become more established. Further research is needed to confirm these initial results.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Serrano AM, José B. Early childhood intervention: The Portuguese pathway towards inclusion. Rev Educ Inclusiva 2011;4:123-38.
Siller, M, Emily Hotez LM, Meghan S. Promoting Early Identification of Autism in the Primary Care Setting: Bridging the Gap Between What We Know and What We Do. Croatia, European Union: InTech Open Access Publisher; 2013.
Duby JC, Lipkin PH, Macias MM, Wegner LM, Duncan P, Hagan JF, et al
. Identifying infants and young children with developmental disorders in the medical home: An algorithm for developmental surveillance and screening. Pediatrics 2006;118:405-20.
Illingworth RS. The development of the infant and the young child: Normal and abnormal. Elsev Hea Sci 2013.
Squires J, Bricker D, Potter LW. Revision of a parent-completed developmental screening tool: Ages and stages questionnaires. J Pediatr Psychol 1997;22:313-28.
Glascoe FP, Marks KP. Detecting children with developmental behavioral problems: The value of collaborating with parents. Psychol Test Assess Model 2011;53:258-79.
Love JM, Kisker EE, Ross C, Raikes H, Constantine J, Boller K, et al.
The effectiveness of early head start for 3-year-old children and their parents: Lessons for policy and programs. Dev Psychol 2005;41:885-901.
Gilbride KE. Developmental testing. Pediatr Rev 1995;16:338-45.
Garg A, Dworkin PH. Applying surveillance and screening to family psychosocial issues: Implications for the medical home. J Dev Behav Pediatr 2011;32:418-26.
Glascoe FP. Parents' concerns about children's development: Prescreening technique or screening test? Pediatrics 1997;99:522-8.
Bagnato SJ. Authentic Assessment for Early Childhood Intervention: Best Practices. New York: Guilford Press; 2007.
Developmental surveillance and screening of infants and young children. Pediatrics 2001;108:192-6.
National Screening Committee (NSC) UK: Child Health Sub-Group Report. 1999. www.neh.1.nhs.uk/screening/child. [Last accessed on 2014 Jun 01].
Mclean M. Assessment and its importance in early intervention/early childhood special education. In: Mclean MM, Wolery MW, Bailey DB, editors. Assessing Infants and Preschoolers with Special Needs. Upper Saddle River, NJ: Pearson Merrill Prentice Hall; 2004. p. 1-20.
American Academy of Pediatrics. Identifying infants and young children with developmental disorders in the medical home: An algorithm for developmental surveillance and screening. Pediatrics 2006;118:405-20.
Bricker D, Squires J, Mounts L. Ages and Stages Questionnaires: A Parent-completed, Child-monitoring System. Baltimore (MD): Paul H. Brookes; 1999.
Squires J, Bricker D. Ages and Stages Questionnaires, A Parent-completed Child Monitoring System. (ASQ-3). Brookes Publishing Company, Baltimore, MD; 2009.
Singh A. Parent-Completed Developmental Screening: Validity, Reliability and Utility of the 6-Year Ages and Stages Questionnaire. (Doctoral dissertation, University of Oregon); 2015.
Sarmiento Campos JA, Squires J, Ponte J. Universal developmental screening: Preliminary studies in Galicia, Spain. Early Child Dev Care 2011;181:475-85.
Leandre FR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods 1999;4:272.
John CD, Foster SL. Dissertations and Theses from Start to Finish: Psychology and Related Fields. Washington, DC: APA; 1993.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling 1999;6:1-55.
Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modelling and confirmatory factor analysis results: A review. J Educ Res 2006;99:323-38.
Hutcheson GD, Sofroniou N. The Multivariate Social Scientist: Introductory Statistics Using Generalized Linear Models. Thousand Oaks, CA: Sage; 1999.
Field A. Discovering Statistics Using SPSS. Thousand Oaks, CA: Sage Publications; 2009.
Cohen J. Statistical Power Analysis for the Behavioral Sciences. Cambridge, Massachusetts: Academic Press; 2013.
McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996;1:30.
Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modelling and confirmatory factor analysis results: A review. J Educ Res 2006;99:323-38.
Denise PF, Beck CT. Nursing Research: Principles and Methods. Philadelphia: Lippincott Williams & Wilkins; 2004.
DeVellis RF. Scale Development: Theory and Development. Sage publications; Vol. 26. 2011.
Bae YH. Three essays on the customer satisfaction - Customer loyalty association. University of Iowa;2012.
Pingjun J, Rosenbloom B. Customer intention to return online: Price perception, attribute-level performance, and satisfaction unfolding over time. Eur J Mark 2005;39:150-74.
McPherson M, Weissman G, Strickland BB, van Dyck PC, Blumberg SJ, Newacheck PW. Implementing community-based systems of services for children and youths with special health care needs: How well are we doing? Pediatrics 2004;113 Suppl 4:1538-44.
Charafeddine L, Sinno D, Ammous F, Yassin W, Al-Shaar L, Mikati MA. Ages and stages questionnaires: Adaptation to an Arabic speaking population and cultural sensitivity. Eur J Paediatr Neurol 2013;17:471-8.
Limbos MM, Joyce DP. Comparison of the ASQ and PEDS in screening for developmental delay in children presenting for primary care. J Dev Behav Pediatr 2011;32:499-511.
McCrae JS, Cahalane H, Fusco RA. Directions for developmental screening in child welfare based on the ages and stages questionnaires. Child Youth Serv Rev 2011;33:1412-8.
Squires J, Bricker D, Heo K. (under development). 6 Year (72-Month) Interval. Ages and Stages Questionnaire, 4 th
ed. Baltimore, MD: Brookes Publishing.
[Table 1], [Table 2], [Table 3]