How to Cite
Abstract
Valid and reliable measures are important to understanding the implementation of physical activity approaches in schools. The study purpose is to examine the psychometric properties of measures of individual-level constructs (knowledge, attitudes, outcome expectations, self-efficacy, innovativeness, and support) in the context of implementing school-based physical activity approaches. We collected data from a sample of elementary school employees (administrators, classroom teachers, physical educators, and support staff) from an urban school district in southeast Texas. Confirmatory factor analysis (CFA) models were used to examine structural validity. We also examined correlations between constructs to assess discriminant and convergent validity. Last, we used a CFA-based approach to examine point estimates for reliability. The analytic sample consisted of 205 employees. CFA results for each individual measure revealed good-fitting models for most measures (χ2(df)>0.05, RMSEA<0.08, CFI>0.90, TLI>0.90, SRMR≤0.07). A combined model that included all the measures also indicated good fit across indices: χ2(306)=485, p<0.001; RMSEA=0.05, CFI=0.93, TLI=0.92, SRMR=0.07. All correlations between constructs were <0.70, and all but one construct (innovativeness) demonstrated moderate correlations with support for classroom-based physical activity approaches (>0.30). In addition, reliability point estimates were all >0.70. The measures tested in this study were found to have good reliability, as well as good structural, discriminant, and convergent validity. These measures are useful in efforts to better understand how individual-level constructs relate to implementation behaviors for physical activity approaches in schools.
References
Armitage, C. J. (2005). Can the theory of planned behavior predict the maintenance of physical activity? Health Psychology, 24(3), 235.
Bandura, A. (2004). Health promotion by social cognitive means. Health Education & Behavior, 31, 143–164. doi:10.1177/1090198104263660
Bandura, A. (2006). Guide for constructing self-efficacy scales. In Self-Efficacy Beliefs of Adolescents, 307–337. Information Age Publishing.
Bartholomew Eldredge, L. K., Markham, C. M., Ruiter, R. A. C., Fernández, M. E., Kok, G., & Parcel, G. S. (2016). Planning health promotion programs: An intervention mapping approach (4th ed.). Jossey-Bass.
Bartholomew, J. B., Jowers, E. M., Errisuriz, V. L., Vaughn, S., & Roberts, G. (2017). A cluster randomized control trial to assess the impact of active learning on child activity, attention control, and academic outcomes: The Texas I-CAN trial. Contemporary Clinical Trials, 61, 81–86. doi:10.1016/j.cct.2017.07.023
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). Guilford.
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Routledge.
Carlson, J. A., Engelberg, J. K., Cain, K. L., Conway, T. L., Geremia, C., Bonilla, E., Bonilla, E., Kerner, J., & Sallis, J. F. (2017). Contextual factors related to implementation of classroom physical activity breaks. Translational Behavioral Medicine, 7, 581-592. doi:10.1007/s13142-017-0509-x
CFIR Research Team—Center for Clinical Management Research (2021). Consolidated Framework for Implementation Research. Other Personal Attributes. https://cfirguide.org/constructs/other-personal-attributes/
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. I. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8. doi:10.1186/1748-5908-8-22
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50, 217-226. doi:10.1097/MLR.0b013e3182408812
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science, 4, 40–55. doi:10.1186/1748-5908-4-50
DeVellis, R. F. (2016). Scale development: Theory and applications (Vol. 26). Sage.
Dishman, R. K., Hales, D. P., Sallis, J. F., Saunders, R., Dunn, A. L., Bedimo-Rung, A. L., & Ring, K. B. (2009). Validity of social-cognitive measures for physical activity in middle-school girls. Journal of Pediatric Psychology, 35(1), 72–88.
Dong, Y., & Peng, C.-Y. J. (2013). Principled missing data methods for researchers. SpringerPlus, 2(1), 1–17.
Donnelly, J. E., Hillman, C. H., Castelli, D., Etnier, J. L., Lee, S., Tomporowski, P., Lambourne, K., & Szabo-Reed, A. N. (2016). Physical activity, fitness, cognitive function, and academic achievement in children: a systematic review. Medicine and Science in Sports and Exercise, 48(6), 1197.
Fernández, M. E., Gill, A., van Lieshout, S., Rodriguez, S. A., Beidas, R. S., Parcel, G., Ruiter, R. A. C., Markham, C. M., & Kok, G. (2019). Implementation mapping: Using intervention mapping to develop implementation strategies. Frontiers in Public Health, 7.
Fishbein, M. (2008). A reasoned action approach to health promotion. Medical Decision Making 28, 834–844. doi:10.1177/0272989X08326092.A
Goldsmith, R. E. (1991). The validity of a scale to measure global innovativeness. Journal of Applied Business Research, 7(2), 89–97.
Kelder, S. H., Springer, A. E., Barroso, C. S., Smith, C. L., Sanchez, E., Ranjit, N., & Hoelscher, D. M. (2009). Implementation of Texas senate bill 19 to increase physical activity in elementary schools. Journal of Public Health Policy, 30(1), S221–S247.
Kohl, H. W., & Cook, H. D. (2013). Educating the Student Body: Taking Physical Activity and Physical Education to School. National Academies Press.
Lewis, C. C., Klasnja, P., Powell, B., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 136.
Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2015). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10. doi:10.1186/s13012-014-0193-x
Mendoza-Vasconez, A. S., Marquez, B., Benitez, T. J., & Marcus, B. H. (2018). Psychometrics of the self-efficacy for physical activity scale among a Latina women sample. BMC Public Health, 18(1), 1–10.
Mura, G., Vellante, M., Egidio Nardi, A., Machado, S., & Giovanni Carta, M. (2015). Effects of school-based physical activity interventions on cognition and academic achievement: a systematic review. CNS & Neurological Disorders—Drug Targets (Formerly Current Drug Targets—CNS & Neurological Disorders), 14(9), 1194–1208.
Nilsen, P. (2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10. doi:10.1186/s13012-015-0242-0
Padilla, M. A., & Divers, J. (2016). A comparison of composite reliability estimators: coefficient omega confidence intervals in the current literature. Educational and Psychological Measurement, 76(3), 436–453.
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015). A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21. doi:10.1186/s13012-015-0209-1
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. doi:10.1007/s10488-010-0319-7
Raykov, T. (2009). Evaluation of scale reliability for unidimensional measures using latent variable modeling. Measurement and Evaluation in Counseling and Development, 42(3), 223–232.
Rhodes, R. E., Matheson, D. H., & Blanchard, C. M. (2006). Beyond scale correspondence: A comparison of continuous open scaling and fixed graded scaling when using social cognitive constructs in the exercise domain. Measurement in Physical Education and Exercise Science, 10(1), 13–39.
Rogers, E. M. (2003). Diffusion of Innovations (5th ed.) Free Press.
Szeszulski, J., Walker, T. J., Robertson, M. C., Cuccaro, P., & Fernández, M. E. (2020). School staff’s perspectives on the adoption of elementary-school physical activity approaches: A qualitative study. American Journal of Health Education, 51(6), 395–405.
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43, 337–350. doi:10.1016/j.amepre.2012.05.024
Turner, L., & Chaloupka, F. J. (2017). Reach and implementation of physical activity breaks and active lessons in elementary school classrooms. Health Education & Behavior, 44, 370–375. doi:10.1177/1090198116667714
van den Berg, V., Salimi, R., de Groot, R. H. M., Jolles, J., Chinapaw, M. J. M., & Singh, A. S. (2017). “It’s a battle … you want to do it, but how will you get it done?”: Teachers’ and principals’ perceptions of implementing additional physical activity in school for academic performance. International Journal of Environmental Research and Public Health, 14(10), 1160. doi: 10.3390/ijerph14101160
Webster, C. A., Zarrett, N., Cook, B. S., Egan, C., Nesbitt, D., & Weaver, R. G. (2017). Movement integration in elementary classrooms: Teacher perceptions and implications for program planning. Evaluation and Program Planning, 61, 134–143. doi:10.1016/j.evalprogplan.2016.12.011
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2021 Timothy Walker, Derek Craig, Jacob Szeszulski, Maria Fernandez