Volume 16, Issue 63 (3-2017)                   refahj 2017, 16(63): 215-245 | Back to browse issues page

XML Persian Abstract Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Oreyzi H. (2017). Introduction to Empirical Research with Clustering Effects with a Focus on Unit of Analysis in Randomization and Treatment . refahj. 16(63), 215-245.
URL: http://refahj.uswr.ac.ir/article-1-2727-en.html
Abstract:   (3845 Views)

Introduction: Methodological issues pertaining to multilevel research are certainly complex. However, this complexity is fruitful  in many domains, such as collective and shared constructs. Methods of data analysis obtained from random tests when the unit of analysis corresponds to intervention unit are well recognized. When individual and random data are used via a group intervention, different statistical methods should be applied to evaluate treatment effects. The three introduced models are: I: individuals randomly assigned to individually administered treatments, II: preexisting groups are randomly assigned to group administered treatments and III: randomization is administered on an individual basis, while the treatment is administered on a group setting. This research shows that most research in social welfare corresponds to the second or third model while data were analyzed with the well – recognized first model. An example of managing workplace bullying by training employees of a holding company in citizenship behavior through different courses and using different sites illustrates the third model. Variance component of the exemplified research was computed for three models at level 1( ) and level 2( ). It was shown that the best ratio of these variance component appears in the third model.

Method: All (quasi) experimental articles in Social Welfare Quarterly (SWQ) in which group treatment was applied were investigated. .Also, the content analysis method was used to investigate connotations of group therapy in introduction, discussion and conclusion of articles. The mentioned studies  illustrate a distinction  between the units that are randomized at the cluster level while the intervention is delivered at the individual or group (cluster) level. Six articles  were chosen. The unit of randomization and the unit to which treatment is administered for these articles were determined and  correspondence between them was analyzed .  Only in one article the treatment was administered in clusters, but in three articles there is no correspondence between the unit of analysis in randomization and treatment. Results of content analysis indicate that only half of the articles  in social welfare journal referred to group treatment, although none of the groups are reflected in the statistical analysis. .

Findings: In all the  six articles of  SWQ, deficiency in statistical method was observed, because in all of them ANOVA methods were applied instead of hierarchical method regardless of  group therapy . Also, except for one article  there is was no  attention paid to group setting effects in the introduction and discussion. The third data analysis model received little methodological attention that raises  issues. The most important issue is the relationship between treatment and residual variance. Traditional regression models and multilevel models were compared. The advantage of multilevel models especially their explicit determination of  source of variability at both individual and group level was mentioned.

Discussion: The results  showed that method of hierarchical linear models were not applied in articles published by  SWQ. It is recommended to consider two articles which were written a decade ago byLee & Thompson (2005) and Roberts & Roberts (2005). The advantage of paying attention to the unit of randomization and treatment and between design of research and statistical method of analyzing data empowers researchers to control for contamination across individuals if the cluster was used in randomization or treatment. In cluster randomized research,  such as research of Ali Pouri Niaz et al (1388) which has been conducted  at different sites and communities, the third model in this article  was superior to traditional pre-post tests. The methods introduced in this article  for analyzing data can be extended to some of the more complex situations encountered in social welfare research.

Full-Text [PDF 523 kb]   (3060 Downloads)    
Type of Study: orginal |
Received: 2017/03/13 | Accepted: 2017/03/13 | Published: 2017/03/13

References
1. Baldwin, S. A., Murray, D. M. & Shadish, W. R. (2005). Empirically supported treatments or type I errors? Problems with the analysis of data from group-adminis‌tered treatments. Journal of consulting and clinical psychology, 73(5), 924.
2. Boruch, R., May, H, Turner, H. & Lavenberg, J. (2004). Es‌timating the effects of interventions that are deployed in many places: place randomized trials. American Behavioral scientis‌t, 47, 608-633.
3. Bradley, J., Hergott, D., Garcia, G. & Lines, J. (2016). A clus‌ter randomised trial comparing deltamethrin and bendiocarb as insecticides for indoor residual spraying to control malaria on Bioko Island, Malaria. unpublished manuscript.
4. Donner, A. & Klar, N. (2000). Design and Analysis of Clus‌ter Randomization Trials in Health Research, London:.
5. Donner, A. & Klar, N. (2004). Pitfalls of and controversies in clus‌ter randomized trials. Am J public Health, 94, 416-422.
6. Eldridge, S. & Kerry, S. (2012). A Practical guide to clus‌ter randomized trials in Health services Research. : John Wiley Sons.
7. Figueiras, A., Herdeiro, M. T., Polonia, J. & Ges‌tal-otero, J. J. (2006). An educational intervention to improve physician reporting of adverse drug reactions: a clus‌ter- randomized controlled trial. JAMA, 296, 1086-1093.
8. Fors‌ter, A., Young, J., Chapman, K., Nixon, J., Patel, A. & Holloway, I. (2015). Clus‌ter Randomized controlled trial, clinical and cos‌t- effectiveness of a sys‌tem of longer- term s‌troke care, s‌troke, 46, 2212-2219.
9. Goodrich, R. I. & Pierre, R. G. (1979). Opportunities for s‌tudying later effects of follow through. Cambridge, MA: ABT Associates.
10. Janega, J. B., Murray, D. M., Varnell, S. P., Blits‌tein, J. L., Birnbaum, A. S. & Lytle, L. A. (2004). Assessing the mos‌t powerful analysis method for school-based intervention s‌tudies with alcohol, tobacco, and other drug outcomes. Addictive behaviors, 29(3), 595-606.
11. Johnson, J. K., Napoles, A. M. & S‌tewart, A. L. (2015). S‌tudy protocol for a clus‌ter randomized trial of the community of voices choir intervention to promote the health and well being of diverse older adults. BMC public health, 15, 1044-1056.
12. Judge, T., Scott, B. & Illies, R. (2006). Hos‌tility, Job attitudes and workplace deviance: Tes‌t of a multilevel model. Journal of Applied psychology, 91, 126-138.
13. Kenward, M. G. & Rogers, J. H. (1997). Small sample inference for fixed effects from res‌tricted maximum likelihood. Biometrics, 53, 983-991.
14. Kumar, V., Mohanty, S. & Kumar, A. (2005). Effect of community – based behaviour chang management on neonatal mortality in shivgarh: a clus‌ter- randomised controlled trial. Lancet, 372, 1151-1162.
15. Lee, K. J. & Thompson, S. G. (2005). The use of random effects models to allow for clus‌tering in individually randomized trials. Clinical Trials, 2(2), 163-173.
16. Murray, D. M. & Blits‌tein, J. L. (2003). Methods to reduce the impact of intraclass correlation in group-randomized trials. Evaluation Review, 27(1), 79-103.
17. Murray, D. M., Varnell, S. P. & Blits‌tein, J. L. (2004). Design and analysis of group-randomized trials: a review of recent methodological developments. American Journal of Public Health, 94(3), 423-432.
18. Ramsey, K., Hingora, A., Kante, M. & Jackson, E. (2013). The Tanzania Connect project: a clus‌ter- ranomized trial of the child survival impact of adding pained community health workers to an exis‌ting facility focused health sys‌tems, BMC health servres.
19. Raudenbush, S. W. (1997). S‌tatis‌tical analysis and optimal design for clus‌ter randomized trials. Psychological Methods, 2(2), 173.
20. Roberts, C. (2016). Design and analysis of trials with a partially nes‌ted design and a binary outcome measure s‌tatis‌tics in Medicine, 35, 1616-1636.
21. Roberts, C. & Roberts, S. A. (2005). Design and analysis of clinical trials with clus‌tering effects due to treatment. Clinical Trials, 2(2), 152-162.
22. Sani, F. & Todman, J. (2008). Experimental Design and S‌tatis‌tics for Psychology: A Firs‌t Course. Malden: Blackwell Publishing.
23. Schweig, J. D. & Pane, J. F. (2016). Intention to treat analysis in pratially nes‌ted reandomized controlled trials with real- world complexity. International Journal of Research and Methods in Education, 7, 12-29.
24. S‌terba, S, K. (2015). Partially nes‌ted designs in Psychotherapy trials: A review of modeling developments. Journal of psychotherapy research, 5, 1-12.
25. Tehrani, N. (2004). Bullying: a source of chronic pos‌t traumatic s‌tress?. British Journal of Guidance & Counseling, 32, 384-366.
26. Zelen, M. (1990). Randomized consent designs for clinical trials: An update. S‌tatis in Med, 9, 645-656.
27. Zelen,M. (1979). A new design for randomized clinical trials, N Engl J Med 300, 1246-1245.

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

© 2024 CC BY-NC 4.0 | Social Welfare Quarterly

Designed & Developed by : Yektaweb