期刊文獻資料庫

論文查詢

論文詳細資料內容:
未授權全文
論文基本資料
篇  名 國內教育、心理後設分析研究出版偏誤檢定之實徵分析
並列篇名 Empirical Assessment of Effect of Publication Bias on Meta-Analysis in Domestic Education and Psychology
作  者 謝進昌 ; 陳敏瑜
發表期刊 測驗學刊
出版年份 2011 年
卷  期 58 卷 2 期
頁  次 p.391~422
關鍵字 出版偏誤 ; 成敗估計值 ; 後設分析 ; Fail-safe N ; meta-analysis ; publication bias
語言別 中文
中文摘要

後設分析技術自1976年起就逐漸成為社會科學重要的研究方法之一,但國內多數研究均是以應用導向為首要,其中,對於可能導致錯誤結論之出版偏誤議題,則較少以系統性的方式進行探討。據此,本研究經調查國內103篇教育、心理後設分析研究之出版偏誤檢定現況後,發現其檢定比率確實不高,只有近四成研究曾利用出版偏誤方法進行檢定,其中,幾乎有39篇研究都是以傳統Fail-safe N指標為考量,但此方法存在的實務與假設限制,是值得研究者重視。接續,本研究經引用30篇後設分析研究之實徵數據,採用等級相關與線型迴歸分析檢定funnel plot之不對稱性,並搭配trim and fill方法後,發現各方法檢定結果雖不一致,但卻顯示出版偏誤是可能存在於國內後設分析研究,並影響著分析結果。最後,經檢視各方法特色及實徵分析數據後,建議未來研究者在傳統Fail-safe N指標外,可考量同時運用線型迴歸分析、trim and fill方法產生的訊息,以較保守的態度來看待與呈現出版偏誤可能對其研究結果產生的影響。

英文摘要

Since 1976, meta-analysis has become an important method in social science. It has been observed that many meta-analysis have been used for application, but only few evaluated publication biases systematically. After surveying, a total of 103 educational and psychological meta-analysis were assessed, but only 39 (37.86%) evaluated publication bias. Also almost every meta-analysis only reported Fail-safe N, which should be treated with considerable caution due to some practical limitations. Therefore, researchers adopted rank correlation test and linear regression approach to measure funnel plot asymmetry, and assessed 30 published meta-analysis by trim and fill method. Although results are of discordance, researcher observed publication biases were common within meta-analysis and affected the results. Finally, some suggestions were proposed for future usage.

本文被引用次數:3瀏覽...

說明:為本資料庫所收錄文章

本文參考文獻資料:

王順正、林正常 (1995), 登階測驗評估最大攝氧量的效度概化, 體育學報, 20(), 351-362.

王鶴蓉 (2007), 品牌形象之後設分析, 私立銘傳大學管理研究所, 碩士論文, 未出版.

李永怡 (2007), 臺灣學校青少年性行為介入計畫成效之統合分析研究, 國立成功大學公共衛生研究所, 碩士論文, 未出版.

沈孝穎 (2008), 銜接性試驗下最大概似法之偏差修正, 國立高雄大學統計學研究所, 碩士論文, 未出版.

官蔚菁 (2004), 臺灣健康信念模式研究之統合分析, 國立成功大學護理學系, 碩士論文, 未出版.

林川田 (2004), 捨人為己:群際歧別與自尊間關係的整合性分析, 國立中正大學心理學研究所, 碩士論文, 未出版.

林星帆 (2006), 情境干擾效應在動作學習領域之後設分析, 國立中正大學運動與休閒教育研究所, 碩士論文, 未出版.

邱兆宏 (2004), 壓力與健康:整合分析與模式驗證之研究, 私立高雄醫學大學行為科學研究所碩士班, 碩士論文, 未出版.

洪雪雅 (2003), 影響青少年偏差行為的家庭因素之整合分析, 國立高雄師範大學輔導研究所, 碩士論文, 未出版.

孫旻儀、蔡明學 (2007), 社經地位和學生學業成就關係之後設分析, 國教學報, 19(), 199-221.

翁玫郁 (2008), 海峽兩岸高中職創造思考教學成效之統合分析, 國立臺灣師範大學創造力發展碩士在職專班, 碩士論文, 未出版.

馬信行 (2001), 教育學門統合分析之綜合, , 行政院國家科學委員會專題研究計畫成果報告, NSC89-2413-H-004-012.

馬信行 (2001), 犯罪理論之統合分析:以自陳犯罪之研究報告為樣本, 教育與社會研究, 000(002), 0035-0066 .

馬信行 (2002), 教育科學導論, 臺北市: 元照.

馬信行 (2002), 犯罪理論之統合分析:以社會進化論與行為增強理論為軸, 教育與心理研究, 000(025), 0083-0120. 

張火燦、謝廷豪、劉嘉雯 (2007), 員工工作滿意、組織承諾與離職意圖關係的統合分析修正模式, 臺灣管理學刊, 7(1), 25-41.

張秀瓊 (2008), 寫作教學成效之研究:整合分析, 國立新竹教育大學人資處語文教學碩士班, 碩士論文, 未出版.

張沼澤 (2005), 我國資訊科技融入教學對學生學習成效影響之統合分析, 國立臺中師範學院教育測驗統計研究所, 碩士論文, 未出版.

張昭陽 (1999), 組織氣候與整體工作滿足的實案整合分析, 私立淡江大學管理科學學系, 碩士論文, 未出版.

許婉宜 (2007), STS教學對學生科學學習成效與科學學習態度影饗之統合分析, 私立中原大學教育研究所, 碩士論文, 未出版.

連啟舜 (2002), 國內閱讀理解教學研究成效之統合分析研究, 國立臺灣師範大學教育心理與輔導研究所, 碩士論文, 未出版.

陳芝仙 (2004), 國民中小學校長教學領導之後設分析研究, 私立淡江大學教育政策與領導研究所, 碩士論文, 未出版.

陳琬真 (2005), 以後設分析探討顧客貢獻價值、關係品質及顧客忠誠度之關聯性, 國立清華大學科技管理研究所, 碩士論文, 未出版.

陳韻純 (2008), 影響學生創造力的結構模式及創造思考教學處理效果之整合分析, 國立高雄師範大學特殊教育學系, 博士論文, 未出版.

曾南薰 (1998), 我國教師組織承諾之整合分析, 國立嘉義師範學院國民教育研究所, 碩士論文, 未出版.

曾柔鳴 (2008), 心理健康量表測量模式之後設分析研究, 國立嘉義大學輔導與諮商研究所, 碩士論文, 未出版.

曾麗霞 (2009), 臺灣冒險教育體驗方案成效之統合分析, 私立中國文化大學心理輔導研究所, 碩士論文, 未出版.

黃瑛琪 、戴嘉南、張高賓、連廷嘉 (2005), 台灣青少年生涯團體諮商效果之整合分析研究, 諮商輔導學報, 000(012), 0071-0100. 

黃寶園 (2004), 結合統合分析與結構方程模式之理論驗證:以壓力調節反應模式之建立與驗證為例, 國立臺灣師範大學教育心理與輔導研究所, 博士論文, 未出版.

楊麗華 (2005), 生命教育課程成效之後設分析, 私立南華大學生死學研究所, 碩士論文, 未出版.

葉錦光 (2007), 我國中小學教師個人背景變項與工作壓力相關性之後設分析, 國立屏東科技大學技術及職業教育研究所, 碩士論文, 未出版.

鄒佳芬 (2007), 探究式教學對學生科學學習成效影響之統合分析, 私立中原大學教育研究所, 碩士論文, 未出版.

裴美玲 (2007), 系統性文獻回顧與整合分析:催眠治療在憂鬱症與憂鬱情緒上之應用, 私立南華大學自然醫學研究所, 碩士論文, 未出版.

劉彥君、藍玉玲、劉志如、周育如 (2008), 認知行為團體治療對憂鬱症狀緩解之成效:近十年之統合分析, 中華心理學刊, 50(4), 383-402.

劉珍足 (2008), 學習障礙者教學成效之後設分析, 國立臺東大學教育研究所, 碩士論文, 未出版.

蔡坤宏 (2001), 出版偏誤對以相關為基礎之整合分析的影響, 管理學報, 18(1), 153-172.

賴淑婷 (2007), 科學史融入教學對學生科學學習成效影響之統合分析, 私立中原大學教育研究所, 碩士論文, 未出版.

Begg, C. B., & Mazumdar, M. (1994), Operating characteristics of a rank correlation test for publication bias, Biometrics, 50(), 1088-1101.

Berlin, J. A., & Ghersi, D. (2005), Preventing publication bias: Registries and prospective meta-analysis, In H. R. Rothstein, A. J. Sutton & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments , 35-48, NJ: John Wiley & Sons.

Boissel, J. P., & Haugh, M. C. (1993), The iceberg phenomenon and publication bias: The editor’s fault?, Clinical Trials Meta-Analysis, 28(), 309-315.

Borenstein, M. (2005), Software for publication bias, In H. R. Rothstein, A. J. Sutton & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments , 193-220, Chichester, UK: John Wiley & Sons.

Cohen, J. (1992), Quantitative methods in psychology: A power primer, Psychological Bulletin, 112(1), 155-159.

Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.) (2009), The handbook of research synthesis and meta-analysis (2nd ed.), New York: Sage.

Coursol, A., & Wagner, E. E. (1986), Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias, Professional Psychology: Research and Practice, 17(), 136-137.

Davies, P. (1999), What is evidence-based education?, British Journal of Educational Studies, 47(2), 108-121.

Duval, S. J. (2005), The trim and fill method, In H. R. Rothstein, A. J. Sutton & M. Borenstein (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments , 127-144, Chichester, UK: John Wiley & Sons.

Duval, S. J., & Tweedie, R. L. (2000), A nonparametric trim and fill method of accounting for publication bias in meta-analysis, Journal of the American Statistical Association, 95(), 89-98.

Duval, S. J., & Tweedie, R. L. (2000), Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis, Biometrics, 56(), 455-463.

Egger, M., Davey, S. G., Schneider, M., & Minder, C. (1997), Bias in meta-analysis detected by a simple, graphical test, British Medical Journal, 315(), 629-634.

Evans, S. (1996), Statistician’s comments on: Fail sate N is a useful mathematical measure of the stability of results (Letter), British Medical Journal, 312(), 125-125.

Fraser, B. J., Walberg, H. J., Welch, W. W., & Hattie, J. A. (1987), Syntheses of educational productivity research, International Journal of Educational Research, 11(), 145-252.

Gerber, A. S., & Malhotra, N. (2008), Publication bias in empirical sociological research, Sociological Methods & Research, 37(1), 3-30.

Glass, G. V. (1976), Primary, secondary and meta-analysis of research, Educational researcher, 5(), 3-8.

Glass, G. V., McGaw, B., & Smith, M. L. (1981), Meta analysis in social research, Beverly Hills, CA: Sage.

Grégoire, G., Derderian, F., & LeLorier, J. (1995), Selecting the language of the publications included in a meta-analysis: Is there a Tower of Babel bias?, Journal of Clinical Epidemiological, 48(), 159-163.

Hedges, L. V., & Olkin, I. (1985), Statistical methods for meta-analysis, Orlando, FL: Academic Press.

Hoffert, S. P. (1998), With increasing use of meta-analysis come efforts to boost validity, The Scientist, 12(), 7-9.

Jennions, M. D., & Møller, A. P. (2002), Publication bias in ecology and evolution: An empirical assessment using the ‘trim and fill’ method , Biological Review, 77(), 211-222.

Kendall, M., & Gibbons, J. D. (1990), Rank correlation methods, London: Edward Arnold.

Light, R., & Pillemer, D. (1984), Summing up: The science of reviewing research, Cambridge, MA: Harvard University Press.

Lipsey, M. W., & Wilson, D. B. (1993), The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis, American Psychologist, 48(), 1181-1209.

Lipsey, M. W, & Wilson, D. B. (2001), Practical meta-analysis, Thousand Oaks, CA: Sage.

Little, R. J. A., & Rubin, D. B. (1987), Statistical analysis with missing data, New York: John Wiley & Sons.

McAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000), Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?, The Lancet, 356(9237), 1228-1231.

Orwin, R. G. (1983), A fail-safe N for effect size in meta-analysis, Journal of Educational Statistics, 8(), 157-159.

Parekh-Bhurke, S., Kwok, C., Pang, C., Hooper, L., Loke, Y. K., Ryder, J. J., Sutton, A. J., Hing, C., Harvey, I., & Song, F. (2009), How do systematic reviews deal with publication bias? An overview of current practice and comparison with a previous assessment, Retrieved November 10, 2009, from http://www.cochrane.org/colloquium/2009/virtual_posters/posters/P62.pdf.

Petrosino, A. J., Boruch, R. F., Rounding, C., McDonald, S., & Chalmers, I. (2000), The Campbell Collaboration Social, Psychological, Educational and Criminological Trials Register (C2-SPECTR) to facilitate the preparation and maintenance of systematic reviews of social and educational interventions, Evaluation and Research in Education, 14(), 206-219.

Petticrew, M., Gilbody, S. M., Sheldon, T. A. (1999), Relate between hostility and coronary heart disease, British Medical Journal, 319(), 917-918.

Rosenthal, R. (1979), The file drawer problem and tolerance for null results, Psychological Bulletin, 86(), 638-641.

Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005), Publication bias in meta-analysis: Prevention, assessment and adjustments, NJ: John Wiley & Sons.

Schwarzer, G. (2009), Meta: Meta-analysis with R, Retrieved November 1, 2009, from http://cran.r-project.org/web/packages/meta/index.html.

Song, F., Eastwood, A. J., Gilbody, S., Duley, L., & Sutton, A. J. (2000), Publication and related biases, Health Technology Assessment, 4(10), 1-115.

Song, F., Khan, K. S., Dinnes, J., & Sutton, A. J. (2002), Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy, International Journal of Epidemiology, 31(), 88-95.

Sterling, T. D. (1959), Publication decisions and their possible effects on inferences drawn from tests of significance-or vice versa, Journal of American Statistical Association, 54(), 30-34.

Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000), Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature, Journal of Clinical Epidemiology, 53(), 1119-1129.

Sutton, A. J. (2009), Publication bias, In H. Cooper, L. V. Hedges & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed.) , 435-452, New York: Russell Sage Foundation.

Sutton, A. J., Duval, S. J., Tweedie, R. L., Abrams, K. R., & Jones, D. R. (2000), Empirical assessment of effect of publication bias on meta-analyses, British Medical Journal, 320(), 1574-1577.

Sutton, A. J., Duval, S. J., Tweedie, R. L., Abrams, K. R., & Jones, D. R. (2000), Response to ‘High false positive rate for trim and fill method’, British Medical Journal. Retrieved October 30, 2009, from http://www.bmj.com/cgi/eletters/320/7249/1574.

Viechtbauer, W. (2009), Metafor: Meta-analysis package for R, Retrieved November 1, 2009, from http://cran.r-project.org/web/packages/metafor/index.html.

Wang, M. C., & Bushman, B. J. (1998), Using normal quantile plots to explore meta-analytic data sets, Psychological Methods, 3(), 46-54.

What Works Clearinghouse (2008), The review process and evidence standards, Retrieved July 31, 2010, from http://ies.ed.gov/ncee/wwc/referenees/idoeviewer/Doc.aspx?docId=19&tocId=4.

What Works Clearinghouse (2009), What works clearinghouse, Retrieved September 10, 2009, from http://ies.ed.gov/ncee/wwc.

Yu, L.-F., Chiu, C.-H., Lin, Y.-S., Wang, H.-H., & Chen, J.-W. (2007), Testing a model of stress and health using meta-analytic path analysis, Journal of Nursing Research, 15(3), 202-214.

Yu, L.-F., Lin, Y.-S., Chen, J.-W., Wang, H.-H., & Chiu, C.-H. (2007), A meta-analysis of the association between stress and health in Taiwan, The Kaohsiung Journal of Medical Science, 23(6), 287-297.