20卷 5期
/
2012 / 10
/
pp. 393 - 412
網路化檔案評量環境下教學者評量之信度與效度
Reliability and Validity of Instructor Assessment in a Web-Based Portfolio Assessment Environment
作者
張基成 *
(國立台北科技大學技術及職業教育研究所)
吳炳宏
(臺北市立松山家商 資料處理科)
張基成 *
國立台北科技大學技術及職業教育研究所
吳炳宏
臺北市立松山家商 資料處理科
中文摘要

本研究探討網路化檔案評量環境下,教學者評量的信度與效度。研究對象為某高職二年級修習「計算機概論」課程的兩個班級學生,共72人。學習者使用網路化檔案評量系統進行個人檔案的製作、觀摩、自評與同儕互評,教師則透過系統檢視學習者的檔案並評量其學習表現。結果顯示:(1)網路化檔案評量準規具足夠之信度;(2)網路化檔案教學者評量有很高的評分者間信度及評分者內部信度,是可以展示足夠信度的評量方式;(3)網路化檔案評量準規具足夠之效度;(4)教學者檔案評量分數與學生的測驗成績具有高度的一致性,顯示網路化檔案教學者評量方法具良好效度。建議未來研究可針對簡報軟體、文書處理軟體、網頁製作軟體等建置的自我建構式數位化學習檔案來製定可行的檔案評量準規並檢驗其信、效度。

英文摘要

This study investigates the reliability and validity of instructor assessment in a web-portfolio assessment environment. The research target group consists of seventy-two students who take ”Introduction to Computer” course of the second grade in some vocational high school. During experimental period, the students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and doing self-assessment and peer-assessment. The teacher uses the system for inspecting and assessing students' learning performances. The results reveal that the rubric of the Web-based instructor assessment has an adequate reliability. The web-based instructor assessment has a high reliability between assessors as well as a high internal reliability within one assessor. Therefore, it is an assessment method with high reliability. In regard to validity, the rubrics of the web-based portfolio assessment have an adequate validity. The consistence between portfolio instructor assessment score and test score is high, which means the web-based instructor assessment has a high validity. Finally, the study recommends to develop the rubric of self-constructed e-portfolio created by PowerPoint, Word and FrontPage software and to investigate its reliability and validity.

中文關鍵字

信度效度電子化學習歷程檔案網路化學習歷程檔案網路化檔案評量

英文關鍵字

ReliabilityValiditye-PortfolioWeb-Based PortfolioWeb-Based Portfolio Assessment