A Multidimensional Evaluation Framework for Personal Learning Environments

摘要: Evaluating highly dynamic and heterogeneous Personal Learning Environments (PLEs) is extremely challenging. Components of PLEs are selected configured by individual users based on their personal preferences, needs, goals. Moreover, the systems usually evolve over time contextual opportunities constraints. As such have no predefined configurations user interfaces, traditional evaluation methods often fall short or even inappropriate. Obviously, a host factors influence extent to which PLE successfully supports learner achieve specific learning outcomes. We categorize along four major dimensions: technological, organizational, psycho-pedagogical, social. Each dimension informed relevant theoretical models (e.g., Information System Success Model, Community Practice, self-regulated learning) subsumes set metrics that can be assessed with range approaches. Among others, usability experience play an indispensable role in acceptance diffusion innovative technologies exemplified PLEs. Traditional quantitative qualitative as questionnaire interview should deployed alongside emergent ones analytics context-aware metadata) narrative-based methods. Crucial for maximal validity triangulation empirical findings multi-perspective (end-users, developers, researchers), mixed-method (qualitative, quantitative) data sources. The framework utilizes cyclic process integrate across cases cross-case analysis order gain deeper insights into intriguing questions how why work.