http://www.wcer.wisc.edu/publications/workingPapers/Working_Paper_No_2010_08.php

Preparing citizens to address the complex problems inherent in cities requires changing society to embrace a new kind of education. One way to train people to think about complex problems is to identify and study how professionals who think in those ways develop their epistemic frame. This ethnographic study of an urban planning practicum examines the ways urban planners master and appropriate relevant expertise. Specifically, epistemic network analysis is used to look at presentation feedback sessions during 2 weeks of the urban planning practicum and explore emergent relationships between the teacher’s and the students’ planning expertise. The results of this study indicate that epistemic network analysis offers a powerful set of techniques for analyzing the kinds of situated understanding that result from sociocultural learning and for observing the translation of pedagogy into practice in various types of learning environments.

http://epistemicgames.org/eg/wp-content/uploads/Bagley-ICLS2010-submitted.doc

Preparing citizens to address the complex problems inherent in cities requires our changing society to embrace a new kind of education. One way to train people to think about complex problems is to identify and study how professionals who think in those ways develop their epistemic frame. In this paper, we examine one of the ways urban planners master and appropriate relevant expertise through an ethnographic study of an urban planning practicum. Specifically, we use a new method called epistemic network analysis to look at presentation feedback sessions during two weeks of the practicum to explore emergent relationships between the teacher’s planning expertise and the students’ expertise. The results of this study indicate that epistemic network analysis offers a technique for analyzing the kinds of situated understanding that result from sociocultural learning and for observing the translation of pedagogy into practice in various types of learning environments.

Epistemic games have been developed to help players develop domain-specific expertise that characterizes how professionals in a particular domain reason, communicate, and act (Shaffer, 2006; Shaffer & Bagley, 2009). Grounded in a sociocultural and sociocognitive approach to learning, epistemic games are designed to foster situated learning that leads to data structures with high levels of dependencies. As one might expect, traditional measurement models struggle to accommodate such contextual dependencies, especially when data are collected at smaller scales and epistemic network analysis (ENA) has been developed to provide a practically feasible modeling alternative (e.g., Rupp et al., 2009; Shaffer et al., in press). In this paper, we describe a research program that addresses key statistical considerations for modeling data from epistemic games using ENA with an eye toward representing different learning progressions of players within such games. Current approaches for representing learning progressions using ENA are juxtaposed with approaches for simulating such data using particular statistical constraints.

Elizabeth Bagley is a graduate student at the University of Wisconsin-Madison in Educational Psychology and Environment and Resources.

He also quotes epistemic games researcher Elizabeth Bagley, “There are tradeoffs and consequences, and these are things they need to deal with as a planner. They are learning how to really facilitate compromises because there are stakeholders whose goals don’t overlap.”

While the game facilitates collaboration and critical thinking, it also connects young people to the environment and to their neighborhoods. View the full article on the Journal Sentinel website, or a PDF here.

‘Well, Maria thought that she did the assignment wrong,’ I replied.

‘I can’t believe that. Her map was amazing. She had the entire city zoned for specific uses,’ responded the student.

‘Maria said that all of the other kids drew houses with smoke coming out of the chimneys and trees in the lawn.’ 

‘They did, and they were totally lame,’ the student said decisively. 

But that’s not what Maria thought. Since her work looked nothing like her peers’, she assumed that she had done the assignment wrong.  She even threw it away shortly after receiving a grade (an A) on it, not recognizing her own innovation since her teacher hadn’t.

That’s why I was excited that the student remembered Maria’s work a year after she had observed her class, and I followed up by talking with the teachers-in-training about the messages we too often send our children in school, the message that their work is little more than a means to a grade. I hope that Maria’s story helped some of the students think outside of the traditional ‘assessment box’ and inspired them to reflect on how they measure success in their classrooms.  

In this paper we look at educational assessment in the 21st Century. Digital learning environments emphasize learning in action. In such environments, assessments need to focus on performance in context rather than on tests of abstracted and isolated skills and knowledge. Digital learning environments also provide the potential to assess performance in context, because digital tools make it possible to record rich streams of data about learning in progress. But what assessment methods will use this data to measure mastery of complex problem solving, the kind of thinking in action that takes place in digital learning environments?

Here we argue that one way to address this challenge is through evidence-centered design: a framework for developing assessments by systematically linking models of understanding, observable actions, and evaluation rubrics to provide evidence of learning. We examine how evidence-centered design can address the challenge of assessment in new media learning environments by presenting one specific theory-based approach to digital learning, known as epistemic games, and describing a method, epistemic network analysis, to assess learner performance based on this theory. We use the theory and its related assessment method to illustrate the concept of a digital learning system: a system composed of a theory of learning and its accompanying method of assessment, linked into an evidence-based, digital intervention. And we argue that whatever tools of learning and assessment digital environments use, they need to be integrated into a coherent digital learning system linking learning and assessment through evidence-centered design.

This short video gives an overview of our work on Urban Science and other epistemic games as part of the Macarthur Digital Media and Learning Project and the National Science Foundation.

In these games, players have a chance to learn 21st century skills by playing as urban planners, engineers, journalists, and other professionals in the knowledge economy.

I suppose next we’ll need to make an epistemic game about making epistemic games….

http://epistemicgames.org/eg/wp-content/uploads/ijgcms-bagley-shaffer.pdf

Trying on different identities via new media was hot at this year’s AERA conference. Elisabeth Soep spoke about her work with Youth Radio. Participants learn the basics of broadcasting, and in the process, they explore identity through authorship of new media stories for local and national outlets. What is especially powerful about Youth Radio is that young people have a specific role from which they can complete consequential tasks and explore new identities. Instead of merely writing a news piece for a grade in social studies class, the Youth Radio journalists write pieces that are broadcast on local and national media outlets. Their writing becomes consequential to a larger community, affecting people outside of their school and reinforcing a new way of being for the journalists themselves.

Erica Halverson and Damiana Gibbons discussed their collaboration with Reel Works Teen Filmmaking. In the class Reel Impact, teen filmmakers work with mentors and learn how to bring their stories to new audiences through broadcast, web-cast, film festivals and community screenings.

Designing such consequential identities for young people to try on is also an important part of my own work on the epistemic game Urban Science. In Urban Science, players role play as urban planners redesigning their city. Through the process of creating land-use plans and justifying their decisions, players explore what it’s like to enact a professional identity with responsibilities to represent a diverse community, while also gaining a new perspective on their own interests in that community. As in Youth Radio, these identity explorations then become consequential when players present revised plans to local planning officials and the mayor. Through projects like Urban Science, Youth Radio, and Reel Works, we can take up the challenge of providing pro-social roles for kids that let them use digital tools to produce meaningful work for an exterior audience-to let kids try on realistic, positive and consequential digital identities.