Using Alternative Assessment Models to Empower Youth-directed Learning

Barry Joseph

Online Leadership Director
Global Kids, Inc.



Tashawna is a high school senior in Brooklyn, NY. In the morning she leaves home for school listening to her MP3s, texting her friends about meeting up after school at Global Kids, where she participates in a theater program, or FIERCE, the community center for LGBT youth. On the weekend she'll go to church and, on any given day, visit MySpace and Facebook as often as she can. While she misses television and movies, she says she just can't find the time.

This describes what we can call Tashawna's distributed learning network, the most important places in her life where learning occurs. Not just at home, school and church but also through digital media, like MP3s, SMS and social networks, and at youth-serving institutions, like Global Kids and FIERCE. Some are places that require her presence, like school, while others are opt-in, like MySpace. But the learning she gathers across the nodes in her network are preparing her to succeed in the classrooms, workplaces, and civic arenas of the 21st Century.

And Tashawna is not alone. In part due to the changes in education, in part due to the affects of digital media, youth have a wide array of options for learning knowledge and developing skills. But how many youth feel in charge of their networks, or are even aware they exist as an interconnected whole? How do they learn to synthesize what they learn and communicate it to future employers and college admission staff who won't learn of their strengths on most school transcripts?

Global Kids, an afterschool program in New York City that supports youth like Tashawna to be global citizens and community leaders, has begun to explore just these questions. More specifically, we are increasingly asking the following: What do youth need to understand and strategically navigate their distributed learning networks? And how can youth-serving institutions support youth to document the associated learning that address 21st Century Skills that so often go unrecorded?

We are far from alone, however, in raising these concerns. For example, a number of recent initiatives supported by the MacArthur Foundation (from whom we too receive funds) are concerned with the distributed nature of learning experienced by today's young people and the challenge for both youth and learning institutions to integrate and assess it. While digital media has been a disruptive force supporting the fragmentation of learning environments it yet remains a potential source for coordinating and synthesizing the experience.

One approach to empowering youth to be more in charge of their learning and make more sense of their distributed learning network is to focus on youth's existing assets through both digital tools and offline activities to help them see the contours of their networks, understand their role as they traverse their learning nodes, and enhance their abilities to make connections amongst them. The following describes artifacts from three approaches Global Kids has undertaken to further explore these important issues.

Distributed Learning Maps

I was able above to describe Tashawna's distributed learning network because she showed it to me, on paper. It looked like this:



Actually, this was her second drawing. She didn't like her first because she was concerned it wasn't original. The first one looked like this:



When I first viewed these I paid attention to how she chose to group certain nodes. I noticed the distinctions between informal learning institutions and the formal, between portable digital media and online.

Of course, Tashawna doesn't walk around with a drawing of her learning network. I don't think she'd even thought about all the places she learns before I'd asked her to draw these pictures. But when I did it was easy for her to list on a sheet of paper places like home and school. I had to push her, however, to list all of her portable media devices, web sites and after school programs. She wasn't used to thinking about them all as sites of learning. After each one I asked her what she learned from that node:

Me: What do you learn from texting on you cellphone?
Tashawna: How to spell bad! (laughs)
Me: What else?
Tashawna: How to use technology more effectively to communicate.

At the end of the process, as a representative of one of her learning nodes, I was left with a broader understanding of Tashawna's network, of the resources she brings into our program, and where her learning with us might affect other sites of learning. From Tashawna's perspective, I hope she began to think, perhaps for the first time, about herself as a participant within her network, as the final source creating meaning by synthesizing the collected learning, and as the one ultimately responsible for learning how to best design and navigate her network, now and in the future.

Digital Literacy Transcript

Even if Tashawna could fully articulate the learning she receives outside of the standard school curriculum, how can she communicate it to others, in a capacity more formal than a college essay? Last year, we worked with Henry Jenkins' Project New Media Literacies to create something which might do just that: a Digital Literacy Transcript.

Henry Jenkins has identified and described the core literacies afforded by new media tools that are essential for full participation in our new digital age, such as Simulation, Negotiation, and Multitasking. Last year, Global Kids developed and implemented a curriculum that used social media to sharpen their literacies while assisting youth to understand how to think about them.

Below is Tashawna's transcript by the end of the school year:

The Transcript turns each literacy into a triangle-shaped badge. Each corner represents a different relationship with the literacy: I can recognize it, I can talk about it, and I can do it. At the beginning of our program each youth's Transcript was blank. Over the course of the program youth watched their Transcript grow as badges were earned through completing social media projects in the program while also submitting existing work (fan fiction, podcasts, etc.) that demonstrated evidence of their existing competencies. For example, you might note that Tashawna completed her "negotiation" badge, was working on her "networking" badge, and never began "performance."

The Transcript served as both a feedback mechanism to motivate and guide learning and an alternative transcript to show colleges or prospective employers about abilities which would otherwise go unrecognized.

Digital Literacy Portfolio

How could a college or potential employer viewing Tashawna's Digital Literacy Transcript know that she actually learned the referenced skills? And for those new to the terms - which, to be frank, are most of us - what could she do to make these concepts clear and concrete? Enter the Digital Media Portfolio.

Each Portfolio is personally curated by youth like Tashawna to offer an audio and visual tour of their social media productions that highlights the literacies developed through each social media project. This stands in contrast to the Digital Transcript, which is official and controlled by Global Kids.

Below is Tashawna's:

Global Kids is new to these three approaches - Distributed Learning Maps, Digital Literacy Transcripts and Digital Literacy Portfolios - but this year will expand them in a variety of contexts. The new MacArthur Foundation-funded Edge Project will allow us, as part of a broader initiative, to bring the Learning Maps into civic and cultural institutions that use digital media for learning. Meanwhile, the Transcripts and Portofolios will be rolled out in Winter 2010 within the New York City Public Library. Over the course of the next two years we will be documenting this work and sharing our findings with the broader community.

Breakthrough Learning from the Outside In: Four Policies to Accelerate Innovation in the Classroom

Victor V. Vuchic

Program Officer, Open Educational Resources
The William and Flora Hewlett Foundation

Often when we think about innovation, we focus on lots of low cost rapid prototypes and bottoms up design driven approaches. You don’t often hear much about how policy could stoke innovation. Usually, people think of policy as stifling innovation. I actually think there are opportunities to shift policies that could significantly promote innovation. Here are a few areas of opportunity on the near term horizon:

Textbook Adoption to Resource Adoption

Most states have incredibly archaic and restrictive textbook adoption policies. The sad irony is that these adoption cycles are being lengthened from seven to nine years in many states, when the rate of change and innovation in the world is dramatically increasing (imagine what an 8 year old textbook on science and technology looks like today). Shifting these processes to include digital resources is critical. This not only allows us to begin to move from paper based textbooks to new digital environments, but it can also serve as a distribution channel. Much of the feedback we get from teachers is that searching for educational materials online leads to a mediocre mixed bag of results. The state can play a role similar to what they do with textbooks in evaluating digital resources, aligning them to standards and providing at least a baseline for rich media materials for all teachers for all state standards. With the support of the CK-12 Foundation, Virginia and California adopted open-source digital textbooks over the last year.

Smarter Filters

One enormous problem that is stifling innovation and doesn’t get much attention is the internet filters that schools use. While there is a clear need to have some control over where kids go on the internet, the current filters are blocking a huge amount of the Internet and create a significant barrier for teachers to do anything innovative with the web. I recently did a classroom observation at a low income public school in the Bay Area, and the teacher complained that he couldn’t even get to UC Berkeley’s site to get his materials from his Masters degree program. Also, when I used to work with students and told them that they are doing a video project that would be on YouTube, their enthusiasm and engagement jumped 10 fold. On the other hand, when I later explained that YouTube was blocked and we’d use a different lesser known site, they lost interest. Brand is very important to kids and can be a huge motivator. We need to invest in better filtering tools and figure out how we can leverage the digital spaces kids love inside the classroom. The evidence is clear that using the Internet can act as a powerful tool for engaging students, especially the ones that are most at risk of dropping out. We need better school policies on internet filtering that don’t throw the baby out with the bathwater.

Common Core Standards

States adopting a common core of higher level standards will help provide some coherence to the education system across the country. This will stoke innovation in two ways: first, it will immediately and dramatically increase the market size for entrepreneurs in the field of K-12 education and in turn help them attract more investment. Today, someone starting a company in education has to develop and worry about 50 different states, each with their own standards. This fragmentation puts a significant cost and burden for small innovative startups. Second, unifying under some common standards will make it more likely that innovations in one state will transfer more easily to other states. This should also stoke more collaboration between states, which again will increase the transfer of innovations.

Seat time to Learning time

Today most states focus funding on time spent in school (average daily attendance). Shifting the focus from seat time to learning time could open up an entire new space for innovative, and perhaps more effective, learning environments. The state of California recently decreased its minimum annual school days requirement by five days to help accommodate the recent budget cuts. (In practice, most school districts are choosing to make other cuts rather than cutting school days, but they are now allowed to cut days.) This is a particularly troubling policy change given the strong evidence that time in school is directly correlated with academic success. But, by shifting the focus from seat time to learning time, districts in California could choose to have five self-learn days spaced throughout the year where students would spend the days learning outside the school or in a lab on online courses or digital media learning environments that have proven learning outcomes. This could help deal with the budget cuts while not losing out on critical learning time. One could also imagine that teachers could leverage digital resources in new ways that help reach the kids where they are and when they want it rather than in just a specific 45 minute period in the classroom.

Overall, there is a lot of innovation going on in education, but unfortunately very little of it is making its way into the public education system. I believe with a handful of tweaks and shifts in policy, we can open up and create pockets of space to allow the system to begin to absorb and integrate these innovations. At a recent meeting of the National Association of State Boards of Education I was pleasantly surprised with how forward thinking the group was and to see that policies are starting to shift in states to become more digital friendly. Let’s hope that this continues and begins to open up the system and allow a lot of the great work happening outside to have impact on the inside.

The outer spaces of learning

Colleen Macklin, Parsons The New School for Design

In the recent Star Trek movie by J.J. Abrams we get to see what a 23^rd century Vulcan school was like for young Spock. Hundreds of crater-like pods, with 360-degree projection systems, allow individual students to navigate through an encyclopedic array of topics fully described through visualizations and sound. These images, as science fiction images often do, illuminate more about our present anxieties and desires than they do about possible futures. Star Trek fan and media theorist Henry Jenkins points out these conflicting visions in his blog, "Confessions of an Aca/Fan":

"In some ways, this is the future which many educators fear -- one where they have been displaced by the machine. In other ways, it is the future we hope for - one where there are no limits placed on the potentials of individual learners to advance."

As an interaction designer I can’t help but be fascinated by the design characteristics of these learning pods, particularly as a learning space and experience. Spatially, the pods enable a 360-degree view of virtual content, placing the student in the center of a whirl of information, visualized in formulas and images. Experientially, the intelligence (presumably artificial) that runs the displays also has a voice - quizzing the student on a wide array of subjects, from geometry to ethics. The effect is a high tech quiz or spelling bee, knowledge containable in a question and short answer. And in a reverse of the exploratory pleasures of the Internet, students merely provide the answers to questions asked by the computer – they don’t ask questions of their own. Perhaps we are glimpsing a Vulcan standardized test? While the delivery is individualized, as Jenkins points out, it’s also asocial, physically inactive (there’s no “learning by doing”), and if we take away the special effects, no more advanced than some of the drill-based learning methods we use today.

From the tricorder to the holodeck, Star Trek has, since its introduction in the 60s, had a tremendous influence on technology designers. Wah Ming Chang's communicator designs for the original TV series inspired Martin Cooper's mobile phone design research. Will the images of the 23^rd century Vulcan school influence future school design? In terms of a spatial and experiential approach to learning, I actually think there are more interesting examples present now, in the 21^st century. I’ll mention two of them, and why, from the perspective of interaction design, they promote not only cool new technologies and “special effects”, but also breakthroughs in the design of learning.

In SMALLab (Situated Multimedia Art Learning Lab), a mixed-reality learning environment developed by ASU’s David Birchfield, students also inhabit a projected world where diverse subjects can switch as quickly as the speed of light. However, this is where the similarity between SMALLab and Star Trek’s vision ends. Instead of surrounding us at eye-level, the projections for SMALLab are on the floor. The fact that images are beneath you immediately activates the space. Like the lines chalked on the sidewalk forming a hopscotch court, SMALLab beckons for ACTION. We want to step, run, jump, and crawl on the interactive images beneath us. And the space also encourages this – it uses playful interaction to illuminate how systems work – from concrete poetry to physics. By using our bodies, SMALLab engages our minds in making sense of these systems. In addition, it is a social space. SMALLab has a multi-user interface promoting collaboration and team problem solving. Students learn by coordinating their actions, helping each other, and making sense of how the systems underlying knowledge about a subject actually behave and respond.

Like SMALLab, Mannahatta: The Game (M:TG), a prototype developed by PETLab at Parsons, takes students out of a typical learning environment – in this case, onto the streets of New York City. A collaboration with Dr. Eric Sanderson’s Mannahatta Project at the Wildlife Conservation Society, M:TG uses geographically tagged data about the ecosystems present on Manhattan island prior to colonization in 1609 to create a game of exploration and discovery. Currently available for the iPhone platform, the game requires that players traverse the city in order to uncover and link ecosystem elements, rebuilding the webs that once existed, city block by city block. Using the iPhone as a kind of detector, players are notified when a needed species (mountain lion, poplar tree) or eco-link (“food for”, “shelter for”) is available nearby. M:TG is a game, but it is also a platform for experimenting with how augmented reality and geo-spatial databases can be brought together to form a situated space for learning. In other words, M:TG takes learning out of the classroom and into the world.

These two examples are pilot environments and prototypes. They aren’t yet common, and the implications of these spaces are still being discovered. Both share the element of play, collaboration and creativity as a strategy for activating learning. These environments clearly diverge from current classroom norms – and they also go a step beyond their science fiction counterparts – by designing playful and rich spaces and experiences as integral to 21^st century learning.

SMALLab is one of the two dozen innovations that will be showcased at the Technology Playground demo space at the Breakthrough Learning in a Digital Age Forum on October 28.

Referenced:

Henry Jenkins, “Five Ways to Start a Conversation About the New Star Trek Film”. (blog post, May 12, 2009, accessed 9/28/09). http://henryjenkins.org/2009/05/five_ways_to_start_a_conversat.html

SMALLab, see: http://www.instituteofplay.com/node/169 and http://ame2.asu.edu/projects/emlearning/smallab/smallab.php