The Future of News? Virtual Reality | Nonny de la Peña | TED Talks

The Future of News? Virtual Reality | Nonny de la Peña | TED Talks


What if I could present you a story that you would remember
with your entire body and not just with your mind? My whole life as a journalist,
I’ve really been compelled to try to make stories
that can make a difference and maybe inspire people to care. I’ve worked in print.
I’ve worked in documentary. I’ve worked in broadcast. But it really wasn’t until
I got involved with virtual reality that I started seeing
these really intense, authentic reactions from people that really blew my mind. So the deal is that with VR,
virtual reality, I can put you on scene in the middle of the story. By putting on these goggles
that track wherever you look, you get this whole-body sensation, like you’re actually, like, there. So five years ago was about when
I really began to push the envelope with using virtual reality
and journalism together. And I wanted to do a piece about hunger. Families in America are going hungry,
food banks are overwhelmed, and they’re often running out of food. Now, I knew I couldn’t
make people feel hungry, but maybe I could figure out a way
to get them to feel something physical. So — again, this is five years ago — so doing journalism
and virtual reality together was considered
a worse-than-half-baked idea, and I had no funding. Believe me, I had a lot
of colleagues laughing at me. And I did, though,
have a really great intern, a woman named Michaela Kobsa-Mark. And together we went out to food banks and started recording
audio and photographs. Until one day she came back to my office and she was bawling, she was just crying. She had been on scene at a long line, where the woman running the line
was feeling extremely overwhelmed, and she was screaming,
“There’s too many people! There’s too many people!” And this man with diabetes
doesn’t get food in time, his blood sugar drops too low,
and he collapses into a coma. As soon as I heard that audio, I knew that this would be
the kind of evocative piece that could really describe
what was going on at food banks. So here’s the real line.
You can see how long it was, right? And again, as I said, we didn’t
have very much funding, so I had to reproduce it
with virtual humans that were donated, and people begged and borrowed favors
to help me create the models and make things as accurate as we could. And then we tried to convey
what happened that day with as much as accuracy as is possible. (Video) Voice: There’s too many people!
There’s too many people! Voice: OK, he’s having a seizure. Voice: We need an ambulance. Nonny de la Peña: So the man on the right, for him, he’s walking around the body. For him, he’s in the room with that body. Like, that guy is at his feet. And even though,
through his peripheral vision, he can see that he’s in this lab space, he should be able to see
that he’s not actually on the street, but he feels like he’s there
with those people. He’s very cautious not to step on this guy who isn’t really there, right? So that piece ended up
going to Sundance in 2012, a kind of amazing thing,
and it was the first virtual reality film ever, basically. And when we went, I was really terrified. I didn’t really know
how people were going to react and what was going to happen. And we showed up
with this duct-taped pair of goggles. (Video) Oh, you’re crying.
You’re crying. Gina, you’re crying. So you can hear
the surprise in my voice, right? And this kind of reaction ended up being
the kind of reaction we saw over and over and over: people down on the ground
trying to comfort the seizure victim, trying to whisper something into his ear or in some way help,
even though they couldn’t. And I had a lot of people
come out of that piece saying, “Oh my God, I was so frustrated.
I couldn’t help the guy,” and take that back into their lives. So after this piece was made, the dean of the cinema school at USC,
the University of Southern California, brought in the head of the World
Economic Forum to try “Hunger,” and he took off the goggles, and he commissioned
a piece about Syria on the spot. And I really wanted to do something
about Syrian refugee kids, because children have been the worst
affected by the Syrian civil war. I sent a team to the border of Iraq
to record material at refugee camps, basically an area I wouldn’t
send a team now, as that’s where ISIS is really operating. And then we also recreated a street scene in which a young girl is singing
and a bomb goes off. Now, when you’re
in the middle of that scene and you hear those sounds, and you see the injured around you, it’s an incredibly scary and real feeling. I’ve had individuals who have been
involved in real bombings tell me that it evokes the same kind of fear. [The civil war in Syria may seem far away] [until you experience it yourself.] (Girl singing) (Explosion) [Project Syria] [A virtual reality experience] NP: We were then invited to take the piece to the Victoria and Albert
Museum in London. And it wasn’t advertised. And we were put in this tapestry room. There was no press about it, so anybody who happened to walk
into the museum to visit it that day would see us with these crazy lights. You know, maybe they would want to see
the old storytelling of the tapestries. They were confronted
by our virtual reality cameras. But a lot of people tried it,
and over a five-day run we ended up with 54 pages
of guest book comments, and we were told by the curators there that they’d never seen such an outpouring. Things like, “It’s so real,”
“Absolutely believable,” or, of course, the one
that I was excited about, “A real feeling as if you were
in the middle of something that you normally see on the TV news.” So, it works, right? This stuff works. And it doesn’t really matter
where you’re from or what age you are — it’s really evocative. Now, don’t get me wrong — I’m not saying
that when you’re in a piece you forget that you’re here. But it turns out we can feel
like we’re in two places at once. We can have what I call
this duality of presence, and I think that’s what allows me
to tap into these feelings of empathy. Right? So that means, of course, that I have to be very cautious
about creating these pieces. I have to really follow
best journalistic practices and make sure that these powerful stories are built with integrity. If we don’t capture
the material ourselves, we have to be extremely exacting about figuring out the provenance
and where did this stuff come from and is it authentic? Let me give you an example. With this Trayvon Martin case,
this is a guy, a kid, who was 17 years old and he bought
soda and a candy at a store, and on his way home he was tracked
by a neighborhood watchman named George Zimmerman
who ended up shooting and killing him. To make that piece, we got the architectural drawings
of the entire complex, and we rebuilt the entire scene
inside and out, based on those drawings. All of the action is informed by the real 911
recorded calls to the police. And interestingly, we broke
some news with this story. The forensic house that did the audio
reconstruction, Primeau Productions, they say that they would testify that George Zimmerman,
when he got out of the car, he cocked his gun before he went
to give chase to Martin. So you can see that
the basic tenets of journalism, they don’t really change here, right? We’re still following the same principles
that we would always. What is different is the sense
of being on scene, whether you’re watching
a guy collapse from hunger or feeling like you’re
in the middle of a bomb scene. And this is kind of what has driven me
forward with these pieces, and thinking about how to make them. We’re trying to make this, obviously,
beyond the headset, more available. We’re creating mobile pieces
like the Trayvon Martin piece. And these things have had impact. I’ve had Americans tell me
that they’ve donated, direct deductions from their bank account,
money to go to Syrian children refugees. And “Hunger in LA,” well,
it’s helped start a new form of doing journalism that I think is going to join
all the other normal platforms in the future. Thank you. (Applause)

53 thoughts on “The Future of News? Virtual Reality | Nonny de la Peña | TED Talks

  1. How about just bringing back real, in depth and un-biased journalism not covering up incompetence with another layer of technology.

  2. They really need to get some 3D artists in there and clean up those mid 2000's models/textures. I love the concept, but this is embarrassing.

  3. I think this is a great idea but fear that it can easily be used as propaganda. This should be used but only if there is video solid evidence or video of the recreated event. I find the first and last ones to be a good example of how this can be seen as propaganda, as we do not know 100% what happen those days, however I do not care that did make it as long as they disclaim this is a reenactment base only eyewitness accounts and some other evidence. The 2nd video is the best example of how this can be use good. They have video evidence and recordings however still then it can be potentially faked. However there is always potential that things be faked and I do not think is a good argument against using this. This is new and can go in a lot of way and I am interested in how this turns out in the future. I think this will make it mainstream only if you can get people to trust that the reenactments happen and that they do not inflate or deflate the message.

  4. Really? Another tech enabling media to tab into even more raw emotional mass hysteria. Perspective, proportion, independent thinking, and fact are nearly obsolete as it is.

  5. Travon Martin was guilty. Maybe considering that in the making process of this VR Could have a small effect in the integrity of the work.

  6. Can you really trust the" journalistic best practices" of a one sided, biased media which cares more about furthering its agenda than being accurate? My thought is, "Oh boy, now they can make their ½ truths seem even more real and they will be so much better at controlling the masses with dramatic pieces that make you feel like you were at an event that never even happened." This will do nothing but make the mainstream media's lies more believable unfortunately.

  7. VR is going to be used in gaming way before news. The gaming industry has the money to develop these programs and hardware while the news industry don't have either the talents or the money. These bombs scenes and violent scenes will be in pretty much every game which will make the news stories less dramatic.

  8. I don't think this should be considered journalism if it's an immersive recreation. If you can find a way to immerse people in content captured by photojournalists then that's fine, but it seems fundamentally deceptive because you're saying "This is what it's like to really be there" when so much creative liberty has to be taken.

  9. This is awesome. Using technology, Nonny de la Pena and her team creates an impressive virtual reality scene to place the viewers in the middle action. Gone are the days, where we consumed news through Idiot boxes (both Radio and TV). It's the age of intelligence. I hope all over the world, the media will take this idea seriously and come out with compelling stories.

  10. this was truly amazing, to see how technology can be used in every aspect of our lives. As long as it used correctly and not as a tool of propaganda

  11. If this is combined with recent camera technology such as the globe-looking 360*2 thingy seen in recent articles (google it if you care), millions of people could attend newsworthy scenarios as they happen, in the virtual realm. Imagine what emphatic emotions such news castings would communicate. I sure hope this gets used to erradicate corruption, by eliminating middle hands in the whisper-game state of current journalism.

  12. Low blood sugar doesn't cause seizures and I've never seen a seizure that looked like that. They are just making things up to illicit the response they want.

  13. This is really good and will have a big impact in the world. Its best to work with gaming companies who already have the technology to improve the graphics to make it even more realistic.

  14. To those who express concern over media bias, propaganda and deceit: I hear you on that. That will remain a problem with something like this to the same extent that it is today, perhaps even with deeper consequences. However, I feel it is important to recognise that this is not a problem with media or journalism itself. It is a problem with the existing market conditions in which the media and journalism currently operates. Privatised and politically charged from the top down. It's systemic, not individually applicable to each journalist. The only way to fix that is to separate journalism from the profit motive. To separate news reporting from the interests of those the news relate. Put plainly, to disallow companies like News Corporation from even existing to begin with. They are an unnecessary relic of a pre-internet age, and do not belong.

  15. Great now we can truly be there for those throwing babies out of incubators, gulf of tonkin and SAA using sarin gas incidents!

  16. As a journalist I find this disturbing. The only way to 'accurately' represent a scenario is to record events as they happen, and then play them back. Any element of 'reconstruction' by someone, journalist or no, involves an element of narration and projection that is extremely subjective. — In other words, this isn't journalism, it's art.

  17. My fear is: It can be use to make me fell emphaty, but can make me fell emphaty by a lie, or put emotions where the reason is more needed…

  18. This is kind of already dated. I tried some VR back in April that was captured using real 360• cameras and 3D mics- one was downhill skiing and the other was white water rafting. Eventually scene reconstruction won't be necessary.

  19. PLEASE READ THIS AND UP-VOTE IF YOU CARE ABOUT EFFECTIVE PUBLIC CONVERSATION: No one seems to think about this or care (especially Youtube), but the fact that Youtube sets the comment-sort setting default to "Top Comments" instead of "Newest First" (a setting that probably 95% of people don't even notice) essentially KILLS real conversation. It reduces the possibility of real conversation to hundreds of people barraging the select few (who got lucky enough to comment and get an up-vote or 2 early after the video's posting) with comments and disproportionately large amounts of more up-votes, simply because they were there early on. Everyone else, regardless of how valid or insightful their comment is, gets buried in a sea of comments never to be seen, simply because most people aren't aware of, or don't understand the true utility of, switching the comment-sort to "Newest First." Don't believe me? Switch to "Newest First" and you'll see that hardly any comments have even a single like (because no one saw them). I don't know why I'm still going on, because probably no one will ever see this. Please message Youtube if you see this and care.

  20. VR as a technology is truly innovative. However this intersection of VR and Journalism as it is envisaged in this talk this is seriously unsettling, infused with the the notion that somehow journalistic accuracy and depth can be attained by extending VR into the practice of journalism. This is why it is potentially extremely dangerous as vehicle than can, and I suspect will, be used as a blatant technology for spreading misleading and outright false news.

    I am absolutely in favor of digital technology changing and morphing our professional domains and fields of practice. However this example a clear and blatant attempt at producing a machine of outright manipulation and lies and feeding them to the public in a compelling audio-visual format.

    How will it be possible to discern the real from the virtual once this technology is perfected?

  21. Thank you, Ms. de la Peña, for such great information on VR and how we can use this medium to tell such immersive stories and share with the world.

Leave a Reply

Your email address will not be published. Required fields are marked *