Live via hologram
During tonight's election coverage, CNN pulled out some deep tech, displaying Jessica Yellin live via hologram. I looked closely and wasn't even able to see the R2 unit behind the scenes.
<update>
My original impression of how this works is below. A comment from Eric suggests that this might actually be a real hologram that Wolf can see in person, and not a live bluescreening effect. More on this at the end of the post.
</update>
From what I can tell (and I could be wrong), this is done using a combination of technologies, most of which you could simulate at home if you could be satisfied using standard equipment, some careful camera work, and post production techniques instead of the real-time hardware and networked camera equipment CNN is rocking.
The person is recorded inside of a blue or green tent surrounded by an array of cameras that are able to catch several angles at once, presumably with each camera partnered with a real camera on the studio stage. The appropriate holo-camera feed is chosen depending on the real studio camera being used, and the holo camera is networked and synced to move exactly with its partner camera in the studio. This allows the hologram to shift perspective appropriately as the studio camera scoots around the stage. You might compare this to how the virtual first down line is tweaked in real-time to fit the various camera positions in a football game broadcast, except in this case it's not a generated asset, it's a live video feed that's carefully filmed to be at the exact perspective.
Finally, using traditional keying/blue-screen techniques, the tent background color is alphaed out of the feed and the video is overlayed on top of the studio feed, leaving the keyed-out hologram correctly perspective positioned on the final output.
There are two final added touches that make this pretty convincing. One is the red circle on the floor. My best bet is that it's real and created with a red light from above in the live studio feed. The second is the person-to-person conversation. Wolf Blitzer is a pretty good actor - there's no way he's actually seeing the hologram in front of him.
Or can he? Eric points us to the Musion Eyeliner and Cisco Telepresence technology that can display what appears to be a fairly high-fidelity hologram in a stage environment. Here's a video that shows how such a system would be set up:
I remain a bit unconvinced that this is actually what's going on, mostly because of the full 180 degree camera POV that was used in the CNN version, but doesn't seem possible with the Musion system. What are your thoughts? Please post them in the comments.
Anyone care to make their own hologram video with a moving camera? It'd be a bit of a challenge using consumer equipment, and I'm not sure what software you'd use if you didn't have something like After Effects, but it'd be pretty fun to see. For inspiration, here's a decent one done with a fixed camera position:
CNN Hologram Interview [via MAKE]
Real Life R2D2 Hologram
Cisco Telepresence Demo On Live Stage
Musion Eyeliner Hologram Projection System
Posted by Jason Striegel |
Nov 4, 2008 08:20 PM
Video |
Permalink
| Comments (6)
Recent Entries
- Minty soldering jig
- Selecting row number in MySQL
- iPhone 3G software unlock
- Python on Android
- Controlling Sony camcorders with the Arduino
- Gradient text effect in CSS
- Retro gaming emulators that include (legal) ROMs?
- Das DereLicht - ham radio transmitter from a CFL bulb
- Using Google App Engine as a personal CDN
- Route-me - Open Source mapping library for iPhone
Comments
Newest comments listed first.
| Posted by: Eric on November 4, 2008 at 11:19 PM |
Correct me if I'm wrong, but isnt CNN just using the Cisco telepresence system ? So he would be seeing her there
http://www.youtube.com/watch?v=rcfNC_x0VvE
| Posted by: Jason Striegel on November 5, 2008 at 12:46 AM |
Hmm. I don't think I'm convinced yet. It seems like the Musion system is really just projecting a 2d image onto an invisible plane that sits on a stage. If I'm understanding things correctly, it really works well when the audience is positioned roughly perpendicular to the plane and their point of view isn't moving.
I'm likely wrong, but the way the cameras are sliding all the way around Yellin makes me think this wouldn't be possible with the Eyeliner tech.
The one thing I'm trying to figure out is why the keying looks so crummy. Doesn't the local weather report do a better job typically? There must be some additional complexity that I'm missing.
| Posted by: Phaedrus on November 5, 2008 at 2:38 AM |
The correspondent said that the cameras around her 'knew' what the cameras in the studio were doing, and while the shot was impressively dynamic, showing her from front and back, they only seemed to use about two cameras for the bit. I didn't notice the circle on the floor, but it all adds up to Mr. B talking into empty air.
Regards.
| Posted by: Chris on November 5, 2008 at 2:11 PM |
I'm sure what it is is a motion control camera. Digital effects usually employs these. Someone can shoot a scene with a camera on a robotic arm, while a computer reads where that arm is. Then the computer can replicate that exact move again later. You can then put two separate shots together (i.e. an actor walking around talking to themselves, or a lion chasing an actor that you wouldn't want together for safety reasons). But CNN has instead got a camera at one end recording, and another at the other end mimicking the move in real time. This is probably why the camera move is so slow. The robotic motors are usually very noisy, though, so maybe they slowed down the move to keep things down.
The blue halo is amusing as well. Although then having her directly refer to Princess Leia was a bit redundent
| Posted by: Tim on November 5, 2008 at 4:26 PM |
This is an implementation of virtual set technology used in reverse and hardly a hologram. Normally a person is shot on blue/green screen and a background added and tracked according to camera movement and camera cutting. Here the inverse alpha or "key" is used. Another example of this kind of overlay is virtual lines on sport programs (football, horse racing etc). One very good point was the lack of different shots. Maybe more due to common TV practices for choosing shots but could also mean the number of cameras was a bit of a lie.
If there were 35 cameras, then the computers just chose the camera the closest matched the shot on screen. Most probably a choice made by a human and then the setting saved for later use. For example. The two camera style they used could mean cameras 1 and 17 are used to match cameras 1 and 2 on set respectively. But if a third wide shot is included, then camera 23 matched that shot and is added to the setup. The vision mixer in the main studio tells the computer in the remote studio which camera is in use and the computer the switches to the corresponding camera and feeds the video through.
None of the technologies in play are new in live TV. The main ones are:
Chroma Key; most people know about blue/green screen now. The blue halo is caused by noise in the picture when it's compressed for transmission to the main studio. While you can't see the noise yourself it's enough to cause trouble when "keying" something. There are ways to overcome this.
Camera Tally; this is the little red light on top of the camera telling the talent on set which camera is currently in use. This system can easily be interfaced so a remote location can switch cameras on the same cue. Many system today have "read ahead tally" allowing not only the camera in use but the next shot to be indicated.
Robotic camera heads and pedestals; used in many studios today (particularly news). With a full robotic pedestal there is no need for a cameraman at all. Again the local and remote cameras could be ganged together and moved in unison. On set robots are actually rather quiet specifically for live TV. It's dangerous to stand close to them, you can't hear them coming.
Camera tracking head; these tripod heads tell a graphics computer the direction a manually operated camera is pointing. The computer then augments the graphics to this indicated angles. These heads could also be used to move a 2nd robotic camera. Panasonic demonstrated a system such as this at a trade show here in Australia last year. The same information can be read from a robotic camera as it's required for normal operation.
With the right cameras and interfaces, this idea could actually be done without the use of a graphics computer. If you measured up two studios and placed the cameras in the same locations, set to the same heights and using the same lens settings this effect could easily be done on a large vision mixing desk. Simple camera moves could also be included.
| Posted by: on November 22, 2008 at 11:48 AM |
http://www.vizrt.com/news/press_releases/article3918.ece
Leave a comment
Bloggers
Welcome to the Hacks Blog!
Categories
- Ajax
- Amazon
- Android
- AppleTV
- arduino
- Astronomy
- Baseball
- BlackBerry
- Blogging
- Body
- Cars
- Cryptography
- Data
- Design
- Education
- Electronics
- Energy
- Events
- Excel
- Excerpts
- Firefox
- Flash
- Flickr
- Flying Things
- Food
- Gaming
- Gmail
- Google Earth
- Google Maps
- Government
- Greasemonkey
- Hacks Series
- Hackszine Podcast
- Halo
- Hardware
- Home
- Home Theater
- iPhone
- iPod
- IRC
- iTunes
- Java
- Kindle
- Knoppix
- Language
- LEGO
- Life
- Lifehacker
- Linux
- Linux Desktop
- Linux Multimedia
- Linux Server
- Mac
- Mapping
- Math
- Microsoft Office
- Mind
- Mind Performance
- Mobile Phones
- Music
- MySpace
- MySQL
- NetFlix
- Network Security
- olpc
- Online Investing
- OpenOffice
- Outdoor
- Parenting
- PCs
- PDAs
- Perl
- Philosophy
- Photography
- PHP
- Pleo
- Podcast
- Podcasting
- Productivity
- PSP
- Retro Computing
- Retro Gaming
- Science
- Screencasts
- Security
- Shopping
- Skype
- Smart Home
- Software Engineering
- Sports
- SQL
- Statistics
- Survival
- TiVo
- Transportation
- Travel
- Ubuntu
- User Interface
- Video
- Virtualization
- Visual Studio
- VoIP
- Web
- Web Site Measurement
- Windows
- Windows Server
- Wireless
- Word
- World
- Xbox
- Yahoo!
- YouTube
Archives
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
Recent Posts
- Minty soldering jig
- Selecting row number in MySQL
- iPhone 3G software unlock
- Python on Android
- Controlling Sony camcorders with the Arduino
- Gradient text effect in CSS
- Retro gaming emulators that include (legal) ROMs?
- Das DereLicht - ham radio transmitter from a CFL bulb
- Using Google App Engine as a personal CDN
- Route-me - Open Source mapping library for iPhone
www.flickr.com
|





