Top Immersive Extended Reality Experience, Virtual shooting can see the future.
What is the XR virtual shooting technology?
In 2016, once called the so-called “first year of VR” in the industry, lots of capital entered the market feverishly for a while. But behind the frenzy, the immature technology and the difficulty of commercialization have made many VR companies gradually weak, and the track has turned sharply. For a long time, the VR market had few giants.
In 2021, XR (the collective term for VR virtual reality, AR augmented reality, and MR mixed reality), which has been “frozen” for many years, will appear again. But what is different from the past is that this time the recovery has been incorporated into a more popular and forward-looking concept – the metameres. It has begun to use modern high-tech technologies, including VR, AR, MR, etc., which have been popular in recent years. In the stage art industry, XR is currently the most popular.
XR technology is extended reality, which is the collective name of VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality). Through wearable devices and computer technology, XR can bring a combination of real and virtual, human-computer interaction to the audience.
On this year’s CCTV Spring Festival Gala stage, the application of XR technology was a blockbuster. Through the “cloud stage”, Jay Chou and Andy Lau, who could not be present, “appeared” on the Spring Festival Gala stage “thousands of miles away.” To achieve a better visual experience, the XR technology applied on the stage of the Spring Festival Gala is not a simple extended reality, but a complete set of workflows, which needs to be completed with the cooperation of the director, director, cameraman, actors and other teams familiar with the XR workflow.
The reporter learned that in the program, the director team created 4 virtual modeling scenes with a strong sense of space for Andy Lau’s performance through the application of XR technology, which not only allowed the actors to sing in the traditional buildings with Tenon-and-mortise structure but also built-in gift boxes. You can dance with robots in the magic space, swim in the scene of “fish” every year and interact with the live actors.
So, what is the popular XR technology in the stage art industry? Of course, it’s not the XR in your hands. This XR is not the other XR. Today, let’s talk about XR technology. What kind of magic does it have?
XR is short for “extended-range.” In the future, human interaction will change from 2D to more efficient 3D interaction. XR virtual shooting technology is a new generation of virtual shooting techniques based on the real-time rendering capability of a virtual computer engine, which integrates many virtual solutions such as VR, AR, and MR. Its architecture includes an LED screen, display control system, and powerful graphics processing engine. The camera and position tracking system is a virtual production method that puts the performer in the scene of the material in real-time without the need for a green screen and post-production process.
XR expansion pushes boundaries
Using the video server, the boundaries of the on-screen images captured by the camera are expanded to obtain a virtual scene image, which shows an infinite space on a limited set.
Virtual Sets Alternative to Green Screens
It is not the traditional green screen technology through virtual sets; the shooting team can directly output the final picture. During the shooting process, not only can the background material be adjusted directly in terms of color, frame rate, etc., but also the actors can be guided to cooperate with the picture to shorten the workflow.
In addition, the LED screen of the playback screen can form a more realistic reflection effect on the characters and props on the scene, without having to worry about the green light reflected by the green screen on the characters, which also greatly reduces the post-production work and improves the production efficiency, which provides infinite possibilities for shooting more and more realistic virtual pictures.
What do we need the system components of XR virtual shooting technology?
- Led display background wall
The LED display background wall is the carrier of the virtual image. By receiving the signal from the LED control system, the processed virtual image is displayed.
2, LED control system
With decisive color adjustment, image frame processing, low latency, and other processing functions, it can restore the realism of the virtual shooting scene to a high degree.
3, video server system
Expand the accurate picture captured by the camera to the virtual picture to fill a wider space
- Camera system
Shooting in a virtual background, the real state of the human body or object is given to the server
- Positioning tracking system
Accurately perceive changes in the camera’s viewing angle through the camera-mounted sensor
6, Genlock synchronization system
It ensures the overall synchronization of equipment signals in complex systems, and can also be located in the multi-camera shooting timeline
.
What are the features of XR technology?
1, Fine painting and rendering
HDR, color curve and other functions bring deeper color display and more accurate color management to the LED display, creating a more realistic scene for virtual shooting, allowing actors to be immersed in the scene and show fuller emotions, The rendering of virtual and reality blends more harmoniously.
2, Very low latency
The lower the delay between the signal source and the picture output, the more synchronized and accurate the shooting of the tracking camera system will be, and the more perfect the coordination between the virtual scene and the characters will be.
3, Endless creativity
Virtual shooting is no longer limited by the venue. Any actual scene or virtual scene can be moved to the studio and can be called and adjusted infinitely. With the powerful image processing engine, creativity can be displayed.
4, Color curve
It supports the curve adjustment of the YRGB of the picture source, that is, the brightness, R component, G component, and B component, to meet the needs of custom adjustment of picture color.
5, Scene fusion
The image frames are cross-recombined and played back to meet the requirements of cameras of different positions for different pictures during virtual shooting. The cameras of different positions match the images of different frame positions, and you can obtain scene pictures from multiple perspectives with only one recording.
6, Color cube
Users can individually set the hue, saturation, and lightness of each color. If the user settings change the hue of yellow, the display of the other 11 colors will not change. Coupled with the adjustment for all black and all white, users can easily make precise adjustments to 14 colors.
The emergence of virtual reality fusion technology provides a new advanced experience for the fusion of virtual digital world and the real physical world. XR virtual shooting will be completely integrated into film and television production and related virtual broadcasts in the future.
Zainled provides customers with a set of reliable and cost-effective overall solutions in terms of virtual production requirements, system functional requirements and comprehensive project costs, enabling unlimited production in the film and television industry.
