• VR
  • 2018.07.26

How to shoot 3D Stereo 180VR (VR180) and export?

The head mount display(HMD) such as Oculus Go, The 3DVR content inquiries to our company are also increasing.

3D Stereo 180 VR is kind of 360 VR although which converts to VR only at the front 180 degrees from the beginning has appeared. VR180 is the format which advocated by Youtube and also which is kind of 3D Stereo 180 VR.

VR180 creator tool has been released on Youtube, so if you shoot according to the format even if you shoot with not a google affiliated equipment, you will be able to publish the video content of VR180.

It means, if the equipment 3D Stereo 180 VR can shoot, you can shoot VR180 as well.

Cameras compatible with VR180 are now on sale, and 3DVR images are more familiar, but the choices of equipment for professionals are very limited.

For 3D Streo 180 VR shooting, 3D Stereo 180 VR Kit with a modified GoPro and an Entnaiya Fisheye 220 lens is commonly used.Since the GoPro version of 3D Stereo 180 VR equipment is compact and lightweight, it has a reputation for good handling.

However, recently it seems that viewers are requesting higher quality video contents, and it seems that scenes are being taken with high end equipment using Entaniya Fisheye HAL 200 and mirrorless cameras.

VR 180 and 3D Stereo 180 VR are something like relatives and the final format is slightly different so it is no doubt that the basic shooting methods and shooting points are the same.

However, as many videographers are not used to shooting 3D Stereo 180 VR, it seems that they are often confused by their shooting methods and editing methods.

So I would like to explain the basic shooting method and editing flow of 3D Stereo 180 VR.

3D Stereo 180 VR shooting equipment

3D Stereo 180 VR shooting equipment

Combination of camera and lens example

Cameras Lenses Settings Final resolutiion Memo
Panasonic GH5 HAL200 MFT 3.6 Anamorphic4:3 30p:6340 x 3170
60p:4220 x 2110
High resolution
Panasonic GH5s HAL200 MFT 3.6 Anamorphic4:3 60p:4220 x 2110 Strong in the dark
Sony a7RM2/M3 HAL200 E 3.6 Super35 3640 x 1820 High image quality
Sony a7S/M2 HAL200 E 6.0 4000 x 2000 Strong in the dark
Sony UMC-S3CA HAL200 E 6.0 4000 x 2000 Strong in the dark、Sync

Rig

3D Stereo 180 VR Rig

3D Stereo 180 VR Rig

The rig is designed for 3D Stereo 180 VR designed exclusively for Entaniya Fisheye HAL.
There is rigidity that does not bend even with heavy cameras.
With the base adopting the slide plate, the distance (IPD) between the lenses can be adjusted.
Even if you disassemble the equipment, you can easily assemble it in the same state, which also leads to more efficient editing work after shooting.

3D Stereo 180 VR shooting Tips

Since it is assumed that 3D Stereo 180 VR is watched on a head-mount-display (HMD), it is necessary to shoot according to that rule. If you do not follow the rules, viewers get VR sickness and 3D effects are failed.

Points of before shootingト

Align the horizontal lines of the lens

3D Stereo 180 VR shooting Tips

When setting the camera on the rig, align the horizontal lines of the left and right lenses.
If the horizontal line is misaligned, it means that the heights of the left and right eyes are shifted.
Since the eyes of people are surely located horizontally, be sure to set the camera lens horizontally.
In 3DVR lenses = the human eyes.
Since it also becomes a big hint when shooting, please do not forget that “lenses = human eyes”.

When checking the level, placing a ruler etc. on the two lenses and putting a level on it may make it easy to align.

Be sure to use precision level as a key point.

Set the cameras horizontally and vertically

Set the cameras horizontally and vertically

Please set the cameras horizontally and vertically.
Be sure to check the horizontal and vertical using the level before shooting.
Even if the subject is below the camera, please keep the cameras facing the front.
The direction of the camera is related to the viewing position by the viewer who used the head mounted display.
When many people wear a HMD and watch the video, when looking for the first basic position, they unconsciously try to see it in the horizontal and vertical state.

If the footage that was shot not horizontal and vertical position, there is a gap between the actual picture and the picture is generated, for example, the viewer faces the front, but the video is facing downward.

exception
For example, if you are creating a video content that is supposed to be viewed by a viewer looking upwards or downwards, you can shoot the camera upwards or downwards.
It means that the position of the person viewing the image with the HMD is the same as the direction of the camera.

However, it is necessary for the viewer to explain “This video is supposed to see in the state looking directly above.”

Also in this case equipment must be set horizontally and vertically.
Strictly speaking, you can shoot diagonally.
However, the viewer does not browse the content at an angle that is the same as the angle of the camera that was shot.
If you tilt the camera you can tilt it by 90 degrees.

Points of shooting

Put sound at the beginning and the end of video

Points of shooting

When viewing the 3D Stereo 180 VR, it is necessary that the movement of the left and right are matched.
For that reason, the application for editing has a function of cueing the left and right images. (I will explain later).

Applications make heads to hints of motion and sound of images.
It is easier for the application to judge if you put a clipping sound or clap sound at the beginning of the image so that it becomes a hint.
Also, when shooting for 5 minutes or more, frame discrepancy is likely to occur, so it is easier to check if you put a sound at the end of the video for confirmation.

However, since the application is not perfect, even when analyzing the video and cueing it, there are cases where it is shifted by about several frames.
If you flicker the flash or light to make it easier to adjust at that time, it becomes a hint of frame alignment.

Shoot the videos with the cameras facing forward

Always keep the cameras facing forward and shoot.
In the case of normal image shooting, the cameras will also follow the subject if the main subject moves. However, in the VR image, viewers who did HMD instead of the cameras move the viewpoint by changing the face and body direction.

In other words, if the camera moves like panning or boom up, the viewpoint will be changed arbitrarily contrary to the intention of the viewer and the viewer will be confused.
Also, unexpected movements cause VR sickness, so please never move the cameras.

The cameras should be fixed

Please do not move the cameras as much as possible.

From the creator’s point of view, if you fix the camera, there will be no change in the image. However, in the case of VR, I think that it is better to throw away the concept of camera work.

Some VR videos move on a dolly such as a rover.
Recently, stabilizers and camera shake correction of equipment and applications are also excellent. However, unless you shoot in a spacious place such as a coast or a vast park, using moving images in VR is not recommended. For example, videos walking around narrow rooms are not suitable for 3DVR.

Because moving 3DVR images tend to get VR sick.
People who are robust against VR sick are fine regardless of how the picture moves, but weak people just get VR sick even if they are moving straight.

If it is a picture that makes the video show to a specific limited person, you do not need to worry too much. However, in the case of content like paying money to many people, it is safe to fix the cameras and shoot it. It will not be good for the VR industry and viewers to give the impression “VR = VR Sick.”

When the viewpoint is fixed, the video becomes bored, but in the case of the 3DVR as described above, it is necessary to cut it out.
If you absolutely want to move the viewpoint, I think that it will be within the allowable range if it moves slowly in the front and back direction or up and down direction.
However, please keep horizontal and vertical.

For VR shooting, jib arms are often used.
If you shoot with the Jib Arm you can also avoid your feets in the frame. Also, because the motion is smooth, you can also suppress the shaking that causes VR sickness to a lesser extent.
However, please move slowly.

The height of the viewpoint

The height of the viewpoint

3In the case of 3DVR, the impression changes when the height of the viewpoint changes even for the same subject.
And From the viewpoint of the camera = viewer’s viewpoint, viewers often feel uncomfortable in the case of viewpoints far apart from the viewing position.
As a hint to how to decide the viewpoint, answers will come out automatically when you consider how viewers view the videos.

For example, when viewing videos with HMD, many people often sit in a chair.
You can say that the viewpoint of the image looks most natural from the hight of sitting on the chair.
If you see the image from standing position when you sitting on a chair, it will make you feel uncomfortable.

So when you shoot a 3D Stereo 180 VR, it is good to assume what kind of position viewers will watch in advance.

Or, it is one way to specify the position to see for the viewers. For examole “Please stand and watch this video.”

Know the sweet spot of the cameras

Know the sweet spot of the cameras

There is an optimum distance feeling that makes it easy to obtain a natural 3D effect for each camera.
It is commonly called a sweet spot, and if you shoot in that range, you can shoot with 3D stereoscopic feeling as little as the breakdown as a 3D image.
It is very important to shoot in this distance.

Since it is said that the basic pupillary distance (IPD) is about 65 mm, the distance between the lenses is adjusted in general 3D cameras and the like at around 65 mm.

This seems to be because the average distance of the eyes of adults is about 65 mm, but it is also important to know which distance you are staring at.
This distance of 65 mm seems to be an appropriate pupillary distance for about 1.5 – 2 m, which is an appropriate distance when a person sees objects or people of a certain size.

So it is thought that the sweet spot of the camera set at 65 mm is similarly about 1.5 ~ 2 m, but I think that it will change with the difference of the equipment (camera and lens) to use.

For example, even if it is set at the same 65 mm, if the equipment changes, even if it converts it to 3D Stereo 180 VR by the same procedure it is possible to think that it does not look like the same way.

So it is important to shoot at various distances with equipment to use and explore the range of sweet spot of the equipment.
After understanding the sweet spot, it is better to shoot a video of the range.

Again, the basic distance between lenses (IPD) is 65 mm, but it is not an absolute figure.
When shooting a large building or a distant view, you may move the lens and lens on purpose to emphasize the three-dimensional effect. There are also individual differences.

In other words, the distance between the lenses is only an index for adjusting the distance of the sweet spot.

In the case of human eyes, we always adjust according to the distance to the subject and the size of the subject so we can see naturally even if the distance of the subject changes, but in the case of the camera, It is the same as keeping stare fixed.

For example, if a person gazes at an object 2 meters ahead, if someone approaches, a person can clearly recognize the approaching person at the point of 2 meters, but as the subject approaches the subject, you will not be able to recognize it clearly. (When the subject is out of the sweet spot.)

So, shooting in the sweet spot range is very important.

Optimal distance feeling

Optimal distance feeling

People have personal space, and in daily life they are unconsciously keeping the distance.
People feel uncomfortable if the personal space is ignored.
I think that it is important to shoot videos with a sense of comfortable distance feeling in everyday life.

Close-up shot

Proximity shooting is preferred as content of 3D Stereo 180 VR.
However, in the case of close-up shooting, it becomes easy to break down as 3D video.
In order to reduce collapse, it is sometimes better to shorten the distance between the lens and the lens, but it can not be said unconditionally.

Even if you close the distance between the lenses if the subject is too close the 3DVR will fail.
This is the same as seeing with the naked eye, but if you place an object immediately before your eyes it is the same as the image looks double.

Even in close-up shooting, it is necessary to be conscious of the distance that people can properly recognize objects.
I think that rough standard will be 50 cm ~. If you bring it closer further, the 3DVR will fail.

If you are a kissing scene that is often taken as a staple in the 3D video, a kiss approaching for a moment rather than a long kiss would be better.

The range where the stereoscopic effect can be obtained is confined to the central portion of the image

stereoscopic effect

The 3D Stereo 180 VR will want to make use of the wideness of its field of view but unfortunately there is only the middle part of the image that the 3D effect is felt strongly.

The field of view at both the left and right ends basically becomes a dead space because the next lens is in the frame.
Also, the closer you go to both edges, the bigger the parallax and the more you can not get the correct 3D effect.

This also makes a difference between the actual person’s eye adjustment function and the camera, but when the subject moves to the left or right, people can adjust their eyes to adjust it.
However, the camera is the same as looking at the surrounding objects while looking at the front.

Even in the case of a person, the same phenomenon occurs as if the left and right three-dimensional feeling is lost if the viewpoint is fixed in front.

So, considering the image around the VR image as a background for immersion, it is necessary to devise such that the main subject remains in the center of the screen.

How to export 3D Stereo 180 VR with Autopano

Exporting 3D Stereo 180 VR format.
Although Adobe Premiere Pro and After Effects etc can also handle 360 ° VR images and so on, in order to make the circumference image of the fisheye lens an equi rectangular form as the VR format, VR applications such as Autopano and Mistika VR are interposed is needed.
The same process is required to make Youtube’s VR 180 format as well.

Here we will explain how to export 3D Stereo 180 VR using Autopano which is one of its typical applications.
Since it is fundamental to the last, please make fine adjustments while checking with equipment and devices to view.

Drop video footage on Autopano Video Pro

Launch Autopano Video Pro and drop two footages for 3DVR shot with the camera side by side.

Start searching for left and right

Start searching for left and right

We will cue to make the start of the left and right footages the same frame.
Press the Synchro button on the click icon.

Select the method to cue.
With Autopano Video Pro you can cue to sounds or movements.

To start cueing with sound, press the Use audio to synchronize button.
Since the camera is fixed this time, I pressed the Use audio to synchronize button.

Start searching for left and right

After waiting for a while Autopano can parse the movie file and search the beginning of the frame.

However, since it is the level that adjusts cueing, it sometimes shows a completely different place, and it is not uncommon that several frames are misaligned.

How to adjust cueing

How to adjust cueing

If Autopano shows a completely different frame, you can get good results by shortening or increasing the analysis range from the default 30.00 s, changing the location of the specified frame and redoing the analysis again.

Basically it matches with sound.
Sounds can be put in by hand clapping at the time of shooting, but it is not uncommon to misalign several frames with sound alone.
So adjust the frame or not with hints such as blinking or blinking hands and hands together.

Try blinking the light or burning the flash to make it easier to understand.

How to adjust cueing

If there is no problem with cueing, press the Apply button to confirm.

3D settings

3D settings

Since Autopano Video Pro is an application for 360 VR, 3D setting is required when creating 3DVR.

1.Click the Stereo icon that imaged red and blue 3D from the top menu.

2.heck the Stereo mode

3.elect whether each image is for left eye or right eye.
elect whether each image

The image on the left of the thumbnail displayed in the right window is on the top of the setting screen and the image on the right is on the bottom of the setting screen. Judgment as to whether it is a left or right image can be judged by the lens in the image.

For example, if the lens is seen on the right side of the screen when viewing the image as a normal image, it can be judged as the image of the left eye.

4.Select 3DVR format.
Here we select over / under where images are placed above and below. It is a form called top and bottom.

5. Finally, I press the Apply button, but at this point, there is no particular change.

Unwrap to 3DVR

Unwrap to 3DVR

Unwrap to 3DVR video.

1. Press the Stitch button of the icon where multiple images at the top of the screen.
In the case of 3D 180 VR, it is unnecessary to do stitching, but in Autopano Video Pro it is included in the stitch to unwrap the image of the fisheye lens to VR format.

2.In the item of Stitch as select the parameter of the lens.
Although Entaniya HAL 200 3.6 is selected in the above image, since the parameters of HAL 200 are not included in the default parameters of Autopano, it is necessary to install the parameters.

You can download the parameters from here.

3.After selecting parameters, press the Stitch button.

How to install lens parameters

How to install lens parameters

1.Select Preferences … from the setting menu.

2.Since the Setting window opens, click on the stubborn tab Edition.

3. Since there is an item of Data location in the window where the edition was clicked, click the folder.

Click on the folder to open the local viewfinder.

Kolor > Presets > Cameras > here

download the preset file you downloaded from can enter.

4.Restart Autpopano Video Pro.
When restarting, Entaniya HAL 200 3.6 will be displayed in the lens preset list.
If it is not displayed, select User instead of Kolor in Step 3

User > Presets > Cameras > here

Please insert a preset file into.

Adjusting the 3D VR image with Autopano Giga

Adjusting the 3D VR image with Autopano Giga

When you press the Stitch button, the top and bottom format image as shown above is displayed. (Output format selected in 3D setting is applied.)

In most cases it will be converted slightly incorrectly like the image above.
We will use Autopano Giga to adjust this for correct conversion.

Pressing the Edit button at the bottom of the screen activates Autopano Giga and transfers the conversion parameters.

Adjust crop position

Adjust crop position

The above is the screen of Autopano Giga right after receiving information from Autopano Video Pro.
First, check if the image of the circumference fisheye is correctly clipped out (crop).

Click the (i) mark icon at the bottom of the screen.

Adjust crop position

1.(i) Click the mark icon to open the lens setting window.
Clicking on the crop in the distant view of the tab at the top will bring up a screen with the circle image selected with the yellow circle like the image above selected.

2.You can adjust the size and position by clicking and dragging the yellow circle when you select it.
Adjust if the yellow circle is misaligned from the circumference image.
Please adjust as much as possible to follow the image of the circumference.

In the image above, we have chosen a location that is pretty close, but sometimes we have chose a ridiculous position, so be sure to check and adjust.

3. Adjust the same for other images as well.
You can move to the next image with the arrow mark at the bottom of the screen.
If you click Apply to all images, the position and size of the yellow circle will match the one you originally set, but since the position differs slightly depending on the lens, be sure to move with the arrow and confirm.

4.After adjusting the cropping position of the two images, click the OK button.

Adjust parameters

Adjust parameters

Next, adjust the parameters of the lens.
Basically, the numerical value delivered by Autopano is a numerical value for creating 360 VR, so it can not be used as it is in 3D Stereo 180 VR.
Retype all numbers manually.

Click the triangle mark at the bottom of the screen to open the parameter.

Adjust parameters

At first avove image numbers are displayed.
Looking at the field of view angle is 300.00 and so on.

Incidentally, even with a stitch of 360 VR, a numerical value such as 300.00 will be displayed, but when such a numerical value comes out, it is in a state where a decent stitch can not be made at the time of an error.

If the parameters are properly aligned and the reading can be done correctly, an angle of view close to the actual angle of view will appear. For example, if you use HAL 250 with an angle of view of 250 degrees, please think that it is a mistake that it is 220.00, 300.00, and so on. Even if it seems to be stitching properly the statue is distorted.

If you repeat the stitch several times, it will be the right angle of view as it is stiff and so try trying over again.

I will return the topic.
Since the parameter that was raised above can not be used with 3D Stereo 180 VR, change it as follows.

3D Stereo 180 VR

Yaw 0.000
Pitch 0.000
Roll -90.000 or 90.000 (It depends on the direction of the camera, please adjust so that it looks like a normal image.)
FOV 204 (Although it is 200 degrees on specifications, it actually has an angle of view of 204 – 7 degrees.)
K1 -0.0014
K2 -0.0046
K3 0.000
X offset 0.00 (We will change it when adjusting the vertical displacement later, but please first set it to 0.00)
Y offset 0.00

3D Stereo 180 VR

The preview after changing the value is as above.

Adjust vertical displacement

Adjust vertical displacement

If you enlarge the preview, you can see that the left and right images are misaligned.

As for dislocations on the left and right, there is parallax originally, so you do not have to worry about it.
It is the correct answer that there is no deviation in the center position with respect to the vertical displacement.
We will adjust the gap between the upper and lower center positions using the parameters.

Adjust vertical displacement

Only the part of the red line in the center is used as an indicator of the gap.
In this part, if there are a top and bottom misalignment in the left and right images, X will change the offset value and the discrepancy will adjust to the content.

Normally, the vertical deviation is Y-axis but because the camera is in a portrait position, the X-axis is used to adjust vertical deviation.

It is better to adjust the numerical value so that it becomes half the value for the left and right images.
For example, if the image of the right eye is shifted 2.5, the image of the left eye also shifts by 2.5 (-2.5).

As for the part surrounded by the yellow circle, the gap is always different because the distance is different from the right eye left eye. So it can not be used as an indicator to adjust the gap, there is no need to worry about the gap.

We adjusted the gap using the central line as an indicator.
In the figure above, we adjust it based on the window frame. Adjusting that the window frame is shifted up and down has made it the same height.

Tips

If you shoot the + marks etc. as indicators before shooting at the center position of the camera, it becomes an index for this adjustment and the efficiency gets better .
●If the camera is tilted at the time of the shooting, it is necessary to adjust the value of the Roll roll, etc. as well as the X-axis so that the level is horizontal.
●It will cause fatigue and uncomfortable feeling of eyes when you look at VR if you do not adjust the height somewhat, so let’s do a firmly work.

Save and return to Autopano Video Pro

Save and return to Autopano Video Pro

When adjustment is completed, work is saved by pressing the floppy disk icon button on the upper left of the screen. At the same time, information is handed to Autopano Video Pro.

Confirmation and export with Autopano Video Pro

Confirmation and export with Autopano Video Pro

When you return to Autopano Video Pro, the state you were adjusting with Autopano Giga is displayed up to the previous time.
After that, if you output as 3DVR video, basic export will end.

To export, please click the Render of the gear mark icon.
The export settings window opens.

Export settings

Export settings

With export settings, you can select the size and format of the movie.

In the over / under format, the export size is exported as a square with a ratio of 1: 1, but the settings in Autopano Video Pro are displayed in the same 2: 1 viewing angle as in 360 VR.

For example, in the case of the above image, it is size Width 4666px Hight 2333px.

In this case, the size to be written is Width 2333px x Hight 2333px.
The value of Hight on the setting screen takes precedence over the writing size.
However, in this case, it is FHD level in terms of image quality.
Because Width is 2333px, if converted to 360 VR, it will be a picture of size 2334px x 1167px.

In other words, when 4K image quality is required, at least Hight needs to be 3840px or more.

By the way, Youtube’s VR180 is unnecessary It cuts the 180 ° on the back, and it becomes half the size in terms of file size, but the quality of the picture quality will remain 4K.

Please confirm the figure below because it is difficult to understand.

3DVR

Although the image size varies with the format of the above three patterns, the same 4K image quality will be obtained.

Please output the right format.
Generally, after exporting with Autopano Video Pro, I think that it would be edited with a movie application such as Adobe Premiere, so I think that it is better to output the size as large as possible, in a format with less compression.

If you want to check 3D

If you want to check 3D

If you want to check quickly, if you have red blue glasses, you can check 3D with red / blue if you select Anaglyph in 3D export settings.

If you want to check 3D

If you want to check with HMD, you need to output it once, but it takes time to export the whole story.

In such a case, you can export only a part of the video by clicking & dragging the red bar on the timeline to make it short.

How to adjust the color of two videos

When you convert a video with a different color to 3D stereo image as it is, you feel a sense of incongruity in the image.

It is necessary to make the color of the left and right images the same.

Although it is very difficult to adjust the image visually, you can easily match the colors of multiple images by using a plug-in for the video that adjusts the color of the video taken with a multi camera.

Video plug-in for color correction RE:Match Pro

RE:Match Pro(After Effects / Premiere)

How to improve sharpness

In VR videos, the sharpness is impaired compared with normal images because the circumference fisheye is enlarged to the VR format and further the image is enlarged.

Due to the nature of VR movies, people with sharp images can feel reality.

You can raise the sharpness neatly by using a plug-in calledSamurai Sharpenthat can sharpen the details finely.