3D Depth Map Based Stereoscopic Shader

  • Merlin
More
6 years 6 months ago #1361 by Merlin Replied by Merlin on topic 3D Depth Map Based Stereoscopic Shader
Hello BlueSkyKnight,

I'm using the Depth3D shader to play games in SBS 3D which works great for a 3D monitor. However I also want to play the game in VR using my mobile phone and Google cardboard. Using TrinusVR I can mirror the image from the screen onto my mobile phone. I put it into cardboard but then the aspect ratio looks distorted looking through the glasses.

Since every eye needs to look at a single image and both images were sqeezed to half their original width to make them fit to the screen thats exactly the way they look through cardboard. Is there a way to resolve this problem through some settings in Depth3D?

The solution I see would be to also reduce the shaded SBS images to half their height. This way the aspect ratio of both images would remain constant. Of course only half the height of the mobile phones display would be used but that's the trade off to keep the aspect correct.

A more complicated alternative would be to trick the game into believing it is rendering for a square screen. Two square SBS images would fit on the screen of the mobile phone without distortion and this way the full screen height would be used. But I don't know if this is even possible using shaders.

I can imagine other gamers are also looking for a solution to this problem. Does anyone know how to achieve that?

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 6 months ago - 6 years 6 months ago #1362 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader
I have a shader for this called Polynomial_Barrel_Distortion try it.

github.com/BlueSkyDefender/Depth3D/blob/...Barrel_Distortion.fx
Last edit: 6 years 6 months ago by BlueSkyKnight.
The following user(s) said Thank You: AladinZ

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 6 months ago - 6 years 6 months ago #1363 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader
So I loved this idea for a Virtual nose posted here reshade.me/forum/shader-presentation/5104-vr-universal-shader on our forums. I didn't have the time to implement my own version of it.

So the premise is simple, add a virtual nose to a VR Side by Side output so you reduce VR Sickness.
Ref. www.wired.com/2015/04/reduce-vr-sickness-just-add-virtual-nose/

So I did some research on the subject looking at many images. Of this Idea to get a basic shape on how the nose should look. Turns out the close shape that needed is one of a Hershey Kiss.
- Don't take me down Hershey Trust Company

I also noticed that in videos that I saw the programmers also added ambiance shading to the nose. I had no idea if this is necessary or not. Maybe Helps with emersion?

So I decided to make my own shader.

But, didn't want to use an external texture to create my Nose. So I did entirely in the shader by Drawing a simple Dimond shape and an Oval.
Added simple shade to darken the bridge anded option for skin color. FYI when searching for Skin color on google make sure you use Skin Tones Instead. Because of reasons.

Added ambiance and made sure it grabbed it from one eye. Added size and position setting for the nose. Last but Not Least I added a blur to the nose on the horizontal axis. The reason I did this. Is because every time I tried to focus on my own nose It was always out of focus to me. I also don't know if this was needed. But, I did it anyway.

So here is the shader for testing.
github.com/BlueSkyDefender/Depth3D/commi...393af350daa8439cafe0

Video to see it in action.
Last edit: 6 years 6 months ago by BlueSkyKnight.
The following user(s) said Thank You: AladinZ

Please Log in or Create an account to join the conversation.

  • AladinZ
More
6 years 5 months ago #1364 by AladinZ Replied by AladinZ on topic 3D Depth Map Based Stereoscopic Shader
It is impressive how it changes color depending on what is in front of it.

Please Log in or Create an account to join the conversation.

  • crash131
More
6 years 5 months ago #1365 by crash131 Replied by crash131 on topic 3D Depth Map Based Stereoscopic Shader
Hello everyone !

Has anyone tried to use 3D super depth on Sekiro ?
I tried use and it doesn't seem to have any depth effect... Anyone knows why ?
I think Sekiro is using the same engine as Dark Souls 3, and that one was looking great on 3D...

Thank you!
Crash131

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago #1366 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

crash131 wrote: Hello everyone !

Has anyone tried to use 3D super depth on Sekiro ?
I tried use and it doesn't seem to have any depth effect... Anyone knows why ?
I think Sekiro is using the same engine as Dark Souls 3, and that one was looking great on 3D...

Thank you!
Crash131

Use Depth Map 1. Disable MSAA or other settings that may affect depth buffer detection.

Please Log in or Create an account to join the conversation.

  • audiopathik
More
6 years 5 months ago - 6 years 5 months ago #1367 by audiopathik Replied by audiopathik on topic 3D Depth Map Based Stereoscopic Shader
Hi!

Thank you for your great work!

I am trying to use this with Aaero , the game uses DX11 and ReShade/Depth3D inject and work properly, however the Depth Map is all black and therefor there is no actual 3D effect.

From your OP I can understand the depth map is not available for every game and this might be the case for Aaero, what is it I could try in that case?
Also, the developer is very active in the Steam discussions for his game, what would it be I could ask of the developer to make Depth3D work with his game?

EDIT:
Nevermind, it was just in the menus and I was quick to assume it's going to be the same during gameplay.

This game plays excellent in 3D with Depth3D :)

Regards!
Last edit: 6 years 5 months ago by audiopathik. Reason: Issue solved

Please Log in or Create an account to join the conversation.

  • crash131
More
6 years 5 months ago #1368 by crash131 Replied by crash131 on topic 3D Depth Map Based Stereoscopic Shader
Thanks for your reply BlueSKy !
Unfortunately, i already try to disable all the effect in the setting of the game, and it doesn't change anything...
I tried the reverse and unreverse setting for the 3d and it doesn't change neither...

Are you playing Sekiro in 3d you ?
Thanks again,

Crash131

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago - 6 years 5 months ago #1369 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

crash131 wrote: Thanks for your reply BlueSKy !
Unfortunately, i already try to disable all the effect in the setting of the game, and it doesn't change anything...
I tried the reverse and unreverse setting for the 3d and it doesn't change neither...

Are you playing Sekiro in 3d you ?
Thanks again,

Crash131


Can't afford the game right now. But, someone did report it as working on Discord. So that is why I think it should work for you as well.
Last edit: 6 years 5 months ago by BlueSkyKnight.

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago #1370 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

audiopathik wrote: Hi!

Thank you for your great work!

I am trying to use this with Aaero , the game uses DX11 and ReShade/Depth3D inject and work properly, however the Depth Map is all black and therefor there is no actual 3D effect.

From your OP I can understand the depth map is not available for every game and this might be the case for Aaero, what is it I could try in that case?
Also, the developer is very active in the Steam discussions for his game, what would it be I could ask of the developer to make Depth3D work with his game?

EDIT:
Nevermind, it was just in the menus and I was quick to assume it's going to be the same during gameplay.

This game plays excellent in 3D with Depth3D :)

Regards!


I am glad it worked out for you. Ya, if you can't get Depth Buffer right away sometimes make sure to check in game to make sure.

Please Log in or Create an account to join the conversation.

  • crash131
More
6 years 5 months ago #1371 by crash131 Replied by crash131 on topic 3D Depth Map Based Stereoscopic Shader
Thank you for your quick reply ! I'll keep trying, playing with setting in Nvidia Panel maybe.
Just one thing : what do you mean by "Depth Map 1" ?

THanks,
Crash131

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago - 6 years 5 months ago #1372 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

crash131 wrote: Thank you for your quick reply ! I'll keep trying, playing with setting in Nvidia Panel maybe.
Just one thing : what do you mean by "Depth Map 1" ?

THanks,
Crash131


Oh that's a holdover from the old shaders. DM1 DM0 is Normal & Reversed.
Last edit: 6 years 5 months ago by BlueSkyKnight.
The following user(s) said Thank You: crash131

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago - 6 years 5 months ago #1373 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader
So I am updating Polynomial_Barrel_Distortion_for_HMDs.fx Shader.

Also as you can see it got a small update.

I am planning on adding simple effects other than a vignette. My Ideas for the effects are a simple implementation of sharpen, AA, and Saturation. If anyone has any ideas or requests for this shader please tell me.

Lens Aliment Markers, Independent Eye adjustment, and many more options in this shader where user requested. Any input is welcomed.
Last edit: 6 years 5 months ago by BlueSkyKnight.
The following user(s) said Thank You: guillerodriguezv

Please Log in or Create an account to join the conversation.

  • flynny75
More
6 years 5 months ago #1374 by flynny75 Replied by flynny75 on topic 3D Depth Map Based Stereoscopic Shader
Many thanks for this, this is working great in VR with Virtual Desktop
The following user(s) said Thank You: BlueSkyKnight

Please Log in or Create an account to join the conversation.

  • apollon01
More
6 years 5 months ago #1375 by apollon01 Replied by apollon01 on topic 3D Depth Map Based Stereoscopic Shader
Hello BlueSkyKnight and thank you for your work!

I am a long time user of Depth3D and recently I got an idea: would it be possible to make a shader converting anaglyph 3d output to SBS? Here is what I am after:

1) Use nvidia 3d vision in discover mode to get red/blue anaglyph output.
2) Use the anaglyph to SBS shader to get it into SBS.
3) Get the SBS into the HMD (via virtual desktop for instance).

Is that something that can be done or am I daydreaming?

Thanks!
Milan

Please Log in or Create an account to join the conversation.

  • guillerodriguezv
More
6 years 5 months ago #1376 by guillerodriguezv Replied by guillerodriguezv on topic 3D Depth Map Based Stereoscopic Shader
Please add Steam VR support, you already made some dlls that allow it, that would be fantastic and it will rise your 3Depth project a lot. Thanks

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago #1377 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

apollon01 wrote: Hello BlueSkyKnight and thank you for your work!

I am a long time user of Depth3D and recently I got an idea: would it be possible to make a shader converting anaglyph 3d output to SBS? Here is what I am after:


Yes, this can be done but not with 3D vision unless you use a capture card. This will add too much latency for VR. This is because of reshade injecting itself before the conversion.

apollon01 wrote: 1) Use nvidia 3d vision in discover mode to get red/blue anaglyph output.
2) Use the anaglyph to SBS shader to get it into SBS.
3) Get the SBS into the HMD (via virtual desktop for instance).


It will better to use 3dmigoto and have it output the game in side by side for your HMD. This is better than an anaglyph 3D conversion to side by side.

apollon01 wrote: Is that something that can be done or am I daydreaming?

Thanks!
Milan


I hope this information helps you.

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 5 months ago - 6 years 5 months ago #1378 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

guillerodriguezv wrote: Please add Steam VR support, you already made some dlls that allow it, that would be fantastic and it will rise your 3Depth project a lot. Thanks


Crosire has this. github.com/crosire/reshade/tree/openvr
An openvr build of ReShade. It has Headset Movement simulation. I love it. But, it studders now and then. Other than that I still love using it. Too bad, it was not updated in 2 years.

Maybe someone else can merge this into the main branch.

Then again there are already options to output the image using 3rd party software. I know they are not as good as direct. But, they are useful.
Last edit: 6 years 5 months ago by BlueSkyKnight.
The following user(s) said Thank You: guillerodriguezv

Please Log in or Create an account to join the conversation.

  • apollon01
More
6 years 5 months ago - 6 years 5 months ago #1379 by apollon01 Replied by apollon01 on topic 3D Depth Map Based Stereoscopic Shader
Thank you for this info. I have come across the 3dmigoto but have not tested yet.

Btw: nvidia is going to stop supporting its 3d vision - nvidia.custhelp.com/app/answers/detail/a_id/4781

Sad but true...

Milan
Last edit: 6 years 5 months ago by apollon01.

Please Log in or Create an account to join the conversation.

  • mr_spongeworthy
More
6 years 4 months ago - 6 years 4 months ago #1380 by mr_spongeworthy Replied by mr_spongeworthy on topic 3D Depth Map Based Stereoscopic Shader
So, anyone tried this with Mass Effect Andromeda? Being a Frostbite game, like Dragon Age Inquisition, I thought that TriDef would probably work, but the game won't even launch and the TriDef sites have been down for ages now, so no luck there. Unfortunately SuperDepth3D also appears non-functional. Although, I am using the latest "Experimental" "Next" version, so I suppose maybe I should try the release version? Or is this simply not going to work?

And that's too bad about 3D Vision. TriDef is gone as well. SuperDepth may be about the last remaining tool for traditional stereoscopic gamers. Too bad Vorpx only supports VR rigs. Seem like it would be cake for them to support traditional 3D displays as well.

EDIT: Tried the regular 1.9.9 release and it also did not work.
Last edit: 6 years 4 months ago by mr_spongeworthy.

Please Log in or Create an account to join the conversation.

We use cookies
We use cookies on our website. Some of them are essential for the operation of the forum. You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.