3D Depth Map Based Stereoscopic Shader

  • mhalsan
More
6 years 8 months ago #1321 by mhalsan Replied by mhalsan on topic Changing aspect ratio (not resolution)
I've been working with SuperDepth3D.fx in side-by-side mode. Display Device is 3840x1080, dual projectors, polarized lenses. Game resolution set to the same.
Games render across the whole screen, and left/right images are properly positioned. Effects work when applied. However, in both eyes the aspect ratio is "squeezed" horizontally by a factor of two. There doesn't seem to be an adjustment for this.

'Polynomial Barrel Distortion" has code that allows the aspect ratio to be changed, but haven't been able to add it to SuperDepth3D without "Syntax Error- expected- unknown"

I'd really like your advice. Thanks, mhalsan

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago #1322 by BlueSkyKnight Replied by BlueSkyKnight on topic Changing aspect ratio (not resolution)

mhalsan wrote: I've been working with SuperDepth3D.fx in side-by-side mode. Display Device is 3840x1080, dual projectors, polarized lenses. Game resolution set to the same.
Games render across the whole screen, and left/right images are properly positioned. Effects work when applied. However, in both eyes the aspect ratio is "squeezed" horizontally by a factor of two. There doesn't seem to be an adjustment for this.

'Polynomial Barrel Distortion" has code that allows the aspect ratio to be changed, but haven't been able to add it to SuperDepth3D without "Syntax Error- expected- unknown"

I'd really like your advice. Thanks, mhalsan


What game is this happening in?

Please Log in or Create an account to join the conversation.

  • mhalsan
More
6 years 8 months ago #1323 by mhalsan Replied by mhalsan on topic 3D Depth Map Based Stereoscopic Shader
I've only installed it to Oblivion, other games are still on TriDef (single core, 32bit, slow)

This weekend I'll set it up with Skyrim and Fallout and see how it works there.

Thanks, Mark

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago - 6 years 8 months ago #1324 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

mhalsan wrote: I've only installed it to Oblivion, other games are still on TriDef (single core, 32bit, slow)

This weekend I'll set it up with Skyrim and Fallout and see how it works there.

Thanks, Mark


I am not getting that error in Oblivion. But, at the same time, You would not be able to get 3D in that game with SuperDepth3D. Because the depth buffer is not properly shown. I don't know if this can be fixed.

You will have to wait for me to get my hands on TriDef too see what going on there for Polynomial Barrel Distortion and that Oblivion.

OK, Testing TriDef and Polynomial Barrel Distortion shader and ReShade.



It worked.... But, some caveats. Reshade needs to be installed as DX 10+ dll that shows up as dxgi.dll in the Oblivion folder.
Last edit: 6 years 8 months ago by BlueSkyKnight.

Please Log in or Create an account to join the conversation.

  • mhalsan
More
6 years 8 months ago - 6 years 8 months ago #1325 by mhalsan Replied by mhalsan on topic 3D Depth Map Based Stereoscopic Shader
I've been working on this, here's what I have so far.
The top screen shot was taken using the TriDef wrapper (with reShade loading correctly, but no shaders checked).


Lower image is the same game without triDef, with reShade loading correctly, and the 3D Depth shader enabled, and no others.


In both cases, the display size reported by the Nvidia driver is 3840x1080x60hz
Last edit: 6 years 8 months ago by mhalsan. Reason: Fixed photos

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago - 6 years 8 months ago #1326 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

mhalsan wrote: I've been working on this, here's what I have so far.
The top screen shot was taken using the TriDef wrapper (with reShade loading correctly, but no shaders checked).
Lower image is the same game without triDef, with reShade loading correctly, and the 3D Depth shader enabled, and no others.
In both cases, the display size reported by the Nvidia driver is 3840x1080x60hz

https://photos.app.goo.gl/X1iZwSWrscsgfYmt8


Depth3D, can't produce a 3D image if no depth buffer is provided. So it's not possible yet. So you have to use TriDef.

You're going to have to use TriDef + Oblivion DDD profile, Polynomial Barrel Distortion shader, and ReShade as set up as dxgi.dll .
For this to work. the way you want too. Make sure you exclude Depth3D in this case.

3840x1080x60hz is the screen size of your HMD right? I also need to add I do see that strange problem your getting I need to test this with this resolution.

I also should ask what HMD is this and what version of reshade?

You can always come on the discord chat and message me faster there. Maybe we can get down to fixing your problem faster there.
Last edit: 6 years 8 months ago by BlueSkyKnight.

Please Log in or Create an account to join the conversation.

  • mhalsan
More
6 years 8 months ago - 6 years 8 months ago #1327 by mhalsan Replied by mhalsan on topic 3D Depth Map Based Stereoscopic Shader
This is an older setup with dual projectors, polarized filters, and passive glasses.
Reshade 4.0.2. I tried version 3, no change.
I started with IZ3D, they went under. Now TriDef is bankrupt, and their installer requires internet activation just to install. I'm stuck with this PC
TriDef is slow but it works with Bethesda games and OutRun 2006.
Just tinkering with 'Polynomial Barrel Distortion" I was able to get the aspect ratio of the pixels correct (which is why I'd like to port that portion of the code to the 3D Depth shader), but I couldn't find a way to remove the barrel distortion, nor remove the black eyepiece masking.
As far as the depth buffer access goes, I'm not sure how TriDef accesses it. I haven't used ReShade before, but the possibility of better framerates is worth working on.
Last edit: 6 years 8 months ago by mhalsan. Reason: Reshade version

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago - 6 years 8 months ago #1328 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

mhalsan wrote: This is an older setup with dual projectors, polarized filters, and passive glasses.
Reshade 4.0.2. I tried version 3, no change.
I started with IZ3D, they went under. Now TriDef is bankrupt, and their installer requires internet activation just to install. I'm stuck with this PC
TriDef is slow but it works with Bethesda games and OutRun 2006.
Just tinkering with 'Polynomial Barrel Distortion" I was able to get the aspect ratio of the pixels correct (which is why I'd like to port that portion of the code to the 3D Depth shader), but I couldn't find a way to remove the barrel distortion, nor remove the black eyepiece masking.
As far as the depth buffer access goes, I'm not sure how TriDef accesses it. I haven't used ReShade before, but the possibility of better framerates is worth working on.


I found the problem. The update is up. Also, you can disable Barrel Distortion by setting these values.



As for the black eyepiece masking? Please show me what you are talking about, so I can tell you how to remove if you can.

You can read about it here. github.com/crosire/reshade-shaders/pull/...ad5491336ebee0b93f53
Last edit: 6 years 8 months ago by BlueSkyKnight. Reason: Updated to show it's Updated

Please Log in or Create an account to join the conversation.

  • mhalsan
More
6 years 8 months ago - 6 years 8 months ago #1329 by mhalsan Replied by mhalsan on topic 3D Depth Map Based Stereoscopic Shader
I've made progress. Here's Oblivion flat, 3840x1080, ReShade 4.0.2, no shaders.


Next, Oblivion with Polynomial Barrel Distortion: Half of each eye stays dark. However the pixel aspect ratio is correct. There is a significant amount of overscan, so that UI elements on the lower left corner are off the edge.



CONFIGURATION:
[Polynomial_Barrel_Distortion.fx]
Interpupillary_Distance=-1920
Lens_Distortion=0.000000,0.000000
Stereoscopic_Mode_Convert=0
Degrees=0.000000,0.000000
Vertical_Repositioning=0
Checkerboard_Reconstruction_Compatibility=0
Lens_Center=0.500000
Polynomial_Colors=100.000000,100.000000,100.000000
Zoom_Aspect_Ratio=1.000000,0.500000
Independent_Vertical_Repositioning=0,0
Independent_Horizontal_Repositioning=0,0
Vignette=0
Lens_Aliment_Marker=0
Image_Aliment_Marker=0
Diaspora=0
HMD_Profiles=0


Lastly, the updated 3D Depth:
There is a 2:1 horizontal compression on the pixel aspect ratio. Not sure what I have set wrong.


CONFIGURATION:
[Depth3D - Full HD.fx]
Depth_Map_Adjust=7.500000
Depth_Map=0
Divergence=7.000000
Depth_Map_View=0
SCSC=0
ZPD=0.010000
Auto_Depth_Range=0.100000
WP=0
Offset=0.000000
Depth_Map_Flip=0
Weapon_Scale=0
Weapon_Adjust=0.000000,0.000000
Weapon_Depth_Adjust=0.000000
Stereoscopic_Mode=0
Anaglyph_Desaturation=1.000000
Perspective=0
Eye_Swap=0
Cursor_STT=0.125000,0.500000,0.750000
Cursor_Color=1.000000,1.000000,1.000000


For comparison, the same scene with TriDef:
Last edit: 6 years 8 months ago by mhalsan. Reason: Photos added

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago - 6 years 8 months ago #1330 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

mhalsan wrote: I've made progress. Here's Oblivion flat, 3840x1080, ReShade 4.0.2, no shaders.



Next, Oblivion with Polynomial Barrel Distortion: Half of each eye stays dark. However the pixel aspect ratio is correct. There is a significant amount of overscan, so that UI elements on the lower left corner are off the edge.



CONFIGURATION:
[Polynomial_Barrel_Distortion.fx]
Interpupillary_Distance=-1920
Lens_Distortion=0.000000,0.000000
Stereoscopic_Mode_Convert=0
Degrees=0.000000,0.000000
Vertical_Repositioning=0
Checkerboard_Reconstruction_Compatibility=0
Lens_Center=0.500000
Polynomial_Colors=100.000000,100.000000,100.000000
Zoom_Aspect_Ratio=1.000000,0.500000
Independent_Vertical_Repositioning=0,0
Independent_Horizontal_Repositioning=0,0
Vignette=0
Lens_Aliment_Marker=0
Image_Aliment_Marker=0
Diaspora=0
HMD_Profiles=0


Lastly, the updated 3D Depth:
There is a 2:1 horizontal compression on the pixel aspect ratio. Not sure what I have set wrong.


CONFIGURATION:
[Depth3D - Full HD.fx]
Depth_Map_Adjust=7.500000
Depth_Map=0
Divergence=7.000000
Depth_Map_View=0
SCSC=0
ZPD=0.010000
Auto_Depth_Range=0.100000
WP=0
Offset=0.000000
Depth_Map_Flip=0
Weapon_Scale=0
Weapon_Adjust=0.000000,0.000000
Weapon_Depth_Adjust=0.000000
Stereoscopic_Mode=0
Anaglyph_Desaturation=1.000000
Perspective=0
Eye_Swap=0
Cursor_STT=0.125000,0.500000,0.750000
Cursor_Color=1.000000,1.000000,1.000000


For comparison, the same scene with TriDef:



You can't fix that without clipping UI and Scene elements.

Also, the game is running as if it's an Ultra Widescreen so the AR is off if you are running it the way you want too,

With Tridef it renders the scene twice so you get two 1080p per projector. This is why it works there. This is not something Reshade has control over.

There is still a way to do this though. Set Depth3D to Side by Side. With a custom resolution of 1920x1080 and scale it to 3840 x 1080. You lose rez. But, the AR should look right.

I guess if you have GPU Power to spare you can use 4k res and scale it down back to 3840 x 1080. You throw away rez. But, the AR should look right.

This can only be done if your system thinks that 3840 x 1080 is native. So I don't know if you can do it. Because my testing it didn't work with Eyefinity or NVSurround.

DualHead2Go Digital SE 'May' work for this problem along with a custom resolution or DSR / VSR.

www.matrox.com/graphics/en/products/gxm/dh2go/digital_se/
www.wsgf.org/forums/viewtopic.php?f=61&t=13822
Last edit: 6 years 8 months ago by BlueSkyKnight.

Please Log in or Create an account to join the conversation.

  • mhalsan
More
6 years 8 months ago #1331 by mhalsan Replied by mhalsan on topic 3D Depth Map Based Stereoscopic Shader
Thank you for helping me with this!
It doesn't look like this will work with my 3D setup, which is s shame, ReShade is a great community-based project!
The following user(s) said Thank You: BlueSkyKnight

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 8 months ago #1332 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

mhalsan wrote: Thank you for helping me with this!
It doesn't look like this will work with my 3D setup, which is s shame, ReShade is a great community-based project!


Actually, Thank you for pointing out the bug.

Please Log in or Create an account to join the conversation.

  • HelpMeSomebody
More
6 years 7 months ago #1333 by HelpMeSomebody Replied by HelpMeSomebody on topic 3D Depth Map Based Stereoscopic Shader
Just tried SuperDepth3D with Resident Evil 2 and it looks AWESOME. I used the settings for RE 7, just the DM and adjustment settings. Are there any other settings you recommend I tweak? Unfortunately you can't search through this thread to see if a particular game has already been discussed, so my apologies if this has already been talked about ...

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 7 months ago #1334 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

HelpMeSomebody wrote: Just tried SuperDepth3D with Resident Evil 2 and it looks AWESOME. I used the settings for RE 7, just the DM and adjustment settings. Are there any other settings you recommend I tweak? Unfortunately you can't search through this thread to see if a particular game has already been discussed, so my apologies if this has already been talked about ...


Use the New SuperDepth2.0.0 for that game and read the same settings for that game.

Please Log in or Create an account to join the conversation.

  • HelpMeSomebody
More
6 years 7 months ago - 6 years 7 months ago #1335 by HelpMeSomebody Replied by HelpMeSomebody on topic 3D Depth Map Based Stereoscopic Shader

BlueSkyKnight wrote:

HelpMeSomebody wrote: Just tried SuperDepth3D with Resident Evil 2 and it looks AWESOME. I used the settings for RE 7, just the DM and adjustment settings. Are there any other settings you recommend I tweak? Unfortunately you can't search through this thread to see if a particular game has already been discussed, so my apologies if this has already been talked about ...


Use the New SuperDepth2.0.0 for that game and read the same settings for that game.


Thank you for responding and for your awesome shader!

I already like the results with the old SuperDepth3D but I will try 2.0 as you suggest. I am not sure what you mean by "read the same settings for that game." Did you mean to say use the same settings for that game?--Meaning, use the same settings I am using now? Resident Evil 2 isn't listed anywhere in the Game Settings so I am using the settings for Resident Evil 7 ...

EDIT: Ah, I am an idiot. I see SuperDepth 2.0 comes with its own Game Settings. Sorry about that.

Also I saw someone in this thread talking about using SuperDepth3D with Star Wars Battlefront II ... but there is no settings listed for that game either. Any suggestions for that game?
Last edit: 6 years 7 months ago by HelpMeSomebody.

Please Log in or Create an account to join the conversation.

  • Sh1nRa358
More
6 years 7 months ago #1336 by Sh1nRa358 Replied by Sh1nRa358 on topic 3D Depth Map Based Stereoscopic Shader
@BlueSkyDefender: Possible to make the Reshade Menu in 3D like the UI for the Sony HMZ T3w (have the ui appear in each eye and increase its depth separate from the game)? I haven't set this up for the sony headset yet because typing with it on is a nightmare so I ordered the Avegant Glyph yesterday and I'll be using this for that. So I'm not aware of if it does this already. If so, ignore this. If not, would be cool to do to bring the menu above the game in 3D and makes for easier setting the options for reshade with a controller.

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 7 months ago #1337 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

Sh1nRa358 wrote: @BlueSkyDefender: Possible to make the Reshade Menu in 3D like the UI for the Sony HMZ T3w (have the ui appear in each eye and increase its depth separate from the game)? I haven't set this up for the sony headset yet because typing with it on is a nightmare so I ordered the Avegant Glyph yesterday and I'll be using this for that. So I'm not aware of if it does this already. If so, ignore this. If not, would be cool to do to bring the menu above the game in 3D and makes for easier setting the options for reshade with a controller.


Ya, it's a pain to adjust it when in 3D. But, I can't change this. This needs to be done on the Reshade side of things.

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 7 months ago #1338 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

HelpMeSomebody wrote:

BlueSkyKnight wrote:

HelpMeSomebody wrote: Just tried SuperDepth3D with Resident Evil 2 and it looks AWESOME. I used the settings for RE 7, just the DM and adjustment settings. Are there any other settings you recommend I tweak? Unfortunately you can't search through this thread to see if a particular game has already been discussed, so my apologies if this has already been talked about ...


Use the New SuperDepth2.0.0 for that game and read the same settings for that game.


Thank you for responding and for your awesome shader!

I already like the results with the old SuperDepth3D but I will try 2.0 as you suggest. I am not sure what you mean by "read the same settings for that game." Did you mean to say use the same settings for that game?--Meaning, use the same settings I am using now? Resident Evil 2 isn't listed anywhere in the Game Settings so I am using the settings for Resident Evil 7 ...

EDIT: Ah, I am an idiot. I see SuperDepth 2.0 comes with its own Game Settings. Sorry about that.

Also I saw someone in this thread talking about using SuperDepth3D with Star Wars Battlefront II ... but there is no settings listed for that game either. Any suggestions for that game?


There is a GameSettings 2.0.0 That has changes settings for some games. I don't know if I got to RE7 yet.

Also I don't know about Battlefront II. You need to adjust for that your self. Good luck

Please Log in or Create an account to join the conversation.

  • NubblesTehScrub
More
6 years 7 months ago - 6 years 7 months ago #1339 by NubblesTehScrub Replied by NubblesTehScrub on topic 3D Depth Map Based Stereoscopic Shader
Anybody Have "Deep Rock Galactic" and got this working good.
I have stereo working had to select the 3rd or 4th depth map. but there seems to be some really aggressive Hud detection affecting my gun/tool and objects occluding other objects. it causes an affect around the edges without depth. What setting am I looking for in depth3d/superdepth to tweak this?

Edit: Unreal Engine based game. Might need some .ini editing to remove DOF completely. also does built in AA affect reshade/Superdepth?
Last edit: 6 years 7 months ago by NubblesTehScrub. Reason: Additional info

Please Log in or Create an account to join the conversation.

  • BlueSkyKnight
  • Topic Author
More
6 years 7 months ago - 6 years 7 months ago #1340 by BlueSkyKnight Replied by BlueSkyKnight on topic 3D Depth Map Based Stereoscopic Shader

NubblesTehScrub wrote: Anybody Have "Deep Rock Galactic" and got this working good.
I have stereo working had to select the 3rd or 4th depth map. but there seems to be some really aggressive Hud detection affecting my gun/tool and objects occluding other objects. it causes an affect around the edges without depth. What setting am I looking for in depth3d/superdepth to tweak this?

Edit: Unreal Engine based game. Might need some .ini editing to remove DOF completely. also does built in AA affect reshade/Superdepth?


If the UI shows up in the depth buffer you can adjust for it using SuperDepth2.0 you can even add your own mask.

Keep in mind this part of the shader still WIP.

Well, that Entire shader is still WIP.
Last edit: 6 years 7 months ago by BlueSkyKnight.

Please Log in or Create an account to join the conversation.