*sad update* ESRGAN AI Upscaling (ScummVM fork and tools pulled from github by author)

All the inane chatter goes in here. If you're curious about whether we will support a game, post HERE not in General Discussion :)

Moderator: ScummVM Team

Post Reply
Blakes7
Posts: 39
Joined: Sun Nov 03, 2019 9:44 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Blakes7 »

Wow! Just the fact that this is possible is impressive. You've made it possible for hi-def upgrades of sierra games!! I fully expect people to begin creating graphics replacements for these games now.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by tomimt »

Blakes7 wrote: Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY

This was done back in 2018 so who knows whats possible now.
A while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt

The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.

I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
Kasenshlogga
Posts: 68
Joined: Thu Jul 18, 2019 1:31 pm

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Kasenshlogga »

MiLO83 wrote: Sun Jan 17, 2021 11:37 pm https://youtu.be/pmtRH1hcG50

https://youtu.be/bQ3JFdbWCJ0

https://github.com/MiLO83/scummvmx (Modified SCI Engine)
https://github.com/MiLO83/SCICompanionX (Modified to Batch Dump SCI Graphics [Views] as individual Cels required for mod). SCICompanionX currently dumps backgrounds as .bmp, these need to be Converted to .png. (Remember to somehow Enlarge all graphics exactly 4x.) [ESRGAN for instance.. :)]

Not all SCI Games work, this is a W.i.P Alpha demonstration.

- MiLO83
Looks like we're finally getting somewhere with this! Thank you for your work.
tomimt wrote: Wed Jan 20, 2021 7:52 pm
Blakes7 wrote: Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY

This was done back in 2018 so who knows whats possible now.
A while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt

The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.

I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
I haven't tried it on videos myself but Cupscale has a Video Upscale option. It's completely free cause it's basically just a GUI for ESRGAN but very straightforward to install and use cause it downloads the dependencies within the app. You just need to get some models from here for example: https://upscale.wiki/wiki/Model_Database
invwar
Posts: 70
Joined: Mon Jul 28, 2008 11:35 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by invwar »

tomimt wrote: Wed Jan 20, 2021 7:52 pm
Blakes7 wrote: Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY

This was done back in 2018 so who knows whats possible now.
A while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt

The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.

I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
Your attempts made me really interested in upscaling myself, also because I am not that satisfied with your upscaled version, as it more looks like a animated church glass window as a video. This is, I think caused by the most used training model of Gigapixel, as I see the effect nowadays with so many upscaled videos. I tried Topaz newer tool Video Enhance AI, which is using models more suitable for videos. Personally, I prefer the result, but this might be just a matter of taste. Anyway, it's quite impressive how good the AI tools perform nowadays, let's see what they can do in the future.
As I am on an AMD GPU (screw you miner ;)), I couldn't find a free to use tool that can properly change the FPS from the 10 to 60FPS to make this changes even more impressive.
Gabriel Knight 2 Intro
Here is a comparison to one original video upload

Gabriel Knight 2 Police station (german meme version)
Gabriel Knight 2 Police station comparison to orginal video upload
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by tomimt »

Kasenshlogga wrote: Sun Jan 24, 2021 4:17 am I haven't tried it on videos myself but Cupscale has a Video Upscale option.

Oh, thanks for the link to Cupscale, I'll give it a spin at some point.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by tomimt »

invwar wrote: Sun Jan 24, 2021 9:10 am
Your attempts made me really interested in upscaling myself, also because I am not that satisfied with your upscaled version, as it more looks like a animated church glass window as a video. This is, I think caused by the most used training model of Gigapixel, as I see the effect nowadays with so many upscaled videos. I tried Topaz newer tool Video Enhance AI, which is using models more suitable for videos. Personally, I prefer the result, but this might be just a matter of taste. Anyway, it's quite impressive how good the AI tools perform nowadays, let's see what they can do in the future.
Yes, I do believe Video Enhance AI is what the beta version of the video upscale I tried turned into. I've been keeping my eye on it, on and off, and it does seem like it is constantly getting better. The results on low-quality video I've seen scaled wit newer versions are very impressive.
Mim
Posts: 85
Joined: Sun Dec 11, 2005 4:59 pm

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Mim »

Great news about the SCI support, I hope that another engines will be added too. I'm looking forward to playing the games like The Curse of Monkey Island, Discworld or Broken Sword in hi-res. :)

Some CoMI images upscaled by Laserschwert:
https://www.reddit.com/r/GameUpscale/co ... ey_island/
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by MusicallyInspired »

Myles posted his build on Facebook. I'm going to be playing with it on my next day off and try to put together some kind of High Res pack for a smaller game first that's less work and see what we can get done in the way of HRPs for Sierra games. This would also be a simple way to VGA-ify EGA games!

You know what would also be great is the capability to replace graphic assets for AGI games too :D.
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by MusicallyInspired »

Here's a video I made with his build playing Space Quest 4 with my ESRGAN background upscales:

https://www.youtube.com/watch?v=VVdali9PzKQ

This can also be done for SCI0 EGA games! VGA-ifying EGA games can be much easier now!

EDIT: Here's KQ4 with a few VGA backgrounds:

https://www.youtube.com/watch?v=ZR5dQdrlaOM
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by tomimt »

Those look pretty amazing. I foresee interesting things in the future.
User avatar
Raziel
ScummVM Porter
Posts: 1532
Joined: Tue Oct 25, 2005 8:27 am
Location: a dying planet
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Raziel »

@MusicallyInspired

Is it normal that some of the backgrounds seem to lack sharpness?

e.g. the beach hut in Kqiv looks amazing, but also as if the camera focus is borked
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by MusicallyInspired »

That's what the image itself looks like. That's the artist's work.
pic.7.png
pic.7.png (139.4 KiB) Viewed 30206 times
Blakes7
Posts: 39
Joined: Sun Nov 03, 2019 9:44 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Blakes7 »

Random Thought: There is a space quest 1 sci vga remake. I suppose it would be possible to give that game the agi graphics and keep the parser interface. But things are positioned differently aren't they item wise and such. I suppose you could get it looking quite close in some places. That would really confuse some people!
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by MusicallyInspired »

Yeah, once you change the image perspective and size of objects it starts treading into script-altering territory that would be required which is out of scope with this. Though, I suppose possible if you had some sort of on-the-fly scripting to change key object coordinates and values. I'm not sure how possible that is for something like this though for AGI/SCI.
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by MusicallyInspired »

4x high res priority maps are now implemented!

https://www.youtube.com/watch?v=74u_12yrNOI

EDIT: And full range alpha transparency:
https://github.com/MiLO83/scummvmx/rele ... v0.89-beta
Post Reply