*sad update* ESRGAN AI Upscaling (ScummVM fork and tools pulled from github by author)
Moderator: ScummVM Team
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Wow! Just the fact that this is possible is impressive. You've made it possible for hi-def upgrades of sierra games!! I fully expect people to begin creating graphics replacements for these games now.
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
A while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:Blakes7 wrote: ↑Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY
This was done back in 2018 so who knows whats possible now.
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt
The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.
I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
-
- Posts: 68
- Joined: Thu Jul 18, 2019 1:31 pm
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Looks like we're finally getting somewhere with this! Thank you for your work.MiLO83 wrote: ↑Sun Jan 17, 2021 11:37 pm https://youtu.be/pmtRH1hcG50
https://youtu.be/bQ3JFdbWCJ0
https://github.com/MiLO83/scummvmx (Modified SCI Engine)
https://github.com/MiLO83/SCICompanionX (Modified to Batch Dump SCI Graphics [Views] as individual Cels required for mod). SCICompanionX currently dumps backgrounds as .bmp, these need to be Converted to .png. (Remember to somehow Enlarge all graphics exactly 4x.) [ESRGAN for instance.. ]
Not all SCI Games work, this is a W.i.P Alpha demonstration.
- MiLO83
I haven't tried it on videos myself but Cupscale has a Video Upscale option. It's completely free cause it's basically just a GUI for ESRGAN but very straightforward to install and use cause it downloads the dependencies within the app. You just need to get some models from here for example: https://upscale.wiki/wiki/Model_Databasetomimt wrote: ↑Wed Jan 20, 2021 7:52 pmA while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:Blakes7 wrote: ↑Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY
This was done back in 2018 so who knows whats possible now.
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt
The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.
I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Your attempts made me really interested in upscaling myself, also because I am not that satisfied with your upscaled version, as it more looks like a animated church glass window as a video. This is, I think caused by the most used training model of Gigapixel, as I see the effect nowadays with so many upscaled videos. I tried Topaz newer tool Video Enhance AI, which is using models more suitable for videos. Personally, I prefer the result, but this might be just a matter of taste. Anyway, it's quite impressive how good the AI tools perform nowadays, let's see what they can do in the future.tomimt wrote: ↑Wed Jan 20, 2021 7:52 pmA while back I did a small test with GK2 videos with still then beta version of Gigapixel AI Video. My results with it are here:Blakes7 wrote: ↑Tue Dec 29, 2020 5:16 am Jim Leonard upscaled Gabriel Knight 2 video from 308x167 playing back at 10fps, and uploaded to YouTube at 720p60
https://www.youtube.com/watch?v=6HJndgXMKYY
This was done back in 2018 so who knows whats possible now.
https://www.youtube.com/watch?v=nG73fb_ ... =TheTomimt
The beta version did make the upscale look a bit painterly, but there have been several improvements on it since it has been released. There are some pretty impressive upscale done with it, for example, Wing Commander 4 high-resolution project has shown some very impressive upscale. They do have a bit higher resolution video on their hands though, about DVD quality.
I haven't yet tried if Topaz would allow me a new 30-day trial on the video upscale software they have, as the previous version I used was the beta version. If they do allow it, I'll give a new spin on how their most current version of the software will fare with such a low resolution as GK2 has.
As I am on an AMD GPU (screw you miner ), I couldn't find a free to use tool that can properly change the FPS from the 10 to 60FPS to make this changes even more impressive.
Gabriel Knight 2 Intro
Here is a comparison to one original video upload
Gabriel Knight 2 Police station (german meme version)
Gabriel Knight 2 Police station comparison to orginal video upload
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Kasenshlogga wrote: ↑Sun Jan 24, 2021 4:17 am I haven't tried it on videos myself but Cupscale has a Video Upscale option.
Oh, thanks for the link to Cupscale, I'll give it a spin at some point.
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Yes, I do believe Video Enhance AI is what the beta version of the video upscale I tried turned into. I've been keeping my eye on it, on and off, and it does seem like it is constantly getting better. The results on low-quality video I've seen scaled wit newer versions are very impressive.invwar wrote: ↑Sun Jan 24, 2021 9:10 am
Your attempts made me really interested in upscaling myself, also because I am not that satisfied with your upscaled version, as it more looks like a animated church glass window as a video. This is, I think caused by the most used training model of Gigapixel, as I see the effect nowadays with so many upscaled videos. I tried Topaz newer tool Video Enhance AI, which is using models more suitable for videos. Personally, I prefer the result, but this might be just a matter of taste. Anyway, it's quite impressive how good the AI tools perform nowadays, let's see what they can do in the future.
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Great news about the SCI support, I hope that another engines will be added too. I'm looking forward to playing the games like The Curse of Monkey Island, Discworld or Broken Sword in hi-res.
Some CoMI images upscaled by Laserschwert:
https://www.reddit.com/r/GameUpscale/co ... ey_island/
Some CoMI images upscaled by Laserschwert:
https://www.reddit.com/r/GameUpscale/co ... ey_island/
- MusicallyInspired
- Posts: 1138
- Joined: Fri Mar 02, 2007 8:03 am
- Location: Manitoba, Canada
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Myles posted his build on Facebook. I'm going to be playing with it on my next day off and try to put together some kind of High Res pack for a smaller game first that's less work and see what we can get done in the way of HRPs for Sierra games. This would also be a simple way to VGA-ify EGA games!
You know what would also be great is the capability to replace graphic assets for AGI games too .
You know what would also be great is the capability to replace graphic assets for AGI games too .
- MusicallyInspired
- Posts: 1138
- Joined: Fri Mar 02, 2007 8:03 am
- Location: Manitoba, Canada
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Here's a video I made with his build playing Space Quest 4 with my ESRGAN background upscales:
https://www.youtube.com/watch?v=VVdali9PzKQ
This can also be done for SCI0 EGA games! VGA-ifying EGA games can be much easier now!
EDIT: Here's KQ4 with a few VGA backgrounds:
https://www.youtube.com/watch?v=ZR5dQdrlaOM
https://www.youtube.com/watch?v=VVdali9PzKQ
This can also be done for SCI0 EGA games! VGA-ifying EGA games can be much easier now!
EDIT: Here's KQ4 with a few VGA backgrounds:
https://www.youtube.com/watch?v=ZR5dQdrlaOM
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Those look pretty amazing. I foresee interesting things in the future.
- Raziel
- ScummVM Porter
- Posts: 1541
- Joined: Tue Oct 25, 2005 8:27 am
- Location: a dying planet
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
@MusicallyInspired
Is it normal that some of the backgrounds seem to lack sharpness?
e.g. the beach hut in Kqiv looks amazing, but also as if the camera focus is borked
Is it normal that some of the backgrounds seem to lack sharpness?
e.g. the beach hut in Kqiv looks amazing, but also as if the camera focus is borked
- MusicallyInspired
- Posts: 1138
- Joined: Fri Mar 02, 2007 8:03 am
- Location: Manitoba, Canada
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
That's what the image itself looks like. That's the artist's work.
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Random Thought: There is a space quest 1 sci vga remake. I suppose it would be possible to give that game the agi graphics and keep the parser interface. But things are positioned differently aren't they item wise and such. I suppose you could get it looking quite close in some places. That would really confuse some people!
- MusicallyInspired
- Posts: 1138
- Joined: Fri Mar 02, 2007 8:03 am
- Location: Manitoba, Canada
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
Yeah, once you change the image perspective and size of objects it starts treading into script-altering territory that would be required which is out of scope with this. Though, I suppose possible if you had some sort of on-the-fly scripting to change key object coordinates and values. I'm not sure how possible that is for something like this though for AGI/SCI.
- MusicallyInspired
- Posts: 1138
- Joined: Fri Mar 02, 2007 8:03 am
- Location: Manitoba, Canada
- Contact:
Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)
4x high res priority maps are now implemented!
https://www.youtube.com/watch?v=74u_12yrNOI
EDIT: And full range alpha transparency:
https://github.com/MiLO83/scummvmx/rele ... v0.89-beta
https://www.youtube.com/watch?v=74u_12yrNOI
EDIT: And full range alpha transparency:
https://github.com/MiLO83/scummvmx/rele ... v0.89-beta