*sad update* ESRGAN AI Upscaling (ScummVM fork and tools pulled from github by author)

All the inane chatter goes in here. If you're curious about whether we will support a game, post HERE not in General Discussion :)

Moderator: ScummVM Team

Post Reply
User avatar
Raziel
ScummVM Porter
Posts: 1532
Joined: Tue Oct 25, 2005 8:27 am
Location: a dying planet
Contact:

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by Raziel »

@tomimt

A crazy art project just sprang to my mind.

The Secret of Monkey Island fan edition where all the backgrounds and sprites in every screen/scene are done by different artists reflecting their own profession and art style.

While one screen might be pure 8-bit, the next screen could be psychedelic over-the-top neon coloured backgrounds and spaced-out characters, while the following screen could be Cel-shading, then flat, then anime etc...

Uuuuhh :-)
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

That could turn out to be something truly special. Perhaps even avant-garde.
User avatar
BeleG
Posts: 42
Joined: Mon Feb 16, 2009 12:31 pm

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by BeleG »

This is such a primising development, well done! I can’t wait to see what can be done with this.
MusicallyInspired wrote: Mon Jan 25, 2021 8:16 pm Here's a video I made with his build playing Space Quest 4 with my ESRGAN background upscales:

https://www.youtube.com/watch?v=VVdali9PzKQ

This can also be done for SCI0 EGA games! VGA-ifying EGA games can be much easier now!

EDIT: Here's KQ4 with a few VGA backgrounds:

https://www.youtube.com/watch?v=ZR5dQdrlaOM
MusicallyInspired, I don’t know which training sets you’re using but your upscales strike the perfect balance for a remake of VGA games like these. They just look like the original drawings would have before they were scanned in and scaled down to 320x240.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

just out of interest, here's a couple of ESRGAN upscales I did of The Secret of Monkey Island. Guybrush especially turned out pretty nice.

Edit, for those who don't want to click Twitter links, here's my Blogger blog post with the Monkey Island upscales: https://bit.ly/3aHDgiD

https://twitter.com/tomimt/status/1358184129075019779

https://twitter.com/tomimt/status/1358185180406628354

https://twitter.com/tomimt/status/1358184789891776517

https://twitter.com/tomimt/status/1358192926573092866
Last edited by tomimt on Mon Feb 15, 2021 3:02 pm, edited 1 time in total.
Blakes7
Posts: 39
Joined: Sun Nov 03, 2019 9:44 am

Re: ESRGAN: AI Neural Net Upscaling (For HiRes Packs?)

Post by Blakes7 »

MusicallyInspired wrote: Mon Jan 25, 2021 8:16 pm Here's a video I made with his build playing Space Quest 4 with my ESRGAN background upscales:

https://www.youtube.com/watch?v=VVdali9PzKQ

This can also be done for SCI0 EGA games! VGA-ifying EGA games can be much easier now!

EDIT: Here's KQ4 with a few VGA backgrounds:

https://www.youtube.com/watch?v=ZR5dQdrlaOM
I noticed you did some King's Quest II SCI graphics some time ago. Hopefully you get a chance to complete this if AGI engine is added.
https://www.youtube.com/watch?v=sf09eXkZiNo
User avatar
MusicallyInspired
Posts: 1138
Joined: Fri Mar 02, 2007 8:03 am
Location: Manitoba, Canada
Contact:

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by MusicallyInspired »

KQ2SCI is more than just an AGI facelift. I do want to finish it someday, but I won't use ScummVMx for that.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

I've been playing a lot with ESRGAN lately and decided to give a go with Larry's acid trip cinematic from LSL7. The end result is pretty good.
https://www.youtube.com/watch?v=8l8ZYBa ... =TheTomimt

This isn't Sierra related, but as the result was pretty damned good, I'll post this upscale of Broken Sword 1 intro as well:
https://www.youtube.com/watch?v=7sKu6S2 ... =TheTomimt
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

Here are some results I got upscaling LSL7 Love For Sail (link goes to my Blogger blog, it's pretty image-heavy, so be warned)
https://bit.ly/2SOdNyZ

Out of all the upscale tests I've done, I'd say LSL7 could work the best as an ESRGAN upscaled version. The graphics scale up nicely thanks to the style.
invwar
Posts: 70
Joined: Mon Jul 28, 2008 11:35 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by invwar »

For Broken Sword, I would recommend to use the Director's Cut videos as source. The videos are completely recoded from the original source and thus have way less artifacts, which should especially benefit at the explosion and the balloons.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

invwar wrote: Sat May 15, 2021 2:18 pm For Broken Sword, I would recommend to use the Director's Cut videos as source. The videos are completely recoded from the original source and thus have way less artifacts, which should especially benefit at the explosion and the balloons.

I actually used the DC video for the upscale.
User avatar
eriktorbjorn
ScummVM Developer
Posts: 3557
Joined: Mon Oct 31, 2005 7:39 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by eriktorbjorn »

invwar wrote: Sat May 15, 2021 2:18 pm For Broken Sword, I would recommend to use the Director's Cut videos as source. The videos are completely recoded from the original source and thus have way less artifacts, which should especially benefit at the explosion and the balloons.
I didn't realize that, but I'm glad to see they got rid of this encoding error in Broken Sword 2:
bs2-comparison.png
bs2-comparison.png (87.95 KiB) Viewed 20635 times
(At least I think it's an encoding error. I guess it could be a decoder error.)
User avatar
Longcat
Posts: 1061
Joined: Sat Sep 23, 2006 3:15 pm

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by Longcat »

I may be misremembering, but I believe they only retouched the original videos (applied some filters) and chopped them up (they are shorter) to get rid of some of the artefacts. They even replaced some shots with still frames by Dave Gibbons, like in the introscene seen here. Reason being, they did not have access to the source animation cells anymore.

So, the DC are probably actually inferior to the originals, for use with ESRGAN (and as animated cutscenes). But as I said, I may remember it wrong.
invwar
Posts: 70
Joined: Mon Jul 28, 2008 11:35 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by invwar »

tomimt wrote: Sun May 16, 2021 1:09 pm
invwar wrote: Sat May 15, 2021 2:18 pm For Broken Sword, I would recommend to use the Director's Cut videos as source. The videos are completely recoded from the original source and thus have way less artifacts, which should especially benefit at the explosion and the balloons.

I actually used the DC video for the upscale.
Ahh, OK. So its likely Youtube created all the artifacts.
tomimt
Posts: 22
Joined: Wed Jan 20, 2021 11:01 am

Re: *UPDATES!* ESRGAN AI Upscaling (HiRes packs now possible!)

Post by tomimt »

invwar wrote: Sat May 22, 2021 11:04 am
Ahh, OK. So its likely Youtube created all the artifacts.
It is possible. I have some uncompressed frames on my blog: https://bit.ly/3enlLY6
beware, the blog entry is image-heavy, so it might take a bit to load.
ZTylerDurden
Posts: 4
Joined: Thu Sep 09, 2021 2:51 pm

Re: ESRGAN: AI Neural Net Upscaling

Post by ZTylerDurden »

Been lurking this thread for a while checking for updates. Is this being discussed or tracked anywhere else?

The upscaled samples of Curse of Monkey Island look incredible. I've tried different ESRGAN models+games for ~2 years and not all of them work as well as they do with this game.

Is there no way to mod this game?

According to one of the devs, he earlier posted that it's "futile":
sev wrote: Sun Mar 15, 2020 10:30 am To all "non-programmers" here. ESRGAN will not come to ScummVM. The reason is simple: it is not real time, and is unable to produce 60 frames per second on modern computers. There are attempts to work around that by lowering the quality of the output, and algorithms like RTSRGAN produce 15 images per second on a single 2.3GHz CPU.

Thus, no, this topic is futile.


Eugene
Post Reply