It is currently 19 Nov 2017, 08:40
   
Text Size

Upscale low res card images to high res using Deep Learning

Discuss Card Scans and Other Artwork Here

Moderator: CCGHQ Admins

Re: Upscale low res card images to high res using Deep Learn

Postby nesci » 02 Aug 2017, 17:29

ok thanks for you answer, I guess i won't be able to make it work for my pictures.

But out of curiosity, how could you train your network for only the artwork?
Taking the survey pic of AKH, cropping to only get the artwork, dividing them into 64x64 blocks and then do the same with low quality pic and 16x16 blocks and then train it with all the blocks?
nesci
 
Posts: 5
Joined: 18 Jul 2017, 02:41
Has thanked: 1 time
Been thanked: 0 time

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 02 Aug 2017, 18:56

Basically yes - except there is no need to generate the low quality data as the training process downsamples the high res for you.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 02 Aug 2017, 18:57

Wildfire Eternal.full.png


I have processed the full set with this 3rd version. If anyone wants to host this set (from CCGHQ or elsewhere) please let me know.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby Zarthbenn » 17 Aug 2017, 03:19

Have you looked into Waifu2x? They have been working on a similar but different feat as far as deep learning art upscaling. While their goal is primarily art focused there might be something there to help.

Here is the same inital test you ran with their program.

Before:
card.png


After:
card(RGB)(noise_scale)(Level1)(1060x1480).png


Your results look very promising and a huge step up from the inital run.
User avatar
Zarthbenn
 
Posts: 13
Joined: 24 Oct 2016, 06:48
Has thanked: 1 time
Been thanked: 10 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 17 Aug 2017, 05:12

I love that result, especially on the art. I'll definitely have a look when I get back from my holiday.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 06 Sep 2017, 13:46

Waifu2x looks extremely well suited to upsampling the low res cards - despite not being specifically trained for magic cards. It does a great job on the art and a reasonable job on all the icons. The text is OK too as long as you are not expecting perfection. If anyone fancies installing Waifu2x locally and batch upsampling cards I think the results would be as good as or better than what I am getting at the moment. I'll continue to refine my training process to see if I can beat Waifu and may even get round to installing it myself at some point so I can use it myself. It would be good to try training it with the high res renders too.

Thanks for pointing me to it.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 13 Sep 2017, 20:46

I've made some more improvements to the pipeline and will be processing the XLN cards as they are spoiled - here's a mini preview of the raw output - I'll post some more fully processed images once I have them:

Spoiled low res:
Arguel's Blood Fast.full.png

Super res:
Arguel's Blood Fast.full.png.xhlq.png
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 13 Sep 2017, 20:57

As it is now a deeper network trained for longer on more data it is performing much better on the art. It also performs very well on unseen card frames, like the new double sided cards - as well as handling the token frames despite not having trained it on tokens.
c_treasure1.png.xhlq.png
Adanto, the First Fort.full.png.xhlq.png
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby kevlahnota » 14 Sep 2017, 01:08

DO you have a complete collection of this? from Alpha to the Latest Release? Where to download them? thanks.
User avatar
kevlahnota
Programmer
 
Posts: 524
Joined: 19 Jul 2010, 17:45
Location: Philippines
Has thanked: 12 times
Been thanked: 147 times

Re: Upscale low res card images to high res using Deep Learn

Postby Bog Wraith » 14 Sep 2017, 17:00

austinio7116 wrote:As it is now a deeper network trained for longer on more data it is performing much better on the art. It also performs very well on unseen card frames, like the new double sided cards - as well as handling the token frames despite not having trained it on tokens.
The results are remarkable. I am most impressed with the software your using and its ability to learn from each successive run. It strikes me that this method can/will be used for additional graphics processing and indeed, I wonder if it could be applied to video, especially analog video when it is being converted and imported digitally.

I look forward to seeing where this might lead to. 8)
'Twas in the bogs of Cannelbrae
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
User avatar
Bog Wraith
Global Mod 1 (Ret)
 
Posts: 1048
Joined: 28 May 2008, 22:40
Location: Shandalar
Has thanked: 344 times
Been thanked: 147 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 14 Sep 2017, 21:53

kevlahnota wrote:DO you have a complete collection of this? from Alpha to the Latest Release? Where to download them? thanks.
I have only used the network to upsample the latest sets (where we only have the 265x370 spoiler images) so that I have sufficient quality images until the CCGHQ scans become available - you are much better off looking up those collections for all sets up to HOU.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 14 Sep 2017, 21:55

Bog Wraith wrote:
austinio7116 wrote:I wonder if it could be applied to video, especially analog video when it is being converted and imported digitally.
Neural networks of this type are being used by the Facebooks and Twitters of the world to use super resolution for video compression.
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

Re: Upscale low res card images to high res using Deep Learn

Postby Bog Wraith » 15 Sep 2017, 01:31

austinio7116 wrote:
Neural networks of this type are being used by the Facebooks and Twitters of the world to use super resolution for video compression.
That is correct, but that is being done with, for the most part, digital video. What I'm referring to is importing video off of VCR tape, converting it to digital, then upscaling it while it's being processed. There is so much analog video that needs to be digitally converted for both delivery, editing and in some ways most importantly for archiving purposes.

I've worked with & have converted thousands upon thousands of hours of video for over 2 decades in my field of video editing in which it was a small part of what I did in creating multi media content for delivery on different mediums, now mostly delivered via streaming as opposed to the old ways of DVD/Blue-ray platforms.

Any upscaling that is used is done so on a frame by frame basis, which is an extremely time extensive process which thus cost a lot of money to do, and the computing power necessary to do this pushes the hardware to its limits to accomplish this. It's much better today then say 10 years ago because the power on top of the line desktop workstations is much more now then it was then.
The same comparison to this is how animation or special effects rendering is done in the same frame by frame method which also takes a lot of both time & processing power to achieve.

What I see of the results you are getting is to me very inspiring and I, being a retired multi media content creator find, as a certain Vulcan science officer would say, "Fascinating"!
'Twas in the bogs of Cannelbrae
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
User avatar
Bog Wraith
Global Mod 1 (Ret)
 
Posts: 1048
Joined: 28 May 2008, 22:40
Location: Shandalar
Has thanked: 344 times
Been thanked: 147 times

Re: Upscale low res card images to high res using Deep Learn

Postby Xitax » 16 Sep 2017, 00:34

The full spoiler is out! Can't wait to see what this looks like on the full set :)
Xitax
 
Posts: 801
Joined: 16 May 2010, 17:19
Has thanked: 128 times
Been thanked: 103 times

Re: Upscale low res card images to high res using Deep Learn

Postby austinio7116 » 16 Sep 2017, 06:44

Xitax wrote:The full spoiler is out! Can't wait to see what this looks like on the full set :)
Working on the final lot
austinio7116
 
Posts: 177
Joined: 10 Mar 2017, 11:59
Has thanked: 19 times
Been thanked: 54 times

PreviousNext

Return to Pictures

Who is online

Users browsing this forum: No registered users and 4 guests


Who is online

In total there are 4 users online :: 0 registered, 0 hidden and 4 guests (based on users active over the past 10 minutes)
Most users ever online was 279 on 11 Jul 2013, 22:03

Users browsing this forum: No registered users and 4 guests

Login Form