Upscale low res card images to high res using Deep Learning
Discuss Card Scans and Other Artwork Here
Moderator: CCGHQ Admins
Upscale low res card images to high res using Deep Learning
by austinio7116 » 13 Jul 2017, 23:15
I have been working on a project to train a neural network (Deep Convolutional Generative Adversarial Network) to upsample images from 265x370 to 1060x1480 resolution. There is plenty of training data as we have HQ scans of all but the most recent set and, once trained, the network can be used to upsample the new sets where we only have low-res spoilers. The network is only trained on parts of the card other than the art, so the art does get a bit modified with the current version. Here is a sample of my first attempt - more examples to follow if people are interested:
low res:
high res:
EDIT:
In case you are reading this thread for the first time - here's how the upscaling looks now (this image shows the low res, the upscaled output - then as we have them now the high res scans too):
And here is a video showing the effect up close: https://www.youtube.com/watch?v=qpFsaIc8BgU
And now with the new ESRGAN model added as the third image:
low res:
high res:
EDIT:
In case you are reading this thread for the first time - here's how the upscaling looks now (this image shows the low res, the upscaled output - then as we have them now the high res scans too):
And here is a video showing the effect up close: https://www.youtube.com/watch?v=qpFsaIc8BgU
And now with the new ESRGAN model added as the third image:
Last edited by austinio7116 on 08 Feb 2020, 14:57, edited 4 times in total.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by kudit » 14 Jul 2017, 04:47
Very interested. Please keep us posted!
Please give feedback on our card database at http://www.deckmaster.info
Send comments via PM here or info@deckmaster.info
Send comments via PM here or info@deckmaster.info
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 14 Jul 2017, 09:55
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 16 Jul 2017, 07:51
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 16 Jul 2017, 09:20
I'm going to try two things now. First tweaking the training parameters, then testing with a smoothed training set i.e. remove the dot matrix effect of the high Res scans.
I am also trying to work out why the borders seem to be increasing in contrast too much.
I am also trying to work out why the borders seem to be increasing in contrast too much.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by kudit » 16 Jul 2017, 13:52
We have hyper high resolution images from the last few sets from the surveys that would be better end results for training. My primary use would be to have the OCR area cleared up from the image gallery versions as sometimes it's hard to read the artist name. What are you using to code this in?
Please give feedback on our card database at http://www.deckmaster.info
Send comments via PM here or info@deckmaster.info
Send comments via PM here or info@deckmaster.info
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 16 Jul 2017, 14:02
Tensorflow python. Good idea to use the survey images - I'll try that. I have them already somewhere I think.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 16 Jul 2017, 14:07
Based on this approach: https://github.com/david-gpu/srez
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 16 Jul 2017, 22:15
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by Bog Wraith » 17 Jul 2017, 00:02
Can someone please post the link to the survey that has the HQ images? I had this for Amonkhet and I'd like to get the images for use until our own CCGHQ imaging team release our in house version.
'Twas in the bogs of Cannelbrae
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
-
Bog Wraith - Global Mod 1 (Ret)
- Posts: 1108
- Joined: 28 May 2008, 22:40
- Location: Shandalar
- Has thanked: 425 times
- Been thanked: 153 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 17 Jul 2017, 05:25
I am training on the AKH survey images and using the model to upscale HOU. There are no HOU HQ survey images that I know of - if there were this project would not be necessary.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 17 Jul 2017, 18:26
Using the high res survey images for training I've seen improved results in the art, but the border (especially the artist/collection no area) is not so good:
It could be the training parameters that differ though so I need to try a few more things out. Even if this is as good as I can get it however I could combine the outputs of two of the networks we have so far to give this:
This uses the border and text from the network trained on normal HQ scans and the image from the network trained on the survey images. Ideally I'd like to get a single network producing good results though.
It could be the training parameters that differ though so I need to try a few more things out. Even if this is as good as I can get it however I could combine the outputs of two of the networks we have so far to give this:
This uses the border and text from the network trained on normal HQ scans and the image from the network trained on the survey images. Ideally I'd like to get a single network producing good results though.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by austinio7116 » 18 Jul 2017, 07:43
I've decided to process the whole set (this will take around 48 hours) with what I think is the best results I have so far (posted above at 16 Jul 2017, 07:51). That will provide us with a full set of upscaled images albeit with some artifacts on the art. Once I have that I can try to find a better set of training parameters to produce good results from the survey image trained model and either combine the two or, if I can get good results across the whole card with that model, replace them.
I will then give the invocations a go too.
I will then give the invocations a go too.
-
austinio7116 - Posts: 451
- Joined: 10 Mar 2017, 11:59
- Has thanked: 47 times
- Been thanked: 169 times
Re: Upscale low res card images to high res using Deep Learn
by Agetian » 18 Jul 2017, 07:59
Very nice! This is an awesome project!
- Agetian
- Agetian
- Agetian
- Programmer
- Posts: 3471
- Joined: 14 Mar 2011, 05:58
- Has thanked: 676 times
- Been thanked: 561 times
Re: Upscale low res card images to high res using Deep Learn
by Bog Wraith » 18 Jul 2017, 19:34
It hasn't been necessary up till now either. The survey images have been available for the last few sets so naturally I thought that this set would be done as well.austinio7116 wrote:I am training on the AKH survey images and using the model to upscale HOU. There are no HOU HQ survey images that I know of - if there were this project would not be necessary.
Glad you're doing this but I was under the impression you were doing this for future sets to get these HQ images faster than even with the survey method.
Your results look very promising and I look forward to seeing it when done, not only for this set, but hopefully for others in the future too.
'Twas in the bogs of Cannelbrae
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
My mate did meet an early grave
'Twas nothing left for us to save
In the peat-filled bogs of Cannelbrae.
-
Bog Wraith - Global Mod 1 (Ret)
- Posts: 1108
- Joined: 28 May 2008, 22:40
- Location: Shandalar
- Has thanked: 425 times
- Been thanked: 153 times
Who is online
Users browsing this forum: No registered users and 28 guests