Page 6 of 15

Re: The "2000 limit no more" CSV

PostPosted: 18 Dec 2011, 16:23
by 0rion79
Try this one: I've seen that there were several mistakes in Expert Rarity, used for reprintings, because some values were missing an "h". Also, done the same for other fields, switched 0 creature types to 211 and removed some extra columns that had no reason to exhist.
Please, also share with me the new converter that allows more than 2K cards.

Re: The "2000 limit no more" CSV

PostPosted: 18 Dec 2011, 17:10
by Gargaroz
Everything seems OK now, get the file you asked for here, it's the new one that also generates the "Ids enumerator" :
viewtopic.php?f=56&t=5936&p=77367#p77296

Re: The "2000 limit no more" CSV

PostPosted: 18 Dec 2011, 17:19
by 0rion79
Glad that I could have been of help! :) Now the hardest work is to re-fill the slots for already coded cards. May you or Mok code any program that does it automatically, taking data from one excell file and merging it ino the other file? Since fields are the same, it is just a matter of copying the whole strings except for column 1.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 03:29
by Sonic
0rion79 wrote:@ Sonic, how have you been able to find so many missing cards and duplicates? I mean, also the ones with wrong typing in the name.
As I’ve being explaining in my most recent posts, I’ve been converting a csv of the 2012 Gatherer Oracle data into the manalink.csv format.
I now have a manalink.csv with the Full Name,Name,Color,Card Type,Rarity,Req Colorless,Req Black,Req Blue,Req Green,Req Red,Req White,Power,Toughness,Subtype,Subtype 2,Type Text,Rules Text, and Flavor Text entries of every card in the Gather Oracle.

I’d already compiled a ‘To_Be_Re-Added’ manalink.csv of all the card entries that have been added/removed to all the csv files produced since the ISO (some 4600+ cards), with the most recent entries over writing the earlier ones. This restores all the current and previously removed entries of any of the cards that have ever been coded, without having to manually add any of them again.
Using a customised ‘Lookup’ sheet on this file and the Manalink Oracle file I'd created, it was then possible to update all these previous card entries with the basic parameters and latest rules text from the Oracle.csv data.

With these combined files, I was then able to find the errors in your xls file.

When the all the separate files are finalized – I'll be able to create a manalink.csv file with the cards sorted in any slot order required; all the removed and current card coded entries restored with the latest rules text, plus add the basic manalink parameters and text of every card in the Oracle which has yet to be coded.
And all in under 30 seconds!!! - thanks to a small amount of lateral thinking and Mok’s ‘MakeNewCSV.exe’ (which he kindly modified for me).

So when we can finally establish a definitive list of the cards and their assigned slots, as agreed by Gargaroz (with the correct spellings and no duplicates). I can then post a complete csv, which will need little or no alteration to get the current and removed coded cards up and running again and has all the basic card parameters and text of all the other 7000+ cards already set up.

Anyway – I’m still having problems getting all this to work as there are still a few errors in that last csv you posted.

You missed adding ‘Goblin Vandal

'Face-down Creature' needs to be renamed 'Face-Down Creature'.

Raise Dead’ is duplicated in slots 198 and 11752.
As is 'Shidako, Broodmistress' in slots 7107 and 7145

All the ‘Full Name’ and ‘Name’ entries between slot 1748 and 12127 have an unnecessary space at the end of the entry. This was one reason I originally failed to spot the ‘Raise Dead’ duplicate. Not sure why the 'Shidako, Broodmistress' duplicate didn’t show up in the original xls file – but it did in the csv.

When I assume you used the ‘find and replace’ function in Excel to change the ‘Flip Card’ entries to ‘//’, it left out the space after the ‘//’, and also missed correcting the original typo error in ‘Order // Chaos’ – so now all the ‘flip cards’ are incorrectly named. The correct name format should be [word][space]//[space][word].

You renamed the correctly named ‘Indestructible Aura’ in slot 1571 to ‘Empty’, but forgot to correct the spelling of the duplicate (spelt wrong as ‘Indestructable Aura’) in slot 682 - the spelling should be ‘Indestructible Aura

You renamed the ‘Rain of Filth Effect’ and ‘Chancellor of the Annex Effect’ cards to ‘Legacy’. Neither are legacy abilities. Legacy abilities are those that remain in effect after the card with the ability has left the battlefield – and neither of these do.
Gargaroz original naming of the cards as an ‘Effect’ is correct.

You also changed the original posted names of the ‘Handicap Cards’. The original wording of ‘Handicap: 3 Cards’ is correct – ‘Handicap: Cards 3’ actually makes no grammatical sense.

Is there any reason the special effects cards were renamed with 'ZZ -' from the original '** ' or '* '?

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 08:05
by 0rion79
You missed adding ‘Goblin Vandal

'Face-down Creature' needs to be renamed 'Face-Down Creature'.

Raise Dead’ is duplicated in slots 198 and 11752.
As is 'Shidako, Broodmistress' in slots 7107 and 7145
Done

All the ‘Full Name’ and ‘Name’ entries between slot 1748 and 12127 have an unnecessary space at the end of the entry. This was one reason I originally failed to spot the ‘Raise Dead’ duplicate. Not sure why the 'Shidako, Broodmistress' duplicate didn’t show up in the original xls file – but it did in the csv.
This is depending from Gargaroz's original list: the error was whithin that, so when I copied those names in the cells, also the final space has been included. I did a job by removing many of them but it is something terrible that I can't do alone despite of who's "guilty": if any of you can't find an automatization for it, we have to split the job. In the attached notepad there are the cards that still end with a space. Now I understand why Excel could not find such duplicates!

When I assume you used the ‘find and replace’ function in Excel to change the ‘Flip Card’ entries to ‘//’, it left out the space after the ‘//’, and also missed correcting the original typo error in ‘Order // Chaos’ – so now all the ‘flip cards’ are incorrectly named. The correct name format should be [word][space]//[space][word].
Done

You renamed the correctly named ‘Indestructible Aura’ in slot 1571 to ‘Empty’, but forgot to correct the spelling of the duplicate (spelt wrong as ‘Indestructable Aura’) in slot 682 - the spelling should be ‘Indestructible Aura
Done

You renamed the ‘Rain of Filth Effect’ and ‘Chancellor of the Annex Effect’ cards to ‘Legacy’. Neither are legacy abilities. Legacy abilities are those that remain in effect after the card with the ability has left the battlefield – and neither of these do.
Gargaroz original naming of the cards as an ‘Effect’ is correct.
Done... about the Chancellor, it was cuter imho. Not a problem anyway.

You also changed the original posted names of the ‘Handicap Cards’. The original wording of ‘Handicap: 3 Cards’ is correct – ‘Handicap: Cards 3’ actually makes no grammatical sense.
It was just to quickly fill the slots with click & dragin Excel, I've forgot to re-change them later.

Is there any reason the special effects cards were renamed with 'ZZ -' from the original '** ' or '* '?
Asterisks and other non-letter values always had such "cards" (which are not even real cards in most cases) to appear at the very beginning of deck builder, even if their use is very limited if compared to other true cards. So it was an escamotage from my version, probably duplicated when I have added some values, to have them to appear always grouped together and always at the end of cards queue in the deck editor. It may be changed in any moment: now the goal is to have a working csv/dat file and game.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 10:09
by Aswan jaguar
You can count me in,if there is no way we can do it automatically and we have to erase the extra space manually.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 10:16
by 0rion79
Yes, thank you! The other solution is to create another list and then re-search for duplicates: maybe it is faster because I'm still keeping up to date the version in Excel format. Without spaces, it should be much easier to use the program's standard tools to locate them rather than searching them one by one. What do you think?

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 10:27
by Aswan jaguar
I am just a beginner when it comes to excel,and it sounds complicated to me whats need to be done.If you can guide me step by step maybe I can help.But maybe we should wait few hours in case smb can do it automatically.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 11:26
by foolosopher
Hi, after a quick look at the latest posted csv I found a few probably duplicate or mistaken entries. you can check the uploaded file.
duplicates-7c.txt
(1.59 KiB) Downloaded 88 times


Scanned only based on "Full Name" and "Name"
by highlighting duplicates and filtering by colour, using excel, I probably have missed similar entries.

Count me also to help, just tell me what other manipulation or duplicate criteria or such, we need to consider.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 11:41
by 0rion79
I'll take a look shortly: thanks all for your support, this is really good team working! Anyway, don't care too much about any duplicate that has Empty in the left coulmn, since it is the one used as main reference.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 15:11
by Gargaroz
Dunno if it's already reported, but the "Bear" token needs to be added.
Edit : Add the "Homunculs" token too.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 15:15
by Sonic
0rion79 wrote:
All the ‘Full Name’ and ‘Name’ entries between slot 1748 and 12127 have an unnecessary space at the end of the entry. This was one reason I originally failed to spot the ‘Raise Dead’ duplicate. Not sure why the 'Shidako, Broodmistress' duplicate didn’t show up in the original xls file – but it did in the csv.
This is depending from Gargaroz's original list: the error was whithin that, so when I copied those names in the cells, also the final space has been included. I did a job by removing many of them but it is something terrible that I can't do alone despite of who's "guilty": if any of you can't find an automatization for it, we have to split the job. In the attached notepad there are the cards that still end with a space. Now I understand why Excel could not find such duplicates!
Open the csv in Wordpad (Not Notepad!)

Select 'Replace With:' from the menu.

Type ' ;' into 'Find What:'

Type ';' into 'Replace'

Hit 'Replace All'

... All spaces gone.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 15:17
by 0rion79
And what about the space WITHIN words? In this way, Serra Angel should become SerraAngel and we would have to start over! Or not?

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 15:33
by Sonic
0rion79 wrote:And what about the space WITHIN words? In this way, Serra Angel should become SerraAngel and we would have to start over! Or not?
Why? You've told the 'find and replace' function to search for a text string with a 'space followed by a semicolon'. And replace it just with Semi-colon? It won't replace any spaces without a Semi-colon following it

And if you think about it, there shouldn't be a space 'Before' a Semi-colon in the text entries anyway.

Re: The "2000 limit no more" CSV

PostPosted: 19 Dec 2011, 15:46
by 0rion79
Ok, Sonic: I trust you on word, without the need of testing the process by myself. Since you can do that, please do that using the list in notepad stored in my latest release on this same thread. Thank you!