It is currently 14 Oct 2019, 20:37
   
Text Size

Pictures for Magic Album

Moderators: charmer, CCGHQ Admins

Pictures for Magic Album

Postby Goblin Hero » 03 Nov 2009, 11:23

Pictures in Magic Album are stored in special directory structure incompatible with MWS. You can build this structure yourself, but the most easiest way to get all the pictures - download the torrent. This torrent is a snapshot of MA pictures I use myself. After downloading go to MA preferences and set up the picture folder. Torrent will be regularly updated. You do not have to redownload the whole torrent each time it is updated. Just download new torrent file and run the rehash process. This way only new and changed files will be downloaded.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby FrontLineFodder » 03 Nov 2009, 12:08

I do like the idea of p2p (torrent) sharing of files. great for sharing bandwidth.

for this however it would work best if the torrent contained the file structure uncompressed as files required by MA.

this way even if you post an updated torrent each client could get away with only downloading the different files / blocks.

As long at the file naming / structure did not change i would be for this.
FrontLineFodder
 
Posts: 14
Joined: 07 Jun 2009, 13:20
Location: Western Australia
Has thanked: 0 time
Been thanked: 0 time

Re: Torrent with all the pictures

Postby Goblin Hero » 03 Nov 2009, 12:15

FrontLineFodder wrote:it would work best if the torrent contained the file structure uncompressed
Unfortunately it is impossible. Torrent file can't include 20K+ files :(
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby Strainer » 06 Nov 2009, 21:38

I think the best solution would be to upload them on a set-per-set basis on a filehoster like mediafire or rapidshare.
Strainer
 
Posts: 63
Joined: 02 Oct 2009, 09:28
Has thanked: 13 times
Been thanked: 12 times

Re: Torrent with all the pictures

Postby goldaar » 18 Dec 2009, 04:29

I think the set-by-set method is simply autrocious. The first time "catch up" downloading takes forever and the bandwidth is not good with those hosted solutions.

Goblin, why not just rar (or some other container) up your images directory for an initial installation, and then everytime you add another directory toss it up as a seperate, much smaller update? People wont have a problem creating an additional directory every 3 months, but people without extensive SED experience have a TON of trouble renaming the files themselves.

I would personally leave this torrented for a long time, it's so inconvenient to have to rename all the files myself that I still haven't done more than 4 sets (and that's with batch renaming, it's just too inconsistent to do it en mass).
goldaar
 
Posts: 13
Joined: 18 Dec 2009, 04:19
Has thanked: 0 time
Been thanked: 0 time

Re: Torrent with all the pictures

Postby Goblin Hero » 21 Dec 2009, 13:45

Ok, I'll create one big torrent with all the pictures just for testing purpose.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby goldaar » 03 Jan 2010, 07:29

Happy new year!

You are a gentleman and a scholar (or the goblin equiv.), don't let anyone tell you otherwise.
goldaar
 
Posts: 13
Joined: 18 Dec 2009, 04:19
Has thanked: 0 time
Been thanked: 0 time

Re: Torrent with all the pictures

Postby Goblin Hero » 06 Jan 2010, 20:49

Look at the site menu. There's a new sumbenu called "Torrents" there. Try it ;)
Torrent integration is in beta now, so pls report whether it works or not.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby Huggybaby » 07 Jan 2010, 00:47

Here are my observations and comments, take them with a grain of salt.

1. Your tracker isn't working, I get this error:
Failure: Unregistered torrent pass

2. It's a private torrent which is a bad idea. You've disabled DHT, Peer Exchange and Local Peer Discovery which means your torrent will die when your tracker goes down for any reason.

3. You don't need your own tracker, but if you insist consider adding public trackers as well like
Code: Select all
http://tracker.publicbt.com/announce
http://tracker.openbittorrent.com/announce
http://denis.stalker.h3q.com:6969/announce
4. The piece size is large. 1028 x 4 MB. I aim for 5,000-10,000 pieces, so your piece size could be 256 kB.

5. Using one big rar file should be thought about carefully, it really handicaps your users. I'd zip each set individually, and use torrentzip. This gives you more update options and allows users to pick which sets they're interested in so they can get started before having to download the entire thing.

Anyway, it's good to see you moving forward with this!
User avatar
Huggybaby
Administrator
 
Posts: 3087
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 585 times
Been thanked: 574 times

Re: Torrent with all the pictures

Postby Goblin Hero » 07 Jan 2010, 11:35

Huggybaby wrote:Here are my observations and comments, take them with a grain of salt.
1. It concern me most. Should work. Could you try again?
2. I know it's a bad idea and will fix it (3d party plugin)
4. Does it matter?
5. Yea, not the best idea, but multiples of ZIPs is not a good idea too. MA has more complex directory structure.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby Huggybaby » 07 Jan 2010, 12:22

1.The tracker is working now.

2. It's still a private torrent which is a bad idea.

4. A large piece size doesn't matter if you only have one file.

5. The mame roms torrent has 8,000+ files, this is not a problem, any torrent client can handle it fine.

The HQ Pics torrent would choke without zips, but your torrent doesn't have crops does it? So it might be possible to have a torrent with no zips at all, it would be interesting to see. How many cards are in your set?

<edit> Max download speed is about 90 kB/s, you must be throttling.
<edit> Make it 50 kB/s. Also I guess you have about 17-18,000 pics, I'll test that out.
<edit> An 18,000 pic torrent would work.
User avatar
Huggybaby
Administrator
 
Posts: 3087
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 585 times
Been thanked: 574 times

Re: Torrent with all the pictures

Postby Goblin Hero » 07 Jan 2010, 12:50

Huggybaby wrote:Max download speed is about 90 kB/s, you must be throttling.
No, I have max speed ~125kB/s and limit upload speed to 100.
Huggybaby wrote: Also I guess you have about 17-18,000 pics, I'll test that out.
24K pics to be sure. And yes, it works :oops: I remember problems creating torrent with lot of files. Ok, I'll recreate torrent with unpacked pictures and try to patch frontend to enable dht.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby Huggybaby » 07 Jan 2010, 12:58

I'm using 64 bit Windows, 24,000 files will put a strain on some older systems I think! :o
User avatar
Huggybaby
Administrator
 
Posts: 3087
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 585 times
Been thanked: 574 times

Re: Torrent with all the pictures

Postby Goblin Hero » 07 Jan 2010, 14:03

Huggybaby wrote:I'm using 64 bit Windows, 24,000 files will put a strain on some older systems I think! :o
Or, yes. Tracker can't handle such like torrent :( Out of memory error. So it's not a solution.
When you´re a goblin, you don´t have to step forward to be a hero -- everyone else just has to step back.
User avatar
Goblin Hero
Site Admin
Site Admin
 
Posts: 1939
Joined: 23 Oct 2005, 09:37
Location: Russia
Has thanked: 145 times
Been thanked: 317 times

Re: Torrent with all the pictures

Postby Huggybaby » 07 Jan 2010, 14:10

OK. Did you figure out DHT? I guess you're not using uTorrent, etc.
User avatar
Huggybaby
Administrator
 
Posts: 3087
Joined: 15 Jan 2006, 19:44
Location: Finally out of Atlanta
Has thanked: 585 times
Been thanked: 574 times

Next

Return to Magic Album

Who is online

Users browsing this forum: No registered users and 2 guests


Who is online

In total there are 2 users online :: 0 registered, 0 hidden and 2 guests (based on users active over the past 10 minutes)
Most users ever online was 287 on 31 Mar 2019, 04:11

Users browsing this forum: No registered users and 2 guests

Login Form