Archives of official NC site CoH stuff?

[TimtheEnchanter]

I first heard there was one a while ago.

#1, I don't know where it is.
#2, Is it still being updated?

Edit: Also, the comics and the videos as mentioned here. http://boards.cityofheroes.com/showthread.php?t=298727

Anyone think there's a chance we can get all of this into one place for download as a torrent or something?

[Frostyfrozen]

Parts I'm sure when the smoke clears and dust settles we will know who has what and can share I'm sure.

[Victoria Victrix]

I first heard there was one a while ago.

#1, I don't know where it is.
#2, Is it still being updated?

There's a site which specializes in saving things like this, and when the site owner heard about the shutdown, he added the Official Forums.  I thanked him, so I can look it up in my email later for you.

[The Fifth Horseman]

http://www.cohtitan.com/forum/index.php/topic,5736.0.html

[Mr. Wentworth]

Do we have confirmation on their intent to do another backup in the next 48 hours to save new content on the boards since Oct 15th? I'm glad they made an archive early. It would be nice to save the rest, too.

[The Fifth Horseman]

If you feel it's important to keep it all for posterity, HTTrack is feely available for use: http://www.httrack.com/

[Mr. Wentworth]

I've been using HTTrack for years, but I'm still in favor of an organization like Archive.org making a publicly available archive. It was mentioned that they would do a secondary archive close to shutdown and I was just curious to know if there was any more word on that happening.

[TimtheEnchanter]

If you feel it's important to keep it all for posterity, HTTrack is feely available for use: http://www.httrack.com/

Wait, wait... this does it all? No need to navigate the threads and hit "save" every time? It just goes through the whole shebang and makes a replica?

Also added this to the first post.

Also, the comics and the videos as mentioned here. http://boards.cityofheroes.com/showthread.php?t=298727

Anyone think there's a chance we can get all of this into one place for download as a torrent or something?

[Mr. Wentworth]

Check this thread, Tim. It has links to the downloadable files on archive.org
http://www.cohtitan.com/forum/index.php/topic,5736.0.html

[TimtheEnchanter]

Oh, nice. I never knew archive.org offered up download packages like that.

[The Fifth Horseman]

Wait, wait... this does it all? No need to navigate the threads and hit "save" every time? It just goes through the whole shebang and makes a replica?

Pretty much so, as long as you set it up correctly at the start:
* ignore robots.txt.
* retrieve even non-HTML files associated with links
* whitelist all media file extensions in project options.
You may need to lift some of the caps (simultaneous connections and bandwidth in particular) to get it to run at a decent speed.

[The Fifth Horseman]

If you have something capable of batch download, use this URL pattern:

http://boards.cityofheroes.com/printthread.php?t=<thread_num>&pp=500&page=<page_num>
This will grab threads from the archive - lighter on layout, more posts displayed per page. Thread numbers go up to around 298900 at this time, and you'll need to download one page for every 500 posts in the thread, rounding up.

[Sekoia]

I have WinHTTrack download this site: http://boards.cityofheroes.com/archive/index.php

It has all the content of the forums, but strips out imaging and formatting. It may even be more lightweight than the printable links that Fifth Horseman references. Compare:

http://boards.cityofheroes.com/printthread.php?t=295812&pp=500
http://boards.cityofheroes.com/archive/index.php/t-295812.html

The last time I downloaded, the archive version was about 3 GB spread across 150,000 files. Since there are so many small files, it makes it harder to reach a high throughput. So if you want to make a capture, I recommend starting now before it's too late!

[The Fifth Horseman]

Will not be lightweight in regards to transfer. All the files still have to be downloaded to your PC.

Here's a slightly different attempt I've put together just now:
Executable: http://www.mirrorcreator.com/files/EGHJXLW7/COHSaver_executable_1.zip_links
Source: http://www.mirrorcreator.com/files/TN3SWUMR/COHSaver_1.rar_links

* Running it with no arguments will attempt a brute force download of every thread in the archive from 1 to 300000. Threads that do not exist will not be saved.
* Running it with one integer as an argument will download the thread with given id.
* Running it with two integers as arguments will download and store threads with ids starting with the first and ending with the second argument.

Threads 294000 and up are saved. :)

Above: my archives go up to thread #298918, half an hour ago.
Grabbing individual posts now.

http://www.mirrorcreator.com/files/04YSCUGQ/Postsaver.zip_links

This one works for saving individual posts. You input post id instead of thread ID.

[The Fifth Horseman]

This is what I managed to salvage before the time ran out.
http://www.mirrorcreator.com/files/V0L8Q99H/thread_204518.rar_links
http://www.mirrorcreator.com/files/U7NIGLXR/thread_120580.rar_links
http://www.mirrorcreator.com/files/1IXAVW4J/posts_4400000_-_4411108.rar_links
http://www.mirrorcreator.com/files/1LLACNC8/Threads_294000_-_298918_(_20_21_hrs_PST_).rar_links