I first heard there was one a while ago.
#1, I don't know where it is.
#2, Is it still being updated?
Edit: Also, the comics and the videos as mentioned here. http://boards.cityofheroes.com/showthread.php?t=298727
Anyone think there's a chance we can get all of this into one place for download as a torrent or something?
Parts I'm sure when the smoke clears and dust settles we will know who has what and can share I'm sure.
Quote from: TimtheEnchanter on November 29, 2012, 08:26:59 AM
I first heard there was one a while ago.
#1, I don't know where it is.
#2, Is it still being updated?
There's a site which specializes in saving things like this, and when the site owner heard about the shutdown, he added the Official Forums. I thanked him, so I can look it up in my email later for you.
http://www.cohtitan.com/forum/index.php/topic,5736.0.html
Do we have confirmation on their intent to do another backup in the next 48 hours to save new content on the boards since Oct 15th? I'm glad they made an archive early. It would be nice to save the rest, too.
If you feel it's important to keep it all for posterity, HTTrack is feely available for use: http://www.httrack.com/
I've been using HTTrack for years, but I'm still in favor of an organization like Archive.org making a publicly available archive. It was mentioned that they would do a secondary archive close to shutdown and I was just curious to know if there was any more word on that happening.
Quote from: The Fifth Horseman on November 29, 2012, 04:56:26 PM
If you feel it's important to keep it all for posterity, HTTrack is feely available for use: http://www.httrack.com/
Wait, wait... this does it all? No need to navigate the threads and hit "save" every time? It just goes through the whole shebang and makes a replica?
Also added this to the first post.
Also, the comics and the videos as mentioned here. http://boards.cityofheroes.com/showthread.php?t=298727
Anyone think there's a chance we can get all of this into one place for download as a torrent or something?
Check this thread, Tim. It has links to the downloadable files on archive.org
http://www.cohtitan.com/forum/index.php/topic,5736.0.html
Oh, nice. I never knew archive.org offered up download packages like that.
Quote from: TimtheEnchanter on November 29, 2012, 09:47:34 PMWait, wait... this does it all? No need to navigate the threads and hit "save" every time? It just goes through the whole shebang and makes a replica?
Pretty much so, as long as you set it up correctly at the start:
* ignore robots.txt.
* retrieve even non-HTML files associated with links
* whitelist all media file extensions in project options.
You may need to lift some of the caps (simultaneous connections and bandwidth in particular) to get it to run at a decent speed.
If you have something capable of batch download, use this URL pattern:
http://boards.cityofheroes.com/printthread.php?t=<thread_num>&pp=500&page=<page_num>
This will grab threads from the archive - lighter on layout, more posts displayed per page. Thread numbers go up to around 298900 at this time, and you'll need to download one page for every 500 posts in the thread, rounding up.
I have WinHTTrack download this site: http://boards.cityofheroes.com/archive/index.php
It has all the content of the forums, but strips out imaging and formatting. It may even be more lightweight than the printable links that Fifth Horseman references. Compare:
http://boards.cityofheroes.com/printthread.php?t=295812&pp=500
http://boards.cityofheroes.com/archive/index.php/t-295812.html
The last time I downloaded, the archive version was about 3 GB spread across 150,000 files. Since there are so many small files, it makes it harder to reach a high throughput. So if you want to make a capture, I recommend starting now before it's too late!
Will not be lightweight in regards to transfer. All the files still have to be downloaded to your PC.
Here's a slightly different attempt I've put together just now:
Executable: http://www.mirrorcreator.com/files/EGHJXLW7/COHSaver_executable_1.zip_links
Source: http://www.mirrorcreator.com/files/TN3SWUMR/COHSaver_1.rar_links
* Running it with no arguments will attempt a brute force download of every thread in the archive from 1 to 300000. Threads that do not exist will not be saved.
* Running it with one integer as an argument will download the thread with given id.
* Running it with two integers as arguments will download and store threads with ids starting with the first and ending with the second argument.
Threads 294000 and up are saved. :)
Above: my archives go up to thread #298918, half an hour ago.
Grabbing individual posts now.
http://www.mirrorcreator.com/files/04YSCUGQ/Postsaver.zip_links
This one works for saving individual posts. You input post id instead of thread ID.
This is what I managed to salvage before the time ran out.
http://www.mirrorcreator.com/files/V0L8Q99H/thread_204518.rar_links
http://www.mirrorcreator.com/files/U7NIGLXR/thread_120580.rar_links
http://www.mirrorcreator.com/files/1IXAVW4J/posts_4400000_-_4411108.rar_links
http://www.mirrorcreator.com/files/1LLACNC8/Threads_294000_-_298918_(_20_21_hrs_PST_).rar_links