Titan Network

Community => Multimedia => Demo Recording => Topic started by: Leandro on December 12, 2012, 02:39:42 PM

Title: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 12, 2012, 02:39:42 PM
Torrent ALL THE MOVS! (http://www.leandro.cox-supergroups.com/movs.torrent)


Well, all the MOVs that are usable with the player skeleton, anyway. I haven't gotten around to dog emotes yet.

I wrote a script that goes through the whole list of MOVs, creates a demo of Fusionette doing that MOV, runs the demo through the COH client while dumping all the frames, then takes those frames and makes an animated GIF out of it, before moving on to the next emote.

The script will finally be done in a little over two hours, after spitting about 8500 animated GIFs, which use about 14GB of disk space. Now the question is, how the hell do I distribute this.

The original plan was to put those in the Wiki, but asking for 14GB of server space to store animations that only a handful of people are going to use seems too greedy. And besides, this works best when you can have the folder in your own computer, because then you can just search for something and have all the emotes that match instantly come up.

So, I'm thinking I should torrent this thing. I'm looking for a few volunteers to seed it, because my connection is very craptastic. If any of you has a seedbox and would like to waste 14GB in Fusionette animated GIFs, please say something! I'd really like to get these things out for others to use.

(https://i.imgur.com/D5dLr.png)
Title: Re: GIF previews for ALL THE MOVS!
Post by: corvus1970 on December 12, 2012, 02:55:40 PM
First off, that's awesome.

Secondly, BitTorrenting the file would be a great idea.

Third, while I don't have  dedicated seed-box, I'd be willing to help seed it so long as a few others would pitch in as well.

You're hits, Leandro, they just keep on coming! :D
Title: Re: GIF previews for ALL THE MOVS!
Post by: The Fifth Horseman on December 12, 2012, 03:24:07 PM
Perhaps the size could be reduced by cropping the images and/or reducing the framerate slightly (assuming it's not below 25 FPS already)? Cutting down on color depth would also help with that.
Title: Re: GIF previews for ALL THE MOVS!
Post by: Codewalker on December 12, 2012, 03:58:02 PM
Or maybe encoding to mp4. GIF dithering can inflate the filesize by a large amount. If they're not on a website there's less of a reason for GIF to be a convenient format.
Title: Re: GIF previews for ALL THE MOVS!
Post by: Leandro on December 12, 2012, 04:44:35 PM
Perhaps the size could be reduced by cropping the images and/or reducing the framerate slightly (assuming it's not below 25 FPS already)? Cutting down on color depth would also help with that.

They're only 10FPS, because they were intended to be put on the web.

Or maybe encoding to mp4. GIF dithering can inflate the filesize by a large amount. If they're not on a website there's less of a reason for GIF to be a convenient format.

You're absolutely right. I did the whole thing thinking they would be put on the wiki, but if I'm just going to torrent the whole thing, it'd be better to MP4 the crap out of it.

I've been using Imagemagick to take the list of TGA files and make the animated GIFs... what would be the equivalent tool to make MP4 files? I think FFmpeg would do it... I'll have to check.

Of course, this means re-rendering all the images, so another week or so until it's done :P
Title: Re: GIF previews for ALL THE MOVS!
Post by: Samuraiko on December 12, 2012, 05:48:44 PM
*sweeps Leandro into her arms and kisses him passionately*

You are my god.

Michelle
aka
Samuraiko/Dark_Respite
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 12, 2012, 07:23:31 PM
Alright, so I started dumping all the emotes again, this time as 720x720 @30fps MP4s. It's going to take about a week to dump everything (since I only run the script while I'm away from the computer), so pause this thread until then. I'll post back once all the files are ready.

(https://i.imgur.com/5yXfP.jpg)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Megajoule on December 12, 2012, 07:49:29 PM
How big are the individual files coming out now, and how does that compare to the GIFs?

p.s. you are awesome.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Arachnion on December 12, 2012, 07:52:18 PM
Thanks for the tremendous amount of effort you put into this, Leandro.

You rock!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 12, 2012, 08:37:43 PM
How big are the individual files coming out now, and how does that compare to the GIFs?

The first 250 emotes already rendered, and are using 259MB of space. So a little over a meg each. But the quality is SO MUCH BETTER. The GIFs were tiny and at 10fps. These MP4s look awesome. You can only see the compression when an emote is very FX heavy (like Murder of Crows costume change) but as a reference it's more than enough.

The final DB with all the animations should be 8.6GB once it's done.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 12, 2012, 08:48:34 PM
That's going to be awesome!

Thanks Leandro!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: wei yau on December 12, 2012, 08:56:34 PM
This community astounds me time and time again.

I don't have the words, my emotional state right now is a complete turnaround from where it was on Dec 1st.

Thank you, thank you, thank you.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: TimtheEnchanter on December 12, 2012, 11:47:06 PM
Once again, it is clear that Leandro has all the movs.  8)

*thumbs up*
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Valtyr on December 12, 2012, 11:54:04 PM
Once again, it is clear that Leandro has all the movs.  8)

*thumbs up*

You could say *puts on glasses* Leandro has all the movs.

YEAAAH! (http://mirrors.rit.edu/instantCSI/)

(warning: loud)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 13, 2012, 06:54:34 AM
Wow this is an ambitious undertaking and damn fine work as always Leo! I was going to ask about the MOV commands too but I see that you names the GIFs with the command for each. You certainly are a demo god my friend!

I can seed to help with this as well but don't have (or even know what it is...) a seedbox
Title: Re: MP4 previews for ALL THE MOVS!
Post by: The Fifth Horseman on December 13, 2012, 11:13:20 AM
Quote
I can seed to help with this as well but don't have (or even know what it is...) a seedbox
In bittorrent lingo, it's a server (either dedicated or shared) used primarily to download and upload data from the bittorrent network.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 13, 2012, 11:38:57 AM
Anyone who is willing to seed this thing, please send me an email to leandrotlz@gmail.com so I can start giving you access to the files. I already re-dumped over 2000 emotes, so might as well start giving the files to those who can seed them.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: therain93 on December 13, 2012, 07:01:34 PM
Anyone who is willing to seed this thing, please send me an email to leandrotlz@gmail.com so I can start giving you access to the files. I already re-dumped over 2000 emotes, so might as well start giving the files to those who can seed them.
Amazing work, Leandro -- I'll see what I can do this evening (probably much later) about setting up a box to help seeding. 

If I am the first to get it, I will likely add an html launch page (it should be relatively easy to script something with g/awk to dump the directory contents and write out an html page).  If someone beats me to it, that likely would be a nice little addition.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 17, 2012, 09:32:14 AM
Torrent of ALL THE MOVS! now available for those who want to download it this way:

http://www.leandro.cox-supergroups.com/movs.torrent

I'm the only seed for now, so prepare for slowness until others join in. It's 8.75GB.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 17, 2012, 11:03:51 AM
I'll be seeding once I know I have all the files Leandro.

Hopefully that helps it go faster..
Title: Re: MP4 previews for ALL THE MOVS!
Post by: corvus1970 on December 17, 2012, 03:39:59 PM
Same here!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Samuraiko on December 17, 2012, 04:17:18 PM
*sheepishly raises hand*

For those of us who've never used Torrent... what do we do?

Michelle
aka
Samuraiko/Dark_Respite
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 17, 2012, 05:01:48 PM
*sheepishly raises hand*

For those of us who've never used Torrent... what do we do?

1) Download a .torrent client. I like Tixati (http://www.tixati.com/download/).

2) If you have SOME of the files that you got from my Dropbox before others(*) deleted it, create a folder called "All the MOVs!" (exact case) somewhere, and put all the MP4s you have in there.

3) Either download the .torrent file I linked, or click this Magnet link (http://magnet:?xt=urn:btih:pq33h5drd3d7ywalcfar7vtcvp2lmctt&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80%2Fannounce) to add the .torrent to your client. The .torrent file should be faster to start and has more trackers, but if .torrent files confuse you, just click the Magnet link and it'll work.

4a) When the .torrent client asks where to save the files, point it to the folder ABOVE the one where your "All the MOVs!" folder is. If you created the folder under Videos, point the torrent client to Videos, it will find the "All the MOVs!" folder and continue from there.

4b) If you didn't have any files from my Dropbox, just tell the .torrent client to save wherever you want. It'll start from zero.

4c) If you HAVE some files, but you told the torrent client to save them somewhere ELSE, click the "Stop" button to pause the torrent, copy all your MP4 files in the place where the client is downloading them, and then right-click the .torrent, select Local Files, then Force Re-Check. This will make the torrent client "see" that you put some of the files in there.

5) Once you're done donwloading it, you can leave the torrent going for a while and it will be "Seeding", that is, giving the files to others so they can download it as well.

(*) If, once you were done downloading files from my Dropbox, you MOVED them away, you automatically deleted them for everybody else who was trying to download them from my Dropbox. Three people who shall remain nameless did that, and that's why, if you were on my Dropbox, I can't guarantee you have all the files, even though I put all of them in it.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Torroes.Prime on December 17, 2012, 05:51:30 PM
(*) If, once you were done downloading files from my Dropbox, you MOVED them away, you automatically deleted them for everybody else who was trying to download them from my Dropbox. Three people who shall remain nameless did that, and that's why, if you were on my Dropbox, I can't guarantee you have all the files, even though I put all of them in it.

I will take responsibility for my particular eff-up. I hit "move" when I intended to hit "copy". I also "copied" the files right back as soon as I realized it. To make amends I'm pulling one of my extra computers out, getting her on line, loading Tixati, downloading the torrent and seeding it. That computer will be online 24/7 for the foreseeable future and I've got a fair good internet connection so the download should be good for anyone downloading from me. I generally get a 42mps upload and a 38mps download.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 17, 2012, 05:53:34 PM
right now I am downloading it with microtorrent and at the rate it's downloading, it will take me another 2 weeks and 4 days to complete... LOL

Globetrotter
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 17, 2012, 07:15:29 PM
right now I am downloading it with microtorrent and at the rate it's downloading, it will take me another 2 weeks and 4 days to complete... LOL

Hang in there. It should get better as more people join.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: corvus1970 on December 17, 2012, 08:06:51 PM
Yup, the speed is already improving.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 17, 2012, 08:46:34 PM
Back to 0.0 kb/s :-(
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Samuraiko on December 17, 2012, 08:50:42 PM
Errr... not sure if I was one of the three - but if I was, I apologize for being a moron.

Downloaded the torrent client, moved over the ones I already had, forced the re-check, and am now at 40% downloaded.

Six hours and counting to go on mine, as of 5pm PST.

Michelle
aka
Samuraiko/Dark_Respite
Title: Re: MP4 previews for ALL THE MOVS!
Post by: corvus1970 on December 17, 2012, 08:53:14 PM
Heh, you and I both Samuraiko.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 17, 2012, 09:32:08 PM
Untill things are fixed I will be cleaning my torrent folder so i can fully dedicate it to this.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: therain93 on December 17, 2012, 09:34:49 PM
I'll be one of the other seeders, but I haven't started yet, so expect that in about 2-3 hours ( ' :
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 17, 2012, 09:53:03 PM
Back to 0.0 kb/s :-(

Yeah, I had a power failure so as the only seeder, everything died. I'm back online now.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Torroes.Prime on December 17, 2012, 10:04:46 PM
downloaded everything Leandro put up on Dropbox, merged that with the torrent download, rechecked it and am now downloading the other files. Presently looking at about 14 hours before the torrent is complete.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ladycat924 on December 17, 2012, 10:20:22 PM
Downloaded/installed Tixati. Initialization complete, 5% downloaded, Time remaining: 34 hours.

The options tab under the seeding button is set to "Constant seeding", Standby-que if no seeding slots are available (which was the default). I do not know anything about torrent or seeding, does this help or does this setting need changed in some way?

Thanks for all the work on this, it is much appreciated. I would like to help in return if you just let me know what I need to do.
Cat
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 17, 2012, 10:23:28 PM
The options tab under the seeding button is set to "Constant seeding", Standby-que if no seeding slots are available (which was the default). I do not know anything about torrent or seeding, does this help or does this setting need changed in some way?

While you're downloading, you're always seeding, so don't worry about it.

Once the torrent is complete, if you are not going to be downloading anything else, it'll seed automatically. Seeing how you've not used torrents before, that's probably what you'll do.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ladycat924 on December 17, 2012, 10:33:03 PM
WOW. That was a quick answer. Thanks.

My computer is almost always on (including overnight) so hopefully that will help in the distribution in some way. If there is anything you know of that I can tweak in the program to facilitate, I am all ears....  O_O
Title: Re: MP4 previews for ALL THE MOVS!
Post by: therain93 on December 17, 2012, 11:34:04 PM
After a false-start due to silliness on my part, currently seeding 100%.  Presently 9 are connected and downloading.
This machine will likely be on for several days, so download awaaaaaaaaaay ( ' :
 
 
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 17, 2012, 11:41:02 PM
Title: Re: MP4 previews for ALL THE MOVS!
Post by: saipaman on December 18, 2012, 12:49:05 AM
I've started downloading.  I see 2 seeds and 14 peers.

Since we've moved into Netflix viewing time, speed is extremely slow.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThePhlebotomist on December 18, 2012, 01:38:11 AM
This is awesome!

Leandro, would you feel okay sharing your script, too?  I'd love to see how you manipulate the CoH client via a script to run the demos.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ladycat924 on December 18, 2012, 01:39:21 AM
Time seems to keep bouncing up and down. Currently reporting 65% downloaded, two and a half hours remaining. (That 34 hours sure dropped while I was gone to dinner!)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 18, 2012, 02:06:12 AM
Leandro, would you feel okay sharing your script, too?  I'd love to see how you manipulate the CoH client via a script to run the demos.

There's really nothing to it. I go through a list of all the MOVs (that Codewalker dumped in the Wiki) and write a demo file with that MOV, then I just call

D:\\CohBeta\\cityofheroes.exe -demoplay mov_list -demofps 30 -demodumptga -fullscreen 0 -screen 720 720

to dump the demo's contents to a folder of TGA files, and then

ffmpeg -f image2 -r 30 -i "D:\\CohBeta\\client_demos\\screens\\mov_list\\movie_%05d.tga" -vcodec mpeg4 -b:v 800k -r 30 "D:\\All the Dog MOVs!\\$mov.mp4"

using the standard ffmpeg static .exe to turn some TGAs into an MP4. There's absolutely no special scripting here, just go through the list, write demo, dump, convert, repeat.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Torroes.Prime on December 18, 2012, 03:54:29 AM
got the full torrent downloaded here. copying it over my server now and will begin seeding as soon as it's done. Also looking to see if I can get any systems on other internet providers to host the file as well. Speed should be going up a little bit now.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: corvus1970 on December 18, 2012, 04:33:58 AM
Ive almost finished downloading it, and I'll be sure to stream it overnight.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ladycat924 on December 18, 2012, 05:25:18 AM
Download complete. My system will be up overnight as well, as far as I can tell there is currently outbound data.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 18, 2012, 05:26:20 AM
I'll be seeding all night tonight as well.

Hope it helps!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Samuraiko on December 18, 2012, 06:16:04 AM
Done and seeding all night.

Michelle
aka
Samuraiko/Dark_Respite
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Nitra on December 18, 2012, 06:37:12 AM
I am loving how this community has NOT given up... this is what made coh the game it was and ncsoft can never close that down!!! GREAT job guys!!!!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 18, 2012, 08:33:43 AM
I have uploaded about 2.5 GB's so far. Gonna keep seeding throughout the overnight until I get off work here.

Though it's odd, this is what I am seeing but it still says I am seeding...

(https://i7.photobucket.com/albums/y253/Thors/Clipboard01-2_zps588fa6ca.jpg)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: The Fifth Horseman on December 18, 2012, 12:06:29 PM
Remember that the reported down/up speeds include protocol overhead.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 18, 2012, 12:22:13 PM
Protocol overhead....well...went over my head. Whats that mean?
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 18, 2012, 02:59:48 PM
I am loving how this community has NOT given up... this is what made coh the game it was and ncsoft can never close that down!!! GREAT job guys!!!!

We have absolutely no reason to give up, and every reason to believe we'll have COH back eventually. We owe it to all the rednames to make sure that all their hard work doesn't go away.  They built us a world, now it's our turn to keep it spinning.

Protocol overhead....well...went over my head. Whats that mean?

it means that, even though you're not downloading anything, other clients are still pinging your computer and saying "Hey, I got these pieces of the torrent, do you need anything? No? Cool. Hey, what pieces do you have?". That chatter uses a little bit of traffic, and that's what you're seeing as your download speed.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 18, 2012, 03:07:32 PM
it means that, even though you're not downloading anything, other clients are still pinging your computer and saying "Hey, I got these pieces of the torrent, do you need anything? No? Cool. Hey, what pieces do you have?". That chatter uses a little bit of traffic, and that's what you're seeing as your download speed.

Ah gotcha, I stopped seeding just a few minutes ago as I didn't see anyone downloading (0 and 0) but it looks like I uploaded around 10GB's overnight. :)

As always, thanks for the info Leo!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 18, 2012, 04:19:52 PM
Ah gotcha, I stopped seeding just a few minutes ago as I didn't see anyone downloading (0 and 0) but it looks like I uploaded around 10GB's overnight. :)

Very awesome. The tracker says 12 people have the full thing now, so it's pretty dang well seeded for anyone who shows up. As long as not everybody leaves. But I figured this particular project was only going to be of interest to a couple dozen people, so I'm pretty happy with the result.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 18, 2012, 04:26:09 PM
I will seed again tonight when I start work. Great to hear it is 'working as intended' :)

If there is a certain time that people need seeds, let me know and I'll see what I can do. I usually power my computers down when not home but I can make an exception if it's needed.

Thanks again for all the hard work Leandro! Looking forward to what ya have up your sleeve next brother!
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Globetrotter on December 18, 2012, 04:54:12 PM
I will be seeding it when I am on line. Last night I left the computer powered, but it's better not to do that every day.

Watched a great deal of teh MOVs. They will be a big help in demo-editing. thanks again Leandro.

And now, I need to find myself a project to work on, or I am getting nuts.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Aggelakis on December 19, 2012, 03:50:03 AM
My computer is on all the time and I now have the entire thing. I'll be seeding unless my internet goes down, in which case I will be back seeding once I notice it and start the program back up! ;)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: ThorsAssassin on December 19, 2012, 05:28:41 AM
My computer is on all the time and I now have the entire thing. I'll be seeding unless my internet goes down, in which case I will be back seeding once I notice it and start the program back up! ;)

Show off, I am back on and seeding again :)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: mikoroshi on December 19, 2012, 08:52:41 AM
Tagging for later download.  Thanks Leandro.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: mikoroshi on December 19, 2012, 08:53:23 AM
(I think a random, currently unnamed tech guy in my novel is going to be named Leandro.  And unlike most of the characters, he gets to live!)
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Leandro on December 20, 2012, 06:21:36 PM
(I think a random, currently unnamed tech guy in my novel is going to be named Leandro.  And unlike most of the characters, he gets to live!)

Be wary of that character, anyone called Leandro is bound to be at least a little insane.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Michiyo on December 26, 2012, 05:15:33 AM
Loading it up on my Seed Box with CoH Windows/CoH Mac Client.  Maybe my provider won't kill me :/ :D
Title: Re: MP4 previews for ALL THE MOVS!
Post by: Ice Trix on February 13, 2013, 08:17:31 AM
Torrent of ALL THE MOVS! now available for those who want to download it this way:

http://www.leandro.cox-supergroups.com/movs.torrent

I'm the only seed for now, so prepare for slowness until others join in. It's 8.75GB.
Thanks for making it, I'll keeping it seeding too.

Quote
*) If, once you were done downloading files from my Dropbox, you MOVED them away, you automatically deleted them for everybody else who was trying to download them from my Dropbox. Three people who shall remain nameless did that, and that's why, if you were on my Dropbox, I can't guarantee you have all the files, even though I put all of them in it.
I hope you knew about Dropboxs excellent undelete function.
Title: Re: MP4 previews for ALL THE MOVS!
Post by: saipaman on December 25, 2016, 02:33:02 AM
If anyone still has the movs.torrent file, can you send it to me or put it someplace I can get it?

I have the files but a system failure caused me to lose the torrent file.