{"id":382,"date":"2012-05-03T16:49:50","date_gmt":"2012-05-03T23:49:50","guid":{"rendered":"http:\/\/www.hd4pc.com\/techblog\/?p=382"},"modified":"2012-05-04T10:05:56","modified_gmt":"2012-05-04T17:05:56","slug":"visual-effects-on-act-of-valor","status":"publish","type":"post","link":"https:\/\/www.hd4pc.com\/techblog\/2012\/05\/03\/visual-effects-on-act-of-valor\/","title":{"rendered":"Visual Effects on Act of Valor"},"content":{"rendered":"

At Bandito Brothers<\/a>, we have always prided ourselves in being authentic and real.\u00c2\u00a0 This is one of the values that led Scott and Mouse to cast real Navy SEALS<\/a> for the main roles in Act of Valor<\/a>, and doing things like using live ammo in certain scenes.\u00c2\u00a0 So at first glance, it would seem surprising that we had hundreds of visual effects shots in the movie.\u00c2\u00a0 About half of them were in response to issues that resulted from shooting with the 5D<\/a>, but we also did have to add things like blood hits, and do fixes like painting out crew members.\u00c2\u00a0 Additionally, we had a fair bit of motion graphics work, both overlaid graphics for the audience, and screen replacement for briefing information.
\n
\nThe film based work was very straight forward, you got a stack of 24p 2K DPX<\/a> film scans, and you rendered out a stack of fixed DPXs when finished.\u00c2\u00a0 Film didn’t have to be converted from 30p to 24p, or exhibit rolling shutter artifacts, or Twixtor issues.\u00c2\u00a0 But compositing a 30p Canon files with a 24p film scan does take some work.<\/p>\n

Twixtor<\/a> is an amazing tool, but it is not perfect.\u00c2\u00a0 Whenever there is too much motion in a scene for the software to accurately track what is going on, it gives some strange results.\u00c2\u00a0 Since Act of Valor is a fairly dynamic movie, to put it lightly, we had our share of issues.\u00c2\u00a0 When issues with Twixtor were encountered, we had a fairly methodical, but time consuming solution.\u00c2\u00a0 We would bring three versions of the shot into the Premiere<\/a> sequence: the original 30p version, which would drop frames to play at 24p, another copy reinterpreted at 24p, (so it was longer, but every frame was accessible) and the Twixtor interpolated render.\u00c2\u00a0 We would start by examining the Twixtor version, and replacing the bad frames with ones from the original file.\u00c2\u00a0 If there was enough action to make Twixtor totally useless, then that chaos was usually enough to hide the dropped frames anyway.\u00c2\u00a0 On shots that were smoother, where that would be too noticeable, we would sometimes have to use the reinterpreted version, and slow the shot down for a couple frames here and there to get through the rough spots.\u00c2\u00a0 This obviously took awhile, and I got really good at moving single frame clips around on the Premiere timeline.\u00c2\u00a0 Smooth playback with lots of layers and micro-cuts was critical for this type of work, so the fact that CS5 played back everything in real-time was critical, especially for rapidly comparing different variations.<\/p>\n

For complex visual effects shots, our artists had to do this cleanup process on nearly every 5D source layer, before they could even start doing any regular VFX work.\u00c2\u00a0 Brett Novak did a lot of the early experimentation with compositing 30p Canon files with 24p film footage.\u00c2\u00a0 Andrew Furlong spent the better part of two years working on shots to keep pace with Scott\u00e2\u20ac\u2122s editorial process.\u00c2\u00a0 Besides the 30p conversion issue, the visual effects were processed in a fairly traditional way, and exported to Cineform when complete.<\/p>\n

We also dealt with a number of different types of rolling shutter <\/a>artifacts.\u00c2\u00a0 My favorite ones were the muzzle flashes at night.\u00c2\u00a0 Because of the way CMOS sensors record light data sequential from top to bottom, a bright flash results in horizontal lines of varying brightness in the recorded image.\u00c2\u00a0 There is a lot of gunfire in Act of Valor, and most of it is in the dark, which exaggerated the issue.\u00c2\u00a0 This is one case where shooting 30p actually worked in our favor.\u00c2\u00a0 Since we had extra frames available, we would just reinterpret the footage, and manually cut out the bad frames we wanted to remove, and enough other ones to get it down to 24p.\u00c2\u00a0 If this didn’t result in smooth playback, someone would have to manually stitch together the good parts of consecutive frames, where once again, it was helpful to have 30 fps to start with.<\/p>\n

We also had over a hundred subtitles, due to the Spanish and Russian dialog of the bad guys. (Some might argue that we should have subtitled the SEAL’s jargon)\u00c2\u00a0 These weren’t necessarily complicated, but had to be inserted into the workflow AFTER the color and grain passes, and the reframing for different aspect ratios.<\/p>\n

We didn’t have much in the way of motion graphics, but treating them the same as visual effects was probably a mistake.\u00c2\u00a0 They were giving us issues right to the end, primarily because of all the revisions that graphics usually get, and because the original templates weren’t designed with our final 2K online process in mind.\u00c2\u00a0 Most of them were rendered as overlay layers with alpha channels, and composited over the backgrounds directly in the Premiere Pro online sequence, which gave us more flexibility to adjust them than rendering the backgrounds into the shots would have.<\/p>\n

It was important to fix all of the visual effect, frame rate conversion artifacts, and rolling shutter issues before we further processed the image with color correction and our texture pass.\u00c2\u00a0 Once those modifications were rendered into the footage, pulling up source frames to cover up problems would no longer match.\u00c2\u00a0 Simple dust busting fixes on the other hand could easily be done on the corrected image.\u00c2\u00a0 So that was one of the last steps I did, pulling up individual DPX files in Photoshop<\/a> for repair with the Clone-Stamp tool.<\/p>\n","protected":false},"excerpt":{"rendered":"

At Bandito Brothers, we have always prided ourselves in being authentic and real.\u00c2\u00a0 This is one of the values that led Scott and Mouse to cast real Navy SEALS for the main roles in Act of Valor, and doing things like using live ammo in certain scenes.\u00c2\u00a0 So at first glance, it would seem surprising […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[16,48,43,44,15,24,45],"_links":{"self":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/382"}],"collection":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/comments?post=382"}],"version-history":[{"count":3,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/382\/revisions"}],"predecessor-version":[{"id":392,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/382\/revisions\/392"}],"wp:attachment":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/media?parent=382"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/categories?post=382"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/tags?post=382"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}