{"id":72,"date":"2010-03-28T15:55:22","date_gmt":"2010-03-28T22:55:22","guid":{"rendered":"http:\/\/www.hd4pc.com\/techblog\/?p=72"},"modified":"2010-03-28T15:55:22","modified_gmt":"2010-03-28T22:55:22","slug":"managing-footage","status":"publish","type":"post","link":"https:\/\/www.hd4pc.com\/techblog\/2010\/03\/28\/managing-footage\/","title":{"rendered":"Managing Footage in Tapeless Workflows"},"content":{"rendered":"

File organization has been an important aspect of media management ever since the advent of tapeless<\/a> workflows.\u00c2\u00a0 Prior to that point, any frame of footage could be identified by, and presumably recovered from, a tape name and timecode<\/a> value.\u00c2\u00a0 Once you remove the tape from that paradigm, a new organization system is needed. \u00c2\u00a0In the case of DSLR cameras, this problem is compounded with the removal of unique timecode from the equation as well.\u00c2\u00a0 The following post is a detailed description of how I deal with those problems during the post process of large scale projects originating on Canon DSLRs.\u00c2\u00a0 Many of the tips below can also be implemented in other tapeless workflows (XD, P2, EX, AVCHD, etc) if desired, but this article will be tailored to DSLR acquisition.
\n
\nWhile file organization for smaller projects is relatively simple, when you have hundreds of hours of footage shot over thousands of individual clips, from\u00c2\u00a0many different cameras, carefully planning is necessary to maintain order.\u00c2\u00a0 The first thing I do is sort all of the footage by source camera, as I am backing up the original CompactFlash<\/a> cards.\u00c2\u00a0 This can be done simply by having the camera crew mark each card to identify the camera that shot it, but that method\u00c2\u00a0is very prone to human error.\u00c2\u00a0 Instead, being able to identify the source camera by the names of the files on the card is a much more reliable plan.<\/p>\n

Canon DSLRs name each video file “MVI_####.mov” where “####” is a constantly incrementing 4 digit number.\u00c2\u00a0 It is easiest to identify individual cameras if each one is shooting a totally different series of numbers. (Like CamA = 1000’s, CamB=2000’s, etc.)\u00c2\u00a0 While there are no options in the\u00c2\u00a0Canon menus for manually setting the starting file number, there is way to trick the camera into starting at\u00c2\u00a0any number you want.\u00c2\u00a0 Reset the counter to zero in the menu, and then return the setting to Continuous. \u00c2\u00a0Take a picture, and then use your computer to rename the JPEG file on the card to the desired number.\u00c2\u00a0 (In this case: 5000)\u00c2\u00a0 Put the card back in the camera and take another picture.\u00c2\u00a0 Verify that it incremented from there. (IMG_5001)\u00c2\u00a0 Format the card or remove it, and your camera will continue incrementing from that point. (So my next shot, will be IMG_5002, or MVI_5002 if you switch to video mode.)\u00c2\u00a0 You can reset it to any four digit number you want, and it will increment from there, unless you shoot with a card from another camera, without reformatting it first.\u00c2\u00a0 In that case, the camera will increase the file number if necessary, above any files already on the card.\u00c2\u00a0 The Canon 1D MarkIV<\/a> has a few more options for filename prefixes, but the\u00c2\u00a0objective is the same, to create a uniquely identifiable series of filenames for each camera on your shoot.<\/p>\n

Doing this will make it much easier to sort through your files, since you will be left with a separate numbered sequence of files from each camera.\u00c2\u00a0 I was recently on a two week shoot with twenty Canon cameras, and by setting their initial numbers 500 apart, (Since four digits gives you 10K possibilities, divided by 20) it was easy to sort the resulting files, even though due to logistics, I got some of the files many days after they were shot, and out of order.\u00c2\u00a0 If you set the clocks on the cameras accurately, the timestamps on the files will make it easier figure out which files are different angles of the same take.\u00c2\u00a0 Even with all that, I still had duplicate file names on that project, with 5600 files for that shoot, so renaming to a better convention will be important on most large projects.<\/p>\n

Having a good naming convention for your media files can save a lot of time and trouble.\u00c2\u00a0 The info that needs to be contained within the file name will vary\u00c2\u00a0depending on the nature of\u00c2\u00a0the project.\u00c2\u00a0 For the Navy Seal movie I setup a convention that included Scene, Setup, Take, and Camera.\u00c2\u00a0 The next project I worked on was more of a documentary type shoot, with no script or scene numbers, so the file name was composed of Date, Camera, and an incrementing shot number. \u00c2\u00a0The important things to keep in mind are: order the info intelligently for searching, keep place values consistent for sorting, (Use leading zeros) and make it unique within the first 8 characters for EDLs<\/a>.\u00c2\u00a0 For the movie, 005A_02b.mov is: scene 5, first setup, second take, camera B. \u00c2\u00a0If I want to see the other camera angles\u00c2\u00a0for this take, they should be nearby if the footage is sorted alphabetically.\u00c2\u00a0 And if I want to find other takes from that setup, I shouldn’t have to scroll too far. If during onlining I am looking for a specific clip based on the name, I go to the proper scene folder, and scroll down to the right setup, and start looking from there.\u00c2\u00a0 Now if you want to include descriptions in your filenames, put them after the unique identifiers up front.\u00c2\u00a0 This is because sorting descriptions alphabetically is relatively useless, but you can still search through them with regular OS tools, as long as the description is somewhere in the filename. (10_E_026_BigExplosion.mov)\u00c2\u00a0 And if your software at some point in the process truncates the name, there should still be enough info in the first 8 characters to identify the exact source file.<\/p>\n

During the process of renaming, it is a\u00c2\u00a0good idea\u00c2\u00a0to keep a log of what you have done in case you make a mistake, and it forms a basis for content logging as well.\u00c2\u00a0 I do this with a simple Excel spreadsheet that records: Original Name (MVI_####), New Asset Name, Description, Comments, as well as CameraName, Date, FrameRate, or any other data that might be relevant depending on the project.\u00c2\u00a0 I also sort out the bad takes and delete the .THM thumbnail files during this stage. (The THM files are actually JPEGs that can be opened if you rename them, but I have never found any practical use for them)\u00c2\u00a0 Once I have this list of what I want the files to be renamed to, to fit the filename convention for the project, I convert the log into a renaming batch file.<\/p>\n

To do this, save a copy of your log sheet as a “Text (Tab Delimited)” file from Excel. Then delete every column except the original name and the new asset name, and insert blank columns before, in between, and after those two columns. Fill each of those three columns with a unique character, like #, $, and %. Save your file and close Excel. Open the file in Notepad, and press CTRL+H to bring up the replace window. Replace “#([TAB]” with a command and the path to your media files. (“REN<\/a> D:\\ProjectName\\Footage\\”) Replace “[TAB]$[TAB]” with “.MOV[SPACE]” unless your log included file extensions, in which case just replace that with [SPACE]. Replace “[TAB]%” with “.MOV” unless your log included that, in which case replace it with nothing. (In WinXP the only way to insert a [TAB]<\/a> into the Replace dialog box is to cut and paste one from the document, with CTRL+V.)\u00c2\u00a0 You should be left with a text file with a series of commands that each look\u00c2\u00a0something \u00c2\u00a0like this:
\nREN D:\\ProjectName\\Footage\\MVI_0001.MOV 057_T12A_NewClipName.MOV
\nSave this document and rename the file extention to .bat<\/a>, and double click on it to run the batch.\u00c2\u00a0 This should assign new names that match your log to each of your files, and make it much easier to sort through your footage, if you designed your naming convention well.<\/p>\n

The other thing you can do with you footage log is generate an ALE, so that if you are editing in Avid, your log notes can be linked to your clips within the program.\u00c2\u00a0 I will go into those details, and other tips for editing DSLR files in Avid, in my next post.<\/p>\n","protected":false},"excerpt":{"rendered":"

File organization has been an important aspect of media management ever since the advent of tapeless workflows.\u00c2\u00a0 Prior to that point, any frame of footage could be identified by, and presumably recovered from, a tape name and timecode value.\u00c2\u00a0 Once you remove the tape from that paradigm, a new organization system is needed. \u00c2\u00a0In the […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29,11],"tags":[46,44,45],"_links":{"self":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/72"}],"collection":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/comments?post=72"}],"version-history":[{"count":8,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/72\/revisions"}],"predecessor-version":[{"id":80,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/posts\/72\/revisions\/80"}],"wp:attachment":[{"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/media?parent=72"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/categories?post=72"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hd4pc.com\/techblog\/wp-json\/wp\/v2\/tags?post=72"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}