Filming in RAW with the Canon 5D MKIII

James Miller is a film maker and a brave man. Only a brave man would get hold of a brand new $3000 camera and pull it apart without a manual or a safety net just to see if he can make it slightly better. But then this is a man who likes to take the lens off a camera while it is recording. He calls it lens whacking, I call it art and almost everyone else describes it as a certain guarantee violation and the actions of a man who has spent too much time in the sun, pixel peeping. Well he does call his company Miller and Miller which suggests a measure of schizophrenia.

James is a friend and business partner of Philip Bloom and a pioneer in the world of DSLR cameras. We met once but I doubt he will remember because at the time he was salivating over the recently released Canon C300 and cradling it like a child. Inwardly I'm sure he was harbouring thoughts of dismemberment and performing lewd operations using a mini hex key and a soldering iron. I imagine the gaps between the floorboards in his house are forever swallowing up the miniature screws that keep our cameras together - his are in one piece through the arts of origami and gaffer taping.

The results of this camera butchery can be seen on his website mmfilm and some of it is quite beautiful and really shouldn't be possible using the same camera that I own, namely the Canon 5D MKIII. But his latest experiment is one that I might be willing to try since it doesn't involve physical removal of parts and is provided by Magic Lantern, a group of people who produce software that runs inside many Canon cameras to give features that many of us would give our right testicle for. Fortunately there is no need for such drastic surgery because the software is free.

The latest version works on the 5D MKIII and seemingly doesn't turn the camera into a large paperweight but offers lots of useful options like an intervalometer and bulb ramping for time lapsers and zebra levels, waveform monitors and overlays for video shooters. A full list of functionality can be found here.

This week James released a short "film" on Vimeo called Genesis which was shot on a Canon 5D MKIII (previously taken apart in an earlier, seemingly successful experiment) with the Magic Lantern software installed. What I hadn't mentioned was that the ML software allows the camera to record its footage in a RAW format, Canon's own DNG, in a series of still frames, creating in effect a timelapse, albeit one with 25 frames per second - which eats up 4 GB every minute. This allowed the footage to be imported into After Effects using Adobe Camera RAW and its powerful grading functionality, which is the process I use for my timelapses found here. 

He then exported each clip as a ProRes video and edited in Adobe Premiere. Here is the wonderful video (now a Vimeo Staff Pick no less) entirely shot with a Canon 5D MKIII and a Canon 70-200 L IS II lens, please expand it to full screen or follow the above link to James' Vimeo page:



James appeared only to have shot this as a test, but some of the shots are pieces of art, technically superb and wonderfully framed. He mentions the use of IR contamination which is something most of us would avoid but James uses it on the evening sun to stunning effect. Even viewing the film compressed on Vimeo leaves me impressed and goes to prove that the better the source material the better the final video whether it is H.264 or Blu-ray.

James pushes the boundaries far further than us bi-testicled mortals and hopefully Canon will see that they shouldn't restrict the quality of their brilliant DSLRs to protect their high-end cameras, because Magic Lantern and James will bring the revolution to their door. I expect the 5D MKIII to be spitting out 4K video by the end of the year, it will just take a pioneer like James to make it happen. 

4K codecs - the good, the big and the ugly. Part 2

The first part of this blog looked at the file sizes of a 1 second 4K video clip using various QuickTime codecs. This part looks at the image quality of the codecs that use an efficient lossy compression system. Some codecs can compress an image and uncompress it without any loss of information (lossless compression), but these produce extremely large file sizes and I have left them out of this test as they should, in theory, show no difference to the original.   

The codecs compared here are GoPro's Cineform, Avid's DNxHD, MJPEG A, MJPEG B, MPEG 4 and Photo JPEG. Here is the table of file sizes for the various versions I made:

File sizes of 4K 1 second clip

Here is the link to the 1 second clip at HD 1920x1080 size in the MPEG 4 codec at 90%.

I made 2 JPEG (100%) stills of the first frame of the clip. One is the full size 4K image and the other is a 640x360 pixel crop with the image zoomed up to 200%. The cropped image is the top of the tower with the crane by the side. All the images are shown below, but I also made a stack of the crops in Photoshop and sliced out the layers for a comparison. 

Quality of various codecs 90% quality. 200% zoom and cropped

I haven't included MJPEGB here because it is no different from MJPEGA, but both MJPEGs show a large variation in the original colour, lifting the gamma significantly. All the other codecs were consistent and matched the uncompressed version.


The original purpose of this test was to see if the Avid DNxHD codec was suitable for 4K use but when I saw how poor the quality was I looked at all the other codecs to see what was wrong. You can see from the sliced picture how blurred the image of the crane has become, but the MPEG4 version is as sharp as the Photo JPEG image below. I was surprised when I looked at the file size how much DNxHD was compressing the image because I hadn't seen such degradation when editing high definition material and the file size is larger than MPEG4. I rendered out this clip in 1920x1080 with the codecs again set to 90% quality. The DNxHD clip was 44 MB in size and the MPEG4 was only 14 MB in size.

To be precise the HD version of the DNxHD codec was 44,808 KB in size which is exactly the size of the 4K version, which gave the solution. The DNxHD codec is only designed for the 1920x1080 video space and when the image dimension goes beyond that the pixels are duplicated (or more) to fill in the gaps, hence why it is blurred and the file size doesn't increase.

I think this is a mistake and Avid should limit the dimension the codec can produce, like H.264 does. Or it should ignore file size and produce a similar quality of image that the other codecs show here. I assume Avid will come up with a native 4K codec very soon which can be used in the next generation of cameras such as the Blackmagic Design Cinema Camera and their edit tools.

Meanwhile the best solution for moving 4K videos around the web appears to be MPEG 4 because it scales well, reproduces the original colour and is the smallest of all the options. However I hope that the GoPro Cineform codec becomes more widely used (and free) as it is robust and platform agnostic. And of course we wait for the launch of H.265 which is likely to be the choice of the broadcast world.

For videographers producing 4K clips the only solution is to use a lossless codec 

Here are the JPEG images of all the test clips. Please download them to compare.

Cineform 90%

Cineform 90% crop with 200% zoom

Avid DNxHD 90%

Avid DNxHD 90% crop with 200% zoom

MPEG A 90%

MPEG A 90% crop with 200% zoom

MPEG 4 90%

MPEG 4 90% crop with 200% zoom

Photo JPEG 90%

Photo JPEG 90% crop with 200% zoom

What will we be watching in 10 years?

I was sorting out a load of surplus electronic gear that has not been switched on for over 3 years and among it are three perfectly working TVs that I can no longer use, because the TV signal transmitted in the UK is now digital only and these only have analogue tuners. 

About 90% of the material I edit is now originated in high definition and as every UK broadcaster demands that all new programmes are supplied in 1080i I find it hard to watch anything that is not transmitted in HD any more.

I have now started to produce 4K (4096x2304 pixel) video from time lapses shot on a Canon 5D MKII (which are available through the London Photo and Video time lapse gallery). I have nothing to watch them back on yet but 4K TVs are becoming available and PC monitors have been close to this resolution for a while; I expect Apple retina displays will soon reach this level. With the 4K shooting Red Epic and Scarlet cameras becoming widely available more 4K material will be originated and the demand will increase.

The format is likely to remain 16:9 so my LCD and LED 1920p TVs will still be able to show downsized 4K material so hopefully they won't be redundant to quickly. But I doubt they will last as long as one of the TVs I need to get rid of - a Sony Trinitron bought in Hong Kong over 25 years ago and still giving a great picture. 

Maybe I will just keep hold of this one a little longer.