Better Living Through Technology: a blog dedicated to emerging
technology trends in hardware, software, webware, marketing and beyond
 
 
 



« The Digital Revolution - The Impact of Herman Hollerith | Main | XM Satellite Radio: Delphi MyFi Radio Review »

HDV: why I hate it, but will buy it in a heartbeat
Benjamin J. Higginbotham

If you didn’t know, I have a background in broadcast television.  For many years I worked in R&D for a television studio integrator/VAR and have followed the progress of HD for about 10 years now.  In the broadcast world there are many HD formats: DVCPRO HD, DV100, D5, Uncompressed HD, XDCam, Etc.  These formats are all very expensive and the general consumer or even prosumer could not hope to afford them (a DVCPRO HD camera goes for about $80,000 without a lens). So what will be done about HDTV in the cosumer realm?  A couple of years ago JVC introduced a format they were calling HDV and I hoped it would never catch on.   Unfortunately it did.

So why do I dislike HDV so much?  To explain that, I need to explain how DV works and what a CODEC is and does.  DV video, such as the DV camcorder you would buy at Amazon.com or Best Buy, records a digital video signal on magnetic tape at 29.97 frames per second, with a datarate of 25Mbps.  The CODEC, which stands for COmpressor/DECompressor, is an all i-frame format.  What the heck does all this mean?  It’s actually very simple:  Your camera will record almost 30 frames of video per second to the magnetic tape.  These frames are compressed into a format called DV.  If we didn’t compress the frames, which is the process of taking data out of the picture and thus lowering its quality, we would not be able to fit it on a small tape such as we do.  Compression is both good and bad as it allows us to make the video file smaller, but the more compression we add, the more quality we loose.  The thing about DV is that it uses something called i-frames on every frame.  This means that every single frame is an entire picture rather than a partial picture.  This comes in very handy for editing and error correction.  Lets say you bump your camera and 10 pixels get corrupted.  The chances of you being able to see 10 pixels for 1/30th of 1 second is quite slim, since the next frame is an entire new picture.  That’s DV.

Enter HDV.  Make no mistake; HDV has absolutely nothing to do with DV.  The only similarity is that HDV can be pushed down a firewire cable (that’s the preferred transport, actually).  HDV is a long GOP (GOP is a Group Of Pictures) format based on MPEG 2.  This means that rather than recording full frames for every picture, we record 1 full frame, then the next frame only records the changed pixels, the frame after that is the changed pixels, and this continues until we hit a full frame (AKA i-frame) again.  Bang your camera here and get 10 corrupt pixels, now instead of being on the screen for 1/30th of a second, they could be there several seconds possibly.  This also creates a problem with editing.  Since DV is an all i-frame format, we can make an edit on any frame we like.  Since HDV has virtual frames, it becomes much more complex to edit.  How do you start on a frame that is missing 2/3 of its information?  In addition to the long GOP problem, HDV is 25Mbps, just like DV.  So a standard definition video takes 25Mbps and a high definition video also takes 25Mbps… They are throwing something away to make the HD video fit on that tape (HDV uses the same tape as DV).

GOP structure

These are the disadvantages of HDV:  The fact that it’s not all i-frames (long GOP) and the amount of compression.  So what are the advantages and why would I buy HDV over DV (which I would)?  The advantage of HDV is the type of CODEC and the resolution.  HDV uses MPEG 2, while not the newest CODEC on the market, still a very good one.  Since MPEG 2 is long GOP rather than all i-frames, the virtual frames take a fraction of the space as a real frame.  This means it’s more efficient with the data that it is using, allowing us to put the added resolution on tape.  HDV runs at 720p or 1080i, quite a bit better than the 480i that DV runs at.  720p would be my format of choice, which is 720 lines of resolution displayed progressively.  1080i is a decent format, but keep in mind that if you froze time and looked at your monitor, only 540 lines would actually be showing since it’s interlaced.  So 1080i has better resolution, but all the problems of the interlacing found in DV.

Interlaced video
Progressive Video
Interlaced Progressive

There are issues editing HDV, but companies such as Apple and Pinnacle Systems have done a good job of creating the tools needed to edit HDV just like you would any other format.  Due to the fact that this is an MPEG 2 CODEC and your editing software needs to re-create the GOP structure on every edit point, these editing systems are painfully slow.  In general if you have 1 minute of HDV video it will take 4 minutes to export that same video to tape.  1 hour of video would be 4 hours.  This number shifts depending on the number of edits in your timeline, the speed of your processor and the amount of RAM your system has, but it’s a good general number.

The added resolution and general quality of HDV makes it a hands down better format than DV.  My hope was that we were going to come up with a HDDV format that’s HD and all i-frames, but that’s not what happened, so we’re stuck with HDV.  If you’re in the market for a digital camera today, take a good look at the HDV cameras from Sony and JVC.  In the consumer realm there are two options: DV and HDV. You can wait for HDV to come down in price, or you can buy today, but pay a premium for being on the bleeding edge of technology. I personally would go HDV today to get the better picture quality and progressive frames. Which would you do and why?




TrackBack

TrackBack URL for this entry:
http://www.technologyevangelist.com/cgi-bin/mt-tb.fcgi/49

Comments

1. Posted by: Roald Marth on December 30, 2005 10:05 PM:

Very compelling review, but as for me, the Sony HC1 is still about $2000 and a standard DV Camcorder is well below a $1000 therefore for a couple more years I would opt for DV. I could buy a DV camcorder today for $700 and an HDV camcorder later for $1000 and still be money ahead, and have an easier time editing. Thanks Ro




2. Posted by: Kelly Adams on December 31, 2005 8:30 AM:

This is an excellent description of an often poorly understood subject.

I work in the streaming video/webcast arena, although I'm the first to admit that I'm not a production guy. Most of what I do is custom application development for viewer demographics and the like. But I do have a fair idea of the concept of key frames/i-frames. Its amazing how much can be done when bandwidth and storage are tight to improve video quality by making careful choices regarding codec settings for keyframe frequency.

That said, the kinds of considerations you've outlined here are what makes normal consumers so hesitant to jump into the high definition market. Its confusing, and most people just want something that works.




3. Posted by: John Pugh on September 10, 2006 8:14 AM:

This was very useful information. It takes a lot of reading to come up with a sound decision and this article was helpful. I'm not quite there yet. I am trying to come up with the optimum solution at a reasonable price. I am buying a 1080p capable HDTV, I have a Mac Mini to store my music and photos. I want a good consumer HD camera to record my granchildren.

Sony have now introduced three versions - tape, hard drive and a DVDROM-based machine. I am guessing that the format will be HDV based on this article. Does anyone have an opinion as to which media to use (tape, disk, ROM). I tend to dismiss disk because it's prone to failure on a hand-held camera (check out iPod mimi-disks). I want to be able to store my raw video so I am now wondering if one storage medium has an advantage over the other. Presumably the ROM approach would have fewer moving parts.




4. Posted by: d hakim on September 12, 2006 2:08 AM:

in 2 years i see samsung, sony, panasonic, canon make HD video camera mp4 version HD progressive 1080p with interchangable 77mm dslr nikon, canon, tamron lens with weight less than 2kgs , package with non rendering editing software at price less than US$2,000-




5. Posted by: freddyzdead on February 7, 2007 2:36 AM:

This article mostly goes on about editing; this is gonna be a problem no matter what. HDV editing is very time intensive - but why try to edit the transport stream? I get excellent results by frameserving the raw TS to VirtualDub, encoding to HuffYUV, from which point I can edit to my heart's content. If space is a problem I even sometimes use Xvid at very high bitrate and the quality is excellent.

What I don't like is that the Sony HDR-HC1 outputs only interlaced. Looks fine on the LCD TV, but for anything else, you have to deinterlace it. There is no way to do this without losing (notice that word has only 1 "o") a lot of information.

The HDV standard allows for 720p as well as 1080i, but Sony won't give it to us for some well-guarded reason. In a lot of situations, 720p, although apparently of lesser quality, would look better than 1080i. Just about anything that's moving, in fact.

Anyhow, HDV is a compromise, for sure, but considering the end result, it's not a bad one.

Mr. Marth, if you'd seen the output from the HC1, you'd never have written what you did.

Mr. Pugh, I have no idea what you're talking about.

Mr. Hakim - ?




Post a comment

Name:


Email Address:


URL:
Remember personal info?

Comments:

HTML Tags you can use in your posts:
<b>Bold</b> = Bold
<i>Italicized</i> = Italicized
<a href="http://www.othersite.com">Link to Other Site</a> = Link to Other Site


Please keep comments on-topic. Contact authors or other commenters
directly for off-topic conversations.

Notify me of future comments via e-mail



Technology Evangelist Digest - Free Newsletter
Sign up for the free Technology Evangelist Digest to receive daily updates, editorials, and practical advice on emerging technology trends in hardware, software, webware, marketing and beyond.

Technology Evangelist Digest will keep you up to date on the technology trends that will help make you more productive and efficient both in business and your personal life.

Let's face it: If you made it to this line, you must have found something valuable on this page, right? Think about how cool it would be to have something free and interesting to read every day from Technology Evangelist by signing up today.

1. Fill in your email below,
2. Then click on the confirmation email you receive.
3. That's it. Your first Technology Evangelist Digest will arrive within 24 hours.




Previous Entries:


Tag Cloud