Lip Sync Problems with New Digital Displays? 311
An anonymous reader writes "With all of the new digital TV displays flying out the door, its easy to to think that life is good on the road to high definition. But, as Audioholics reports today, cheaper displays are using inexpensive processors that result in video delays of up to 60 milliseconds (that's about 2 frames of video). This means that the video processing (deinterlacing, video scaling, etc) delays the picture so that the audio is out of sync. Add to this inherent delays in some LCD and plasma units and the problem can be more than a little noticeable. As of right now only a few manufacturers are building audio lip-sync delay into their products to compensate."
Ah, that explains it. (Score:5, Funny)
I was wondering why Ron Jeremy's tongue was trailing behind the licking sound.
Re:Ah, that explains it. (Score:5, Funny)
Re:Ah, that explains it. (Score:5, Funny)
Previous poster is full of it! Ron Jeremy is a California-based businessman who's known for his length of service and enormous gifts in his industry.
He's known to be a bit underhanded though. He's given the shaft to *hundreds* of co-workers.
Comment removed (Score:5, Funny)
Aaah... (Score:4, Funny)
Re:Aaah... (Score:2)
All right! (Score:5, Funny)
Re:All right! (Score:5, Funny)
Stupid Oriental Movie Jokes Notwithstanding (Score:5, Interesting)
I'm actually serious. While the normal populace may scoff and deride those who play games like Soul Calibur or Street Fighter until they can actually count how many frames a particular move takes to execute - and how many frames from when the button is pushed to when the move reaches its damage point - everyone likes nice, crisp controls.
They want to know that when they push that button, it went into the system immediately.
Now you're talking about adding a possible 4-5 frame delay to the entire system - but you CAN'T make the video game system have the same delay, it'd have to recalculate everything backwards in time to compensate.
So what do you do there, huh? It's a pretty crappy workaround solution.
Turn System! (Score:3, Funny)
Can you imagine how GranTurismo would be in a move-in-turns scheme?
ah (Score:3, Funny)
Re:ah (Score:2)
For anyone who likes cheezy kung-fu movies, will emencly enjoy it.
The best scene, is when one guy asks other guy, what's happening ?
And then you see the other guy, talking for about 10 secs, and finally hear the dubbing "I dunno".
I almost fell out of my chair ,
why do companies do this? (Score:4, Insightful)
So once again, another company is working around the problem instead of fixing it. This seems to be a bad trend in technology these days.
Re:why do companies do this? (Score:4, Informative)
Re:why do companies do this? (Score:3, Informative)
Here is some easily digestible information [avdeals.ca] for you. Cheers.
Re:why do companies do this? (Score:3, Interesting)
Back ~1990 I bought a device from Barkus Berry Electronics which delayed higher frequencies a few ms to let the "slower" bass and low-mid frequencies play catch-up. The idea was that the woofer and midrange had a longer stroke than the tweeter which was required to make the sound. This let the bass and mid leave the speaker at the same time as the high end stuff.
I still have that unit, it really seems to "open up" the music more.
Re:why do companies do this? (Score:4, Funny)
Re:why do companies do this? (Score:3, Informative)
To me, that sounds like phase-shift correction, in a way. More accurately, phase-delay correction.
Any time you low-pass a signal, there is going to be some sort of phase delay as a result -- whether that phase delay is a result of an active/passive crossover, or the physical attributes of the speaker, the problem is the same.
Phase correction
Re:why do companies do this? (Score:2)
Sounds like it's time to add some elementary signal-processing theory to high-school physics curriculums.
Re:why do companies do this? (Score:5, Insightful)
Try playing Nintendo on such a TV (Score:5, Insightful)
Will you really notice if the entire feed is delayed by a fraction of a second?
If the feed is coming from a video game console that's responding to live user input, I'll certainly notice llaagg. A delay of 60ms can spell the difference between a hit and a miss, adversely affecting game scores.
Re:why do companies do this? (Score:5, Insightful)
Re:why do companies do this? (Score:3, Informative)
Then your stereo probably already has this feature. You just have to setup the delay per channel properly.
The inverse problem is a much bigger problem (audio coming out after the video), and actually much more common. Most receivers do a good bit of sound processing nowadays, and some can do so much that they'll end up delaying the audio signal by some fraction of a second. Thing is, they don't delay the video signal noticeably and you wind up
Re:why do companies do this? (Score:3, Informative)
In answer to your question, most midrange (in hi-fi circles, "midrange" generally means between $500 and $1000) and all high-end receivers and preprocessors designed for home theater use will have an adjustable audio delay. I'm not sure how far this has p
Re:why do companies do this? (Score:3, Interesting)
Re:why do companies do this? (Score:5, Informative)
See, to get a sweet spot in a home theatre set up (wish I had room for a sweet spot in mine) is to set the rears equidistant from your ears as the fronts are. Unfortunately, many room environments don't allow for this, so you can use the receiver to "delay" the rear signals by so many milliseconds to make the surround more convincing at close range.
Re:why do companies do this? (Score:5, Insightful)
Audio vs Video processing (Score:4, Informative)
Re:why do companies do this? (Score:5, Insightful)
One man's workaround is another man's fix. Here, the problem is that video lags the audio by a fraction of a second. So there's two solutions to this problem: play the video with less delay or play the audio with more delay. Adding delay to the audio costs close to $0 because it just needs to be buffered for the 60ms it takes for the video to be shown. Speeding up the video might double the cost of the display as you might need parallel video processors which break up the incoming signal by physical region. Or you might need to find a faster display technology which hasn't been invented yet.
Re:why do companies do this? (Score:3, Interesting)
"He shoots he scores!"
Then we see the shot and the goal.
It's impossible to avoid the delay (Score:2)
It does seem compensation is the only solution. But there is a problem: lots of high-end equipment produces the sound and sends it to the speaker without any intervention from the tv (ie the speakers a
Re:It's impossible to avoid the delay (Score:2)
I had not thought about speed of sound before; it looks like just standing at the back of a large room can put you 1 frame out of sync. So much for those sound design people that think they need to sync everything to the quarter-frame
MPEG-2 Video and Audio (Score:4, Informative)
I used to develop code for digital set-top boxes, and I can tell you that this is not a trivial problem.
Because of the way MPEG-2 video works, there is an inherent delay in decoding (frame order in the bitstream isn't necesarily the display order because of the way P-frames and B-frames work.
Audio is slaved to the video through the use of timestamps, but the audio and video frame boundaries don't line up.
I'm not sure if the problem is really lip-sync delay, but building in enough buffering to account for video delay while not glitching audio.
Most people don't notice minor video problems, like repeating or dropping a frame, but they will hear lots of little audio glitches. Also, when a hardware audio decoder runs dry, you usually get a really bad artifact (it sound like stepping on a squealing mouse), and it takes 2 to 4 frames of audio to resync.
"What is that you say?" (Score:5, Funny)
<mouth keeps moving for several seconds>
Oh, wait. Those kung foo movies were always like that.
Big deal... (Score:4, Funny)
Re:Big deal... (Score:4, Funny)
I only watch 1960's Italian westerns...
Italian westerns? Ohh, you mean easterns...
Re:Big deal... (Score:5, Informative)
No, Spaghetti Westerns [wikipedia.org]. Typically made from the mid 60s and early 70s, they made Clint Eastwood into the star he is today. Fast cuts, trippy music, lots of gunplay, and they were heavily (and poorly) dubbed, as most supporting roles were cast with italian actors.
They are considered classics now, as are the likes of "Fistful of Dollars" [imdb.com] and "The Good, the Bad, and the Ugly" [imdb.com] Wonderfully loony and fun to watch.
Re:Big deal... (Score:3, Informative)
Audio Delay (Score:4, Insightful)
booo I say
Re:Audio Delay (Score:3, Informative)
Since you aren't the only one having trouble, I'll explain this guy's post.
"Action" video games rely on a low latency in the following control loop:
game system=>video display=>eyes=>brain=>hands=>controller=>gam e system
If the time delay in this loop gets too big, certain games become impossible, and certain other games become extremely unrealistic.
An example
This could be fun. (Score:3, Funny)
This will hurt video games (Score:5, Insightful)
Video games depend on low latency between input (at the gamepad) and output (at the CRT and speakers). Video game systems manufactured for sale in the United States after 2006 will include some sort of digital TV output. These digital TV sets introduce a significant latency into the chain. So what will happen?
Re:This will hurt video games (Score:2)
Re:This will hurt video games (Score:2)
Re:This will hurt video games (Score:5, Funny)
It's not a problem! It'll just make Halo play like Myst.
Re:This will hurt video games (Score:3, Interesting)
Seriously, the post makes reference to the use of cheap proccessors hence the video delay. By 2006 the expensive processors of today will be cheaper, and eventually cheap enough.
Re: (Score:2)
Re:This will hurt video games (Score:3, Informative)
Some of the fancy processing, such as 3:2 pulldown and deinterlacing, is only applicable to 480i signals. HDTVs generally disable a lot of that stuff with ED/HD signals. All of the current videogame
Re:This will hurt video games (Score:3, Informative)
480i? What game system are you playing? I don't know about the PS2, but the Xbox outputs at 480p, and some (very few) games do support 1080i.
HDTV formats (Score:2, Interesting)
So much for live tv (Score:3, Funny)
DLP TVs (Score:2)
is there a way i can test in the store?
Re:DLP TVs (Score:2)
Take this article with a grain of salt...
just put your speakers 60 feet away (Score:5, Funny)
Re:just put your speakers 60 feet away (Score:2)
Analog Signal Buffering (Score:2, Interesting)
I suppose it is possible to do analog signal buffering now that I think about it. Some guitar AMPs have a delay feture, which I'm sure is all analog.
Workaround exists! (Score:5, Funny)
For a video lag of 60 milliseconds, you only need to step back 20.4174 meters from your TV before the speed of sound will correct the synchronization problem.
The Neurochemical Fix (Score:5, Funny)
Thanks! I was about to return those movies (Score:2)
Damn (Score:2)
Lip sync? (Score:2)
The problem applies equally well to any other kind of video/audio synchronization that when out of whack will appear unnerving to the viewer; for example, gunshots; car explosions; doors slamming; the little high-tech bleeps made
Sucks for PCs, and on input too (Score:3, Interesting)
-dB
Re:Sucks for PCs, and on input too (Score:3, Interesting)
Thus today's syncing technology consists of:
The SMPTE LTC code is both recorded on an audio stripe (channel) of a mu
I ran into that... (Score:5, Interesting)
Samsung ended up sending someone to the house, and replacing a board in the TV with a newer model, and that seemed to fix the problem.
I don't understand why they couldn't have anticipated this problem before they shipped the TVs, though. Isn't that what QA is for?
Not originally from this planet, eh? (Score:4, Funny)
>I don't understand why they couldn't have anticipated this problem before they shipped the TVs, though. Isn't that what QA is for?
Dilbert: We have a serious flaw in our product that can be corrected with a cheap, quick swap-out of the Model 9 Frammish Board with the Model 9A. You want me to recall all 495,000 units that have shipped to our value-added resellers and make the change, right? Remember, I told you about this six months before any of these units shipped.Pointy-Haired Boss: Noooo. Let's wait and see how many retail customers call and complain. We'll send some minimum wage guy out to swap out the card for the one's that somehow manage to call us.
Re:I ran into that... (Score:2)
This happens on my TV Tuner card as well... (Score:2)
I only use it for watching hockey [www.cbc.ca], so it doesn't really matter.
The weird thing is that the tv card just passes the audio through to the sound card (a built-in on the MB).
Dial in delay to the receivers (Score:2, Informative)
Just my 2 cents
Well, you see, these displays are SO BIG... (Score:5, Funny)
And if you can afford one, you probably have a living room that big.
Re:Well, you see, these displays are SO BIG... (Score:4, Funny)
Yes, but by the time you move sixty feet away, the light will lag by forty additional nanoseconds, which forces you to have to move further away still... so they can never be in sync. It's the Zenith Paradox.
Sure it's the display device? (Score:4, Interesting)
It's either my crappy Scientific Atlanta HDTV receiver or the feed itself.
I really have doubts about this article.
Excuses, excuses (Score:4, Funny)
My hunch is that they delayed the video on purpose, but forgot to touch the audio.
Doesn't effect external audio.. (Score:2)
I have a macro set up on my remote, so when I turn the TV on, it automatically turns my receiver on & switches to the right input. I haven't used the speakers in my TV in 3 years, so I'm not sure if it has a lip sync problem or not (probably not, because it supports all the ATSC formats natively.. it doesn't need to do the extra p
rewrote their software (Score:3, Informative)
The old way was to read in a frame into memory. An other HW block or processor would perform the next operation, by reading that frame, process it and store it into memory again. The whole chain could be quite long.
This was not really a problem, they thought, because the audio was processed at the same time, and the delay was under full control of the soft and hardware.
until someone tried to use an external audio path...
As far as I know, they solved the problem, and the delay is minimal. And non existant if you route the audio over the same processor.
Even on TV (Score:2)
Seems to have started once my cable company went to digital...
Tivo sometimes does this (Score:3, Funny)
Kind of like taking too much cough medicine before a job interview.
Very noticable example (Score:5, Funny)
i2c video delay audio (Score:2)
Re:i2c video delay audio -- MAD4868A (Score:2)
MAD4868A press release [micronas.com]
Real Problem... (Score:5, Interesting)
I've delt with a lot of high-priced high-quality plasma systems over the years, and the lesson is definitely "Buyer Beware". The high quality 56" plasma systems can be stunning, but remember that you're also investing thousands in a device with a fairly limited lifetime, and no real industry-wide quality standards and more marketing buzzwords and cheap tricks than you can shake a stick at.
If you using plasmas as a computer display you will see even more artifacts. I've seen widescreen plasmas that could not accept any resolution modes of a correct aspect ratio. Many displays use a great deal of image processing to apply tricks to make the display look good, but sometimes the processing can seriously disturb things like computer text. I've seen apparent color segmentation problems on a lot of displays, and just a lot of artifacts in general.
-braddock
Because quality is job 9873937.2 (Score:3, Insightful)
If you buy model X and it sucks, that won't stop me from purchasing X because nobody researches this stuff beforehand. I just go to the guy in the TV department and he points me to model X and I buy it.
The market does nothing to punish poor quality.Re:Because quality is job 9873937.2 (Score:3, Insightful)
Hence Microsoft.
What? (Score:2)
This is an easily spotted problem and a simple fix.
Sometimes I worry about all these "product engineers" working with what amounts to computer technology more and more. They often don't seem to understand what they are doing or how to work with the technology and end up doing a really bad job.
Think someone who did a whiz-bang job on a satellite receiver in the early 90s being put on a projec
Problem solved (Score:2)
Whips out credit card......
Easy Fix (Score:2)
Britney (Score:4, Funny)
"cheap processor" is a myth. (Score:5, Interesting)
The delay is not caused by cheap processors, that is a myth. Just think about it, even delaying the video by 1 second will not reduce the required processing power...
In fact the delay is a technical neccessity for some of the algorithms employed in modern television. For example motion interpolation for 100Hz TV requires the knowledge of at least one frame in advance.
Also the "delay" in TFTs, as mentioned, has nothing in common with the delay due to video preprocessing....
The only remedy for this problem is to have an option to turn all the preprocessing off for video games and have an artificial audio delay, so it matches the video. Nothing that is out of bounds for an average TV...
Re:"cheap processor" is a myth. (Score:3, Interesting)
We're talking latency here, not throughput. They're two seperate things.
Let's say you have a pipeline of frames you're processing. There may be multiple frames in flight at different stages of processing. The longer it takes for for a frame to enter in one state and leave in it's final state doesn't nescicarily have any impact on the number
Re:"cheap processor" is a myth. (Score:3, Interesting)
P.s.: We are talking about signal processing in a cost efficient architecture here, this is different from render-to-texture algorithms in overpowered 3D accelerators.
Adding a fixed delay will not resolve the problem (Score:3, Interesting)
So much for "live" television (Score:3, Funny)
Not specifically a plasma display problem. (Score:3, Informative)
Slow processors can significantly delay the generation of the output video. Not only that, but the amount of work the processor has to do, which depends on how many changes from frame to frame take place, will cause varying delays.
The way the problem usually manifests itself is that the delta between video and audio gets biggere and bigger, the two slowly drift apart. The video is, of course, being backed up in memory. At some point it will run out of buffer capacity. The olde way of dealing with this was to just flush the buffer, which brings thing back into sync (for a while), but usually causes a nasty glitch in the video (blank screen for a few frames) in most cases.
Newer techniques involve dropping frames, more of them as the buffer fills up.
A good indicator that you are getting buffer overflow is when you change channel, then change back again and all is back in sync (for a while). This will have flushed the video stream buffer, and life will be good, untill it backs up again.
Faster processors can deal with the overall data rate without having to resort to these extremes, but the inherent delay caused by having to buffer a frame (or more) to be able to decode the next (because we are dealing with frame deltas in MPEG) will still cause varying delays in the video.
The real answer is to use adquate processing power, and to modify MPEG to insert timing marks into the video and audio streams, and allow the system to automatically and incrementally adjust the audio delay to keep it in sync with the video.
Expect to see a squadron of flying pigs before this happens ...
An even better answer, of course, is to scrap this digital TV crap. The best digital TV signal doesn't hold a candle to the best analog TV signal. All that digital buys is the ability to squeeze another 150 shopping channels onto every satellite at the expense of video quality - but that doesn't matter, its marginally better than VHS, so what will the consumers ever know?
Re:Not specifically a plasma display problem. (Score:3, Interesting)
Have you ever watched a "properly installed and configured DTV running in full HD"? You obviously have not. If you have seen it on a c
Re:There is an upside (Score:2, Funny)
...if that wasn't impressive enough, I just watched a "live" Britney Spears concert where the words matched HER lips!
Then again who is really watching her lips while she sings.
Re:There is an upside (Score:2)
Re:ah yeah...that is why I like DLP (Score:2)
Re:ah yeah...that is why I like DLP (Score:3, Informative)
Justin
Re:but ont he other hand (Score:2)
Just kidding, I'm Rick James bitch, enjoy yourself!
Re:audio/video out of sync? (Score:2)
Can anyone else confirm?
Re:audio/video out of sync? (Score:2)
I never noticed this. The crossover plugin version of flash doesn't have this problem, so I never tried.
Maybe I'll give it a whirl. If the synching problem is mostly due to contexts switching then the problem might 10x better with 2.6, but probably isn't fixed entirely. It's listed as a known problem in the flash plugin release notes.