There seems to be a bug in mythtv in around this on a combination backend/frontend system while recording and playing non hd content at the same time.
http://www.gossamer-threads.com/lists/mythtv/dev/563847I replaced the amplifier on the cable signal and the problem went away for a while, but then came back, but not as often.
Thinking that this still was a hardware issue, I dug more into Nivida settings. If found a reference for the the following option at
http://www.mythtv.org/wiki/VDPAU#Tearing.2FStutteringCode:
Option "TripleBuffer" "True"
After adding this to the /etc/X11/xorg.conf.d file I have not had anything more than a random stutter every week or so.
My video card is a GeForce GT430 which is speced to handle all VDAPU modes.
My theory is once the system would hit the triggering condition, everything would stacks up, causing mass stuttering. I did notice that the stuttering would go away when a commercial was playing sometimes(HD or SD). Guessing that re encoding of content from the tv station and/or the cable provider of the non native HD content was stressing the video card.