Once I disabled mouse smoothing and added FOV hotkey the game got a whole lot better! Posting link again for anyone who missed it earlier, has a good running list of tweaks/fixes.
http://forums.steampowered.com/forums/showthread.php?t=998374
http://forums.steampowered.com/forums/showthread.php?t=998374