The reflection is only one issue. The overall degradation in image quality sure isn't negligible... (why bother with IPS in the first place?)
What in the world are you talking about? If anything, matte screens are the ones with degradation in image quality. Do you have grainy plastic filters over the windows in your house? Does it make the outside look better?