Upgrades affect all weapons of that type, yes. ME2 doesn't really have weapon "upgrades" as most people know them - new weapons that are clearly better than the ones you already have. For just about every weapon class, you have options between slow firing, more powerful weapons and faster firing, less powerful weapons. Just go with whichever you prefer.
--
http://i32.tinypic.com/zlf1w7.gif
Watch and you'll see... someday I'll be... part of your world!