I would recommend you do, you can't clean the underlug and latch very well if you don't and it's very important they be clean, please see the FAQs topic "Cleaning and Lapping". You also want to clean under the forend and put some good gun oil on that part of the barrel.
Tim