Do I need to remove the plastic bag to harvest the mushrooms?

You shouldn't need to open the plastic bag to harvest the mushrooms. When harvesting, you can hold onto the cluster of mushrooms and twist near their base. That should be enough to pop them easily off the block. If they fruit inside the bag, feel free to open it up to harvest.