Note - the end cap is an assembly of rubber pad glued to a plastic cap. Make sure you pry up from under the edge of the plastic cap, not remove the rubber alone.

You don’t need to continue down the side as mentioned below.