Removing memory card from small black carrier?

I am trying to figure out how to remove the memory card from the small black plastic casing into which it is inserted prior to inserting the entire casing into the camera.  Does anyone know how to do this?  Again, I am referring to the small back insert case that came with the camera, into which the memory card was then inserted, and the whole thing then pushed in place in the camera (Iris360).  I have successfully removed the case from the camera, but cannot seem to find the secret behind getting the memory card back out of the very small casing in which it now resides.  This small black case seems very fragile and I have pulled on the exposed end of the card with no luck. I don't want to break the case of I am in big trouble...  What's the trick? 

Any help on this would be greatly appreciated.  Hope I am making sense.