I've definitely had some that are! The ones on Domino's pizza used to be terrible. Maybe avoid the off brands.I wouldn't use rubbery to describe them.
If you like olives you'll like capers, I think. But they aren't really something you eat right out of the jar (not even me!). They're more to add a salty punch to various dishes. My favorite dish with capers is a this: Johnny Carino’s Angel Hair Pasta with Artichokes | CopyKat RecipesYou try olives and I'll try capers.
. . .hmm, I haven't had that in ages, maybe that should be dinner tonight.