I guess i would, i worry. Hopefully it is something the cat will pass, but i know they often have problems with this. I would go to the vet for a quick check, and see what their advice is? Im guessing they will want you to check the litter box for a few days? But i would want my vets advice. Is this one like she ate? How long is it?
I also wonder if she ate something identical or if that is what she passed? I also find that if you are asking yourself IF you should take her to the vet the answer is probably yes. I have seen pets who ate something a week ago and "seemed fine" but then started vomitting and now its an emergency appointment and likely emergency surgery.... As an Xray shows the ingested item stuck in the intestines, blocking food from passing. Both times I saw it get this extreme the pet didn't make it.
Also better safe then sorry. Appointment and xray if the vet thinks that is necessary.