No, you shouldn’t. Even the mildest unscented baby wipes contain some kind of ingredient that’s harmful or unpleasant to your cat. While not all are poisonous, there are much better ways to keep your cat clean.
Most baby wipes don’t hurt cats just by application, instead, it’s the risk of ingestion that you have to worry about. Since they groom themselves all the time, whatever you put on their coat is likely going to end up in their mouth.
If you want to play it as safe as possible then you should stick with wipes that are specifically designed for pet bottoms. You can use a plain rag or paper towel but just make sure it’s moist before you use it and be gentle.
Citric acid, for example. Consuming essential oils from citrus sources can actually be poisonous to cats. Most baby wipes have added fragrances or ingredients which were never intended to be ingested by anyone!