It depends on one's issues. Sweet potatoes are high in oxalates, so if that's something your body can't tolerate, they will be problematic.

I eat low carb, and they're also a high carb food. None of that is to say that I never eat them, but rarely.