It's not normal for the battery to feel unusually warm when the glasses are plugged in.
If you feel the battery overheating, unplug the glasses immediately, otherwise the glasses may become damaged and, in extreme cases, you may burn your hand.
Battery Overheating
What to do if your battery feels abnormally warm when plugged in
Updated over a month ago