Gems will only be deducted from your account when they are used for in-game benefits (e.g. refilling energy, more moves, boosts).

Unfortunately, we are unable to reverse any in-game benefits.