Turns out the smiley faces DO leave automatically. Whoops! Can't believe I missed that. Actually kinda embarrassed I missed that