I ultimately edited the original instagram post to remove the emoji to get around it, but haven't dug further into the issue after Otto's post via wordpress support. I suspect that I need to update the encoding to my database to have it work, but haven't had time to tinker with it recently.

I've seen the problem via two other hosts which aren't GoDaddy managed, so I don't suspect that's the underlying problem.