If I do that, it says:

No Avatar Specified
Avatars are small graphics that are displayed under your username whenever you post.
X Do not use an avatar Note: if you have a custom avatar selecting this option will delete it.

Where there is an X above, there is a selection button and it is selected, meaning "Do not use an avatar." I am not able to unselect this.