So ...... almost 2 weeks later, I still can't login to my AT&T account (or even reset my password), and have just received the next monthly bill which I can't pay because I can't login!
There has been no response from AT&T, so presumably they don't monitor this forum.
Time to move to another provider, I think.