I worked for a high end retail store in the men's department for the buyer. At that time, Hickey-Freeman was the best, see this link for them:
https://www.hickeyfreeman.com/
I also came across this article when I was doing research. Nordstrom is a pretty good store to go to if you want to "build your wardrobe". Also, some of the premium outlets have some high end men's clothing stores. I admire you for wanting to look your best!