I found many stores in New York City to be very accommodating to my dogs. Every store in Chelsea I entered welcomed them. They were either in their stroller or in their satchel
Stores along Fifth Avenue down the way from Central Park were nice too.
Other stores can be found at petfriendly.com.