The AT&T center isn't in a particularly great part of town either.
Beyond the Spurs games, there's literally no reason to be over there unless you live in the section 8 housing down the road. There are only so many people willing to go to a basketball game for the basketball. A lot of people looking for other attractions close by as much as the game itself might find arenas in other cities more attractive due to proximity to such things.
The spurs are a good team, though. They sell out their playoff games (when ticket prices are much more expensive) and important reg. season games.