I could see voters holding against him that the Spurs overall are not a very good defensive team (though since he moved to C and Tre Jones moved to starting PG, the Spurs have been an above-league-average defense).
That would be the only thing I can think of.
What are online sports books saying these days?