I heard the interview while driving. I agree, that if Patrick had just asked the open-ended question "who do you worry about?" without suggesting the Spurs at the end, it would have been more interesting.
The Spurs have trouble with long, athletic teams and the Spurs have trouble with teams that run a lot of iso plays. In the Spurs/Lakers game last Wednesday at the AT&T Center, the Spurs were playing great until the 2nd half. That's when the Lakers upped their defense and then ran isolations almost exclusively. Kobe, Pau, Odom, and Artest all got clear-out sets for them to go to work.
In other words, the Spurs will have a very difficult time with the Lakers.