My rebuttal would be that among those parts of our foreign policy that our values might actually allow us to change, really only the Iraq war is driving people to attack the U.S. who otherwise would not.
Recent events show that Western nations which have opposed the Iraq war have fallen under at least as great a threat of terrorist attack as the U.S. does. So it's hard to claim that pulling out of Iraq is going to put a significant dent in terrorism.
The Iraq war was stupid.
Calling in public for outright regime change in several countries is stupid.
We can modify those policies.
We don't have a time machine to go back to 1953 and undo the coup in Iran.
Our values are not going to allow Muslims to exterminate the Israelis.
Our values are not going to allow Muslims to slay the Indians in Kashmir.
We are not going to start a war with Russia to protect the Chechens.
Our values are not going to allow us to keep women fully covered and out of public to avoid offending Muslim sensibilities.
We are not going to abandon our own prosperity in order to eliminate the contrast with their own cultural dysfunction that drives them to murderous envy.
We aren't going to sit back so that Islamists can carry out violent revolutions in places like Saudi Arabia.
We do not control OPEC.
Our penchant for working with their own despots is not separating them from what otherwise would be moderate, prosperous countries (would Pakistan be better off if Musharraf were overthrown?).
We aren't going to pack up and avoid all contact and all business dealings with Muslim countries.
We can't help it if their own populations like our culture more than they like repressive Islam.
We are not all going to convert to Islam.
We are not going to allow Muslim communities in our own country to practice Sharia law, and neither are our allies.
We are not going to suppress free speech in our societies to stave off worldwide riots whenever somebody says something bad about the prophet Mohammed or Islam.
Those are some of the big reasons the Muslim street takes up arms against Western society. If you can identify some other specific policies of ours that Muslims have cited as reasons they are driven to take up arms, I will be glad to read them.