A car collided Thursday with the gates of Downing Street in central London, where the British prime minister's home and offices are located, setting off a rapid security response in one of London's most-fortified sites.