I was told by someone who worked at a company that does balloon flights that winds are somewhat predictable, so they launch balloons in a way that gives them a decent margin of error to account for fluctuations in the wind.

If it turns out that you have to land in the middle of the highway or some dangerous location like that, there is enough time to anticipate that and get in touch with the authorities to have that area blocked off.