How sure, exactly?

The atmosphere causes almost all meteorites to burn up before hitting the surface, I imagine that the same holds for space debris. So the concern about space debris hitting your house seems to be more about drawing attention to the very real problem of space debris to orbiting satellites.