That's just how time travel looks like to the untrained eye. The reason why there aren't more travelers is that your average physicist refuses to be eaten by a giraffe in the name of science.
