Note that if a number between 1 and k were not randomly selected to start on (that is, if you just started on k), a systematic sample would not meet the criteria for a probability sample. By, randomly selecting the starting point, all units have a nonzero probability of being included.