1806, originally a military drill to teach balance; "to stand on each leg alternately and swing the other back and forth." This, presumably, reminded someone of a goose's way of walking. In reference to "marching without bending the knees" (as in Nazi military reviews) it apparently is first recorded 1916. As a verb by 1854.[goose-step etymology, goose-step origin, 英语词源]