Don't change horses in the middle of the stream.

“Don't change horses in the middle of the stream.”

It is unwise to switch leaders, plans, or methods in the middle of a difficult undertaking.

— Traditional United States Wisdom, United States

Source: Traditional American saying, famously invoked by Abraham Lincoln in his address to the National Union League (June 9, 1864)