To take the back track Meaning, Definition & Usage

Definitions
  1. to retrace one's steps; to retreat. Colloq.

Webster 1913