To go to the wall Meaning, Definition & Usage

Definitions
  1. to be hard pressed or driven; to be the weaker party; to be pushed to extremes.

Webster 1913