By the sly , ∨ On the sly Meaning, Definition & Usage

Definitions
  1. in a sly or secret manner. Colloq. "Gazed on Hetty's charms by the sly." G. Eliot.

Webster 1913