Leaving and cleaving are identical twins and inseparable. You must leave in order to cleave and you cannot leave without cleaving. The choice then really is yours.
“Therefore shall a man leave his father and his mother, and shall cleave unto his wife: and they shall be one flesh.” – Genesis 2: 24
“Wherefore they are no more twain, but one flesh. What therefore God hath joined together, let not man put asunder.” – Matthew 19: 6