While I think even marriage has limits, baines said

fault?, gf no if a wife yes
but regardless a shit human being

implying that leaving any romantic partner in that situation is immoral.