Is his attitude likely to change if it means losing you? I imagine this is not a situation you'd be willing to contemplate until you got to wits' end, but having worked a job which required six hours' commuting to work eight and lasted a week, I know that it can come to that - and you're probably valuable enough to them that they might be willing to compromise under those circumstances...

Don't kill yourself for the sake of the job. Even if it's a good one. *hug*