I left my last employer because I hated the mood & my collegeaus. I had to take a big pay-cut (€750) so I could work somewhere else (wich I'm leaving at end of month)

Anyway never regretted that choice. I have to be at work at least 40 hours a week (most of time +50). If not in a fun and relaxing enviroment it means most of my time I'm at a place I don't want to be...
So IMO it's always 1st: a nice place to work 2nd: financial bit (providing having the same responsibilty at both jobs)