I think you already answered your own question.
To me the people I work with mean a lot. The job I am at now I took because of the people (mostly my boss

). Of course provided I like the work. I had some major pain in the ass bosses and co-workers --- it was hell. Every day was endless. I hated Mondays. Now that I get along great with all my co-workers and especially my boss, my whole life is different.
Just because it is an easier job doesn't mean it wouldn't be difficult to work there.
As for the lady that cuts you out now, she'll get over it. Too bad she has to act in such an uprofessional manner and it would raise a big red flag for me as to whether or not I would want to work there.
Good luck.