What happens if you go to work, and you don't do what you were hired to do? You get fired. If I own a deli, and you won't make sandwiches, you do not work for me. If I own a taxi service, and you refuse to bring people where they want to go, you do not work for me. Your reasons are irrelevant. I'm sure there are plenty of people out there who'd love to have the job you won't do.
Find the article I'm referring to here.