The fictional world in which a story takes place matters. If the world is not believable then the story will lose power and the reader will lose interest. Writers call this suspension of disbelief. You can have the craziest stuff going on in your story, but if something about the world in which it is set is off, it sticks out like a sore thumb.