As a fellow Lostie who doesn't usually like sci-fi I would highly recommend The Time Traveler's Wife. The time travel is important to the story because it fills in gaps about things in a very exciting and intriguing way but the most important element of the story is still the relationships of the characters. One of my all time favorite books.