The family claim repeated encounters occurred over the years they lived in the 300-year-old home.