Buffett called the five-bedroom listing home when his father, Howard Buffett, was serving in the U.S. House of Representatives in the 1940s.