Mortgage rates dropped back to 4 percent this week with Freddie Mac reporting 4.00 with an average 0.7 of a point as the average on 30-year fixed mortgages.