Despite the low rates, mortgage activity decreased last week.