For everyday Americans, the average family now spends over $1,800 a year on swipe fee-related price increases. The problem has simply become too large for business owners to hide.