Are the public paying the price for free schools?

What is the justification for private schools to be given free-school status, thus saving the parents thousands a year in fees?