The public domain is an amazing resource for homeschooler, teachers and parents. There are so many sites out there organizing the public domain through electronic book formats, audio recordings, videos etc. All these sites are also free - supported through grants and donations.
Here are a few that I have found:
World Wide School
Book Should Be Free
International Children's Digital Library
LibriVox: acoustical liberation of books in the public domain