Just wanted to share that if you have not been to Target lately, around this time of year they stock the "dollar spot" with a decent amount of back to school enrichment supplies. They typically have an assortment of flashcards including all kinds of different species of wild animal cards, us presidents, math facts, and so on, although they are standard size cards (so not perfect for a tiny baby but manageable for a toddler or preschooler). They had encyclopedia knowledge short spiral bound books on Creepy Crawlies (rodents, roaches, fleas and ticks, etc), some books on community helpers, mini reading comprehension books, a us constitution book, and a variety of others. I sure there are some more things I am forgetting, but it's nice to check out and see if that have any odds and ends you might find useful for a very low price.
These blogs show a few examples of the things they have:
http://3.bp.blogspot.com/-irL60vroOqE/UcNVGiUCovI/AAAAAAAAFgw/DE9oEDKGAr4/s1600/photo+(1).JPGhttp://www.thepaceofitall.com/2012/07/13/target-dollar-spot-for-teachers-2/http://www.thepaceofitall.com/2013/05/07/teacher-tuesday-target-dollar-spot-finds/http://lh5.ggpht.com/-4M9LJT-1ohs/UXKHsQE5NCI/AAAAAAAAG6A/MNFhwbGwgwk/s1600-h/Slide2%25255B4%25255D.pngIf you are just starting out you may find some useful materials at your local Dollar Tree right now too. Many have a dedicated teacher area and they do a nice job filling it this time of year. You have to check the quality on what you're getting, but there are some deals to be had if they've got what you need and you're on a budget. Here's some of what they offer-- the word strips are nice for labeling everything in your house or using as word only flashcards, making sentences with them, etc. They have lots of hanging things too like calendars, etc.
http://www.dollartree.com/office-school/learning-educational/classroom-decorations/610c616c617/index.cat