Google Sitemap - An Idea
Not an earth shattering idea But if you have a reasonable number of web-pages, add an html comment to each file you want indexed. Something like this
Sitemap,monthly,0.5inside an html comment and then use a tool to do a recursive descent view of your site and identify which files are to be indexed, how often and priority. The last two values are optional.