Searching specific websites

freshfruit

I would like to a number of specific websites and output the matches as ONE page.

Say for example I want to search the irish times website and the irish independent and format the results as one page.
How would I go about this.

Are there prewritten scripting solutions for this kind of task?

mneylon

Interesting idea, but you might have to get in contact with the sites themselves first.
Google offers a 'search within domain', but that's really not what you are looking for.
Best thing you could do is look on HotScripts or SourceForge to see what's available.
What do you have access to? (Perl, PHP, C, ASP)

freshfruit

I am considering my options. I intend to develop in ASP as we want to link up SQL database.

mneylon

Which flavour of SQL? If you want to use MySQL, or Postgres then PHP might be a better option.

davros

That sounded like an interesting problem so I tried the following search string on Google:

robots site:www.stanford.edu OR site:www.mit.edu

What I got was robot pages from both MIT and Stanford. Sounds like what you want.