Comments on: Getting full contents for partial feeds https://grey-panther.net/2009/02/getting-full-contents-for-partial-feeds.html Just another WordPress site Fri, 07 Aug 2009 08:27:32 +0000 hourly 1 https://wordpress.org/?v=6.9 By: Dario https://grey-panther.net/2009/02/getting-full-contents-for-partial-feeds.html#comment-304 Fri, 07 Aug 2009 08:27:32 +0000 https://grey-panther.net/?p=404#comment-304 Thanks for the reply. I'm develop a app to get the ads from the google result page, so, it isn't possible at all with pipes or ajax api. I will continue making some multi server requests 😉

]]> By: Cd-MaN https://grey-panther.net/2009/02/getting-full-contents-for-partial-feeds.html#comment-315 Thu, 30 Jul 2009 07:19:13 +0000 https://grey-panther.net/?p=404#comment-315 @Dario: yes, Yahoo Pipes respects the robots.txt file, and it is very good that it does. As for getting back search results: I would recommend the Google Search AJAX API's, since it is officially supported and it returns the search results in a machine-readable format (JSON), which saves you the hassle of writing a parser and living in fear that the page format changes and your parser breaks.

The disadvantage is that you must (as per the TOS) use the results on a webpage (ie you can't do mass requests for back-office processing).

]]> By: Darío https://grey-panther.net/2009/02/getting-full-contents-for-partial-feeds.html#comment-316 Wed, 29 Jul 2009 18:44:30 +0000 https://grey-panther.net/?p=404#comment-316 Great article. Do you know how I can parse a entire google result page?. The yahoo pipes claim "Can't fetch pages that robots.txt disallow".

Thanks

]]>