Xerithane's Journal: Some new code, nfScraper

I had to write it up for a short-term contract, and it's pretty slick. I'm going to package it up and post it on nerdfarm tomorrow if anybody is interested.

It's an easily scriptable screen-scraper. I found the ones already existing just didn't have the ease of use that I was looking for. I needed a quick macro-based web-browser. You just pass it commands and it does it, but it is very picky about errors. Anything over 399 (404, 500) will just abort the script.

So, if you need a quick easy-to-control screenscraper, check out nerdfarm tomorrow. I would package it now, but it's running it's second major batch and I want to make sure it is still good through this before releasing it. The code is ugly, and should be re-written. I wasn't planning on having it be a release or a flexible system until I got more specs on the project so it just grew in a fashion of discord.

Screen-scraper?:)

[LPetrazickis]

Would a screen-scraper be something that creates an animation from a set of web-browser commands? I'm really at a loss here.^-^

Re:Screen-scraper?:)

[Xerithane]

A screen-scraper is basically an automated web-browser. It's looking for the data instead of the display, so you can match text, download files in batch jobs.

For instance, you could write a script to automatically post to Slashdot.

Re:Screen-scraper?:)

[sebi]

For instance, you could write a script to automatically post to Slashdot.

Because someone has to: That explains a lot.