powerschool webscraper?

[David Rysdam]

Bill Freeman <ke1g.nh at gmail.com> writes:
> Not that I know of an existing tool (BeautifulSoup probably doesn't deal
> with the JavaScript), but it seems like you want to capture the eventual
> DOM.  You need something that you can trigger when the page has
> settled. 

Nope. I thought this too, but it's not true. I have absolutely no
compunction about actually parsing the HTML--I would just grep for
whatever keyword worked and jam a POST in the web form for my
username/password, BeautifulSoup be damned.

However, it's something else. I can't think of the term now, but it
isn't a matter finding something in the page I can use. I have to
actually simulate a web browser to run the Javascript so I communicate
with the server and get the right security tokens and whatever.