Sunday, August 31, 2008

Progress report

The code has been uploaded to Google Code last Friday. I am still working out the bugs in the parsing code. Parsing Wikipedia was more complicated than I thought -- there are all sorts of corner cases regarding the formatting of links and redirects and such. I am also still learning the ropes of the sqlalchemy library.


Parsing is very time intensive. Instead of taking the 3-4 hours I had originally estimated, it looks like it will more likely take around 12-24 hours. Since this is too long of a time to lose use of my laptop, I am going to try to run it on RPI's computers instead.

No comments: