Hacker Newsnew | past | comments | ask | show | jobs | submit | rouxrc's commentslogin

It might not be necessary to scrap anything since this data was finally released as OpenData last year: https://www.data.gouv.fr/fr/datasets/legi-codes-lois-et-regl...


i tried using this, but it seems it seems to be just a snapshot, not the full dataset with history (i wish i'm wrong, though)


Nioce job but it's too bad there's no licence and the building code is missing.

It's also not really new, Seb35 already did a great job on this previously as free software: - https://github.com/Seb35/CPI - https://github.com/Seb35/Archeo-Lex - http://blog.seb35.fr/billet/Arch%C3%A9o-Lex%2C-Pure-Histoire...

Also http://www.lafabriquedelaloi.fr proposes git versioning of the parliamlentary process for each bills: http://sunlightfoundation.com/blog/2014/06/25/opengov-voices...


Skeptical at first as well coming from the good ol curl/grep/sed backend scraping world, I changed my mind considering authentication issues and instructions saving: no more need to try and auth on complex websites via phantom without knowing what actually happens, I can just log in and see in my browser what I actually wanna scrape and still rerun it later as a script.

And I just loooove listening to artoo beep over and over ;)


@sytse Thanks! One of the display challenges for the git repositories was to display actual dates of the commits instead of the pushes since these commits have to be "simulated in the past" and gitlab was the perfect tool to do that. We hope to be able one day to consider each voted amendment as an individual commit as we did in a previous prototype <https://gitorious.org/law-is-code/demo_bill_hopital/commits/... but it happens to be a lot more complex than anticipated because diffs between two texts are in fact more than just what the voted amendments propose because of "legistic" modifications at each step. Maybe with another release ;)


Awesome, glad to hear that GitLab was a good tool for this. Please let us know if we can help in any way.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: