Marco/Bundescrawler
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
34 commits 1 branch 0 tags 221 KiB
Find a file
Marco Lents fb38bb5894 generate descriptive commit messages by diffing against previous run 
Loads the previous raw.json before saving, compares against current
crawl, and generates commit messages listing: new/departed representatives,
party changes, new disclosures, and total profiles updated.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-13 22:37:50 +02:00
.gitignore add egg-info to gitignore 2025-11-13 21:56:53 +01:00
crawler.py generate descriptive commit messages by diffing against previous run 2026-04-13 22:37:50 +02:00
flake.lock add dev environment 2025-11-13 18:22:58 +01:00
flake.nix add dev environment 2025-11-13 18:22:58 +01:00
pyproject.toml pin versions of dependencies 2025-12-02 10:44:03 +01:00
Readme.md add Readme 2025-12-02 09:20:33 +01:00

Readme.md

Bundescrawler

This repository contains the scraper (I just liked the name Bundescrawler), which collects the available information from the sites of the representatives of the German Parlament.

How to use

  • Clone the repository
  • Install the dependencies with pip install .
  • Initialize a repository somewhere where you want to save the information.
  • Run python3 crawler.py -o <output directory>