|Balhau 63931fc1db Clean stuff||1 year ago|
|scripts/scrapers||2 years ago|
|src||1 year ago|
|.gitignore||2 years ago|
|.gitlab-ci.yml||1 year ago|
|.travis.yml||5 years ago|
|LICENSE||5 years ago|
|README.md||2 years ago|
|pom.xml||2 years ago|
This project has as a main purpose provide a clean way to get important data from public services of Portuguese government and other organizations with civic and public interest in general.
Sometimes an api is a bit overkill if you just to tinker quickly with the data. With this in mind was created a new folder called scripts which will hold miscelaneous scripts to help ease the process of scrapping data.
For those scrips in which is used python you’ll need to ensure that python3 is being used. It is also advised to use the traditional
virtualenv .venv; source .venv/bin/activate
And ensure that everything is working by validating python version with
A small python script was developed as a first iteration which will help you scrape over BaseGov.pt data