Agroforestry Species Switchboard 2.0 Scraper
Scrape plants scientific name information from Species Switchboard 2.0.
Requirements
- python >= 3.10 (you can use pyenv for easier python version management)
- pipenv
How to run
- Install dependencies
cp env.sample .env pipenv --python 3 pipenv install
- Run
pipenv run python main.py
- The result will be placed in a file named
result.*.csv
Test Shell
pipenv run scrapy shell 'http://apps.worldagroforestry.org/products/switchboard/index.php/species_search/Acacia%20abyssinica'
Cleanup All Outputs
rm result.* && rm log.*
Special Cases
Case | Link | Note |
---|---|---|
ICRAF Databases Not Found | Engelhardia spicata | |
Genus Found | Forficula | What to do next? |
Multiple Species Found | Alstonia spectabilis | Get the matched species right? |
Species Variant Found | Engelhardtia spicata | Need human to check |
Similar Species Found | Costus speciosus | Need human to check |
Contributing
- Fork this repo
- Develop
- Create pull request
- Tag @rizqirizqi for review
- Merge~~
License
GPL-3.0