Webservice wrapper for hhursev/recipe-scrapers (python library to scrape recipes from websites)

Overview

recipe-scrapers-webservice

This is a wrapper for hhursev/recipe-scrapers which provides the api as a webservice, to be consumed as a microservice by other languages.

Usage

docker compose

version: "2.1"
services:
  recipe-scrapers-webservice:
    image: ghcr.io/steve192/recipe-scrapers-webservice
    container_name: recipe-scrapers-webservice
    ports:
      - 9090:9090
    restart: unless-stopped

docker cli

    docker run -d \
        --name=recipe-scrapers-webservice \
        -p 9090:9090 \
        --restart unless-stopped \
        ghcr.io/steve192/recipe-scrapers-webservice

Routes

/api/v1/scrape-recipe?url=
responds with

{
	"author": "AuthorHere",
	"category": "CategoryHere",
	"cook_time": "100",
	"cuisine": "French",
	"host": "recipehost.com",
	"imgage": "https://recipehost.com/image-for-recipe.jpg",
	"ingredients": ["10 g Ingredients1", "20g Ingredients2"],
	"instructions": "Instructions to the recipe\nSeparated by newlines",
	"language": "de",
	"links": [],
	"nutrients": {
		"calories": "631 kcal",
		"carbohydrateContent": "69 g",
		"fatContent": "26 g",
		"proteinContent": "14 g",
		"saturatedFatContent": "6 g",
		"servingSize": "504",
		"sodiumContent": "2 g",
		"sugarContent": "5 g"
	},
	"prep_time": "",
	"ratings": "",
	"title": "Title to a delicious recipe",
	"total_time": 30,
	"yields": "2 serving(s)"
}
Comments
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.25.0

    Adds support for:

    Thank you, @​brett @​NijeboerFrank!

    Commits
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.24.0

    Adds support for:

    • #679 - southerncastiron.com
    • #680 - handletheheat.com

    Fixes:

    • #661 - TypeError on mob.co.uk
    • #687 - Site updates for amazingribs.com

    Credits: @​brett @​jayaddison

    Commits
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.17.0

    build(deps): bump alpine from 3.15 to 3.17.0

    Bumps alpine from 3.15 to 3.17.0.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.16.3

    build(deps): bump alpine from 3.15 to 3.16.3

    Bumps alpine from 3.15 to 3.16.3.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.23.0

    Adds support for:

    • creativecanning.com
    • lecker.de
    • simply-cookit.com

    Removes support for:

    • sallys-blog.de

    Updates a bunch of preexisting scrapers with #676.

    Creds @​vabene1111 @​hhursev

    Commits
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • 2e58592 Fix lecker.de articles (#611)
    • fa31236 Reduce the amount of wording in the GitHub 'new issue' templates (#651)
    • fa61cf2 System health. Scrapers needed polishing (#676)
    • 1582886 Exclude macos and win py 3.11 from matrix again
    • 628b375 Use Python 3.11 in CI. Run macos and win w/ python 3.11 - don't mark whole jo...
    • 1d07ae9 Update README and bump version
    • 954c5c6 Issue 646/scraper weightwatchers (#657)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.21.0

    Housekeeping / development / maintenance release :broom:

    • Introduce tox as a standard mechanism to run isolated unit tests and linting workflows (#650)
    • Introduce pyproject.toml for project metadata (#655)
    • Remove the test_settings_module (#663)
    • Remove pytest and unittest-parallel development-time dependencies (#659, #660, 991b1d1784711bf1276ab74763e4e11c46649ee1)
    • Switch unit test scraper setup from per-test-method to per-test-case (#668)
    • Refactor the SchemaOrg parser (#671)
    • Fixup: incorrect start-URL in scraper test (b5f84adc0cfd2da2d645e43a321b39c7da10d4e8)

    This release should have little-to-no effect on usage of the library (it's intended to be backwards compatible) - however, bug / issue reports appreciated, as always!

    Commits
    • e23154a Bump version to 14.21.0
    • e7f7a90 Refactor: schema.org parser (#671)
    • 743d7cd Revert "Fixup: remove overwrite of schema.org data with 'mainEntity' contents...
    • aacd321 Modernization: introduce pyproject.toml for setuptools configuration (#655)
    • 2c3e0e8 Unit tests: move scraper construction from setUp (per-method) to setUpClass (...
    • b5f84ad Fixup: test-mode startURL for test_gousto
    • 557cfd9 Fixup: remove overwrite of schema.org data with 'mainEntity' contents during ...
    • d839b76 Cleanup: remove test_settings_module (#663)
    • 1526b32 Consolidate linting configuration (#662)
    • 991b1d1 Fixup / cleanup: remove unittest-parallel from tox.ini (related to f986c6ed6a...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.20.0

    • Remove META_HTTP_EQUIV setting (#644)
    • Remove TEST_MODE setting (#645)
    • Remove 'v12-like' settings module (#653)
    • Add omnivores cookbook (#647)
    • Add maangchi (#656)
    • Fix justonecookbook (#649)

    Thank you, @​wengtad!

    Commits
    • 93de8af Bump version to 14.20.0
    • 90a507a feat: add maangchi (#656)
    • df71ec3 fix: incomplete justonecookbook (#649)
    • cc913ac feat: add omnivores cookbook (#647)
    • 89a0a67 Cleanup: remove 'v12-like' settings module (#653)
    • 9321d9a Cleanup: remove TEST_MODE setting (#645)
    • cf7870f Cleanup: remove META_HTTP_EQUIV setting (#644)
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.19.0

    Fixes Recipe-scraper does not return the correct amount of ingredients for Hellofresh

    Commits
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • f0d45d0 Bump version to 14.18.0
    • b02a25a Bump version to 14.17.2
    • 6093969 import from dataclasses (#642)
    • 4326635 Add LeanAndGreenRecipes (#636)
    • e1bfb74 feat: add rosanna pansino (#639)
    • f55e235 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 860fb89 Bump version to 14.17.1
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.17.0

    This probably should've been 14.16.1 now that I think about it (bugfixes only, no new scrapers) - oops. We've not always adhered to that I suppose.

    • reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • Fixup to run unit tests on MacOS and Windows in GitHub Actions (#629)
    • mypy: ignore type union-attr errors in scraper modules, to deal with false positives from BeautifulSoup's find return type (e33181aef48f0aac6740edbf96055f2fec6c8eb2)

    Thanks @​vabene1111 for the reishunger improvements!

    Commits
    • a95d8ac Bump version to 14.17.0
    • 753c054 Refactor: remove use of 'while' loop (#634)
    • 5c033fb reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • f5c5ec1 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 401070d Workaround: install lxml from binary wheel when unit tests run on MacOS (#629)
    • e33181a Ignore union-attr mypy errors in scraper modules
    • 39fa50b Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • 754a316 Fixup for OS selection in GitHub Actions unittests workflow (#628)
    • 7d1cfad Bump version to 14.16.0
    • c477678 Fix ingredients for simplyrecipes.com scraper (#623)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.16.0

    • Fix ingredients for simplyrecipes.com scraper (#623)
    • Simple Veganista scraper added (#626)

    Thanks, @​thomaspinder @​puradox!

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.14.0

    Adds support for:

    • owen-han.com (#599)

    Includes fixes for:

    • greatbritishchefs - ingredients in subheadings (#598)
    • mobkitchen - domain name matching (#600)

    Thanks @​ptoczko @​ephemer4l!

    Commits
    • 3a3d2fd Bump version to 14.14.0
    • 3a57112 Added owen-han.com (#599)
    • a52e91e Add updated domain name for MobKitchen scraper (#600)
    • 9ecaec3 greatbritishchefs: handle case where ingredients are in subheaders (#598)
    • 348abb2 Bump version to 14.13.0. Food.com updates
    • a97807b removed unused imports in food.com scraper (#591)
    • 998a3ad Run tests against python 3.11 too and bump setup-python version (#586)
    • 4b5a51f Bump version to 14.12.0
    • 908c8f2 Add support for ica.se (#584)
    • 796a35a Add support for coop.se (#583)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.26.0

    Adds support for:

    • briceletbaklava.ch (#697)

    With credit to @​lacliq

    Commits
    • d673cae Bump version to 14.26.0
    • 472114b added briceletbaklava.ch (#697)
    • d882d1f GitHub Actions workflows: version-constrain 'tox' to less-than v4 (#702)
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
  • build(deps): bump alpine from 3.15 to 3.17

    build(deps): bump alpine from 3.15 to 3.17

    Bumps alpine from 3.15 to 3.17.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 0
  • build(deps): update flask requirement from ~=2.1 to ~=2.2

    build(deps): update flask requirement from ~=2.1 to ~=2.2

    Updates the requirements on flask to permit the latest version.

    Release notes

    Sourced from flask's releases.

    2.2.0

    This is a feature release, which includes new features and removes previously deprecated code. The 2.2.x branch is now the supported bug fix branch, the 2.1.x branch will become a tag marking the end of support for that branch. We encourage everyone to upgrade, and to use a tool such as pip-tools to pin all dependencies and control upgrades.

    Changelog

    Sourced from flask's changelog.

    Version 2.2.0

    Released 2022-08-01

    • Remove previously deprecated code. :pr:4337

      • Old names for some send_file parameters have been removed. download_name replaces attachment_filename, max_age replaces cache_timeout, and etag replaces add_etags. Additionally, path replaces filename in send_from_directory.
      • The RequestContext.g property returning AppContext.g is removed.
    • Update Werkzeug dependency to >= 2.2.

    • The app and request contexts are managed using Python context vars directly rather than Werkzeug's LocalStack. This should result in better performance and memory use. :pr:4682

      • Extension maintainers, be aware that _app_ctx_stack.top and _request_ctx_stack.top are deprecated. Store data on g instead using a unique prefix, like g._extension_name_attr.
    • The FLASK_ENV environment variable and app.env attribute are deprecated, removing the distinction between development and debug mode. Debug mode should be controlled directly using the --debug option or app.run(debug=True). :issue:4714

    • Some attributes that proxied config keys on app are deprecated: session_cookie_name, send_file_max_age_default, use_x_sendfile, propagate_exceptions, and templates_auto_reload. Use the relevant config keys instead. :issue:4716

    • Add new customization points to the Flask app object for many previously global behaviors.

      • flask.url_for will call app.url_for. :issue:4568
      • flask.abort will call app.aborter. Flask.aborter_class and Flask.make_aborter can be used to customize this aborter. :issue:4567
      • flask.redirect will call app.redirect. :issue:4569
      • flask.json is an instance of JSONProvider. A different provider can be set to use a different JSON library. flask.jsonify will call app.json.response, other functions in flask.json will call corresponding functions in app.json. :pr:4688
    • JSON configuration is moved to attributes on the default app.json provider. JSON_AS_ASCII, JSON_SORT_KEYS,

    ... (truncated)

    Commits
    • b17bb9e Merge pull request #4710 from pallets/release-2.2.0
    • 292c7e5 release version 2.2.0
    • f3bb9b2 Merge branch '2.1.x'
    • ac1bb97 Merge pull request #4721 from pallets/pre-commit-ci-update-config
    • cfd5783 Merge pull request #4722 from pallets/deprecate-config-attrs
    • bfdd371 deprecate config attributes
    • 6f9ef11 [pre-commit.ci] pre-commit autoupdate
    • 98ca00d Merge pull request #4720 from pallets/deprecate-env
    • 30427a2 remove FLASK_ENV from docs
    • ef95998 deprecate FLASK_ENV
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
Releases(v1.6.0)
Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX)

mcc-mnc.com-webscraper Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX) A Python script for web scraping mcc-mnc.com Link: mcc

Anton Ivarsson 1 Nov 07, 2021
Raspi-scraper is a configurable python webscraper that checks raspberry pi stocks from verified sellers

Raspi-scraper is a configurable python webscraper that checks raspberry pi stocks from verified sellers.

Louie Cai 13 Oct 15, 2022
An application that on a given url, crowls a web page and gets all words, sorts and counts them.

Web-Scrapping-1 An application that on a given url, crowls a web page and gets all words, sorts and counts them. Installation Using the package manage

adriano atambo 1 Jan 16, 2022
Meme-videos - Scrapes memes and turn them into a video compilations

Meme Videos Scrapes memes from reddit using praw and request and then converts t

Partho 12 Oct 28, 2022
Open Crawl Vietnamese Text

Open Crawl Vietnamese Text This repo contains crawled Vietnamese text from multiple sources. This list of a topic-centric public data sources in high

QAI Research 4 Jan 05, 2022
A leetcode scraper to compile all questions in leetcode free tier to text file. pdf also available.

A leetcode scraper to compile all questions in leetcode free tier to text file, pdf also available. if new questions get added, run again to get new questions.

3 Dec 07, 2021
此脚本为 python 脚本,实现原理为利用 selenium 定位相关元素,再配合点击事件完成浏览器的自动化.

此脚本为 python 脚本,实现原理为利用 selenium 定位相关元素,再配合点击事件完成浏览器的自动化.

N0el4kLs 5 Nov 19, 2021
A web crawler for recording posts in "sina weibo"

Web Crawler for "sina weibo" A web crawler for recording posts in "sina weibo" Introduction This script helps collect attributes of posts in "sina wei

4 Aug 20, 2022
A web Scraper for CSrankings.com that scrapes University and Faculty list for a particular country

A look into what we're building Demo.mp4 Prerequisites Python 3 Node v16+ Steps to run Create a virtual environment. Activate the virtual environment.

2 Jun 06, 2022
A high-level distributed crawling framework.

Cola: high-level distributed crawling framework Overview Cola is a high-level distributed crawling framework, used to crawl pages and extract structur

Xuye (Chris) Qin 1.5k Dec 24, 2022
河南工业大学 完美校园 自动校外打卡

HAUT-checkin 河南工业大学自动校外打卡 由于github actions存在明显延迟,建议直接使用腾讯云函数 特点 多人打卡 使用简单,仅需账号密码以及用于微信推送的uid 自动获取上一次打卡信息用于打卡 向所有成员微信单独推送打卡状态 完美校园服务器繁忙时造成打卡失败会自动重新打卡

36 Oct 27, 2022
Facebook Group Scraping Using Beautiful Soup & Selenium

Extract Facebook group posts that are related to a specific topic and write them to a .json file.

Fatima Ghadieh 14 Aug 12, 2022
Introduction to WebScraping Workshop - Semcomp 24 Beta

Extrair informações da internet de forma automatizada. Existem diversas maneiras de fazer isso, nesse tutorial vamos ver algumas delas, por meio de bibliotecas de python.

Luísa Moura 19 Sep 11, 2022
This tool can be used to extract information from any website

WEB-INFO- This tool can be used to extract information from any website Install Termux and run the command --- $ apt-get update $ apt-get upgrade $ pk

1 Oct 24, 2021
Kusonime scraper using python3

Features Scrap from url Scrap from recommendation Search by query Todo [+] Search by genre Example # Get download url from kusonime import Scrap

MhankBarBar 2 Jan 28, 2022
A Python web scraper to scrape latest posts from official Coinbase's Blog.

Coinbase Blog Scraper A Python web scraper to scrape latest posts from official Coinbase's Blog. IDEA It scrapes up latest blog posts from https://blo

Lucas Villela 3 Feb 18, 2022
Consulta de CPF e CNPJ na Receita Federal com Web-Scraping

Repositório contendo scripts Python que realizam a consulta de CPF e CNPJ diretamente no site da Receita Federal.

Josué Campos 5 Nov 29, 2021
优化版本的京东茅台抢购神器

优化版本的京东茅台抢购神器

1.8k Mar 18, 2022
Poolbooru gelscraper - a simple python script for scraping images off gelbooru pools.

poolbooru_gelscraper a simple python script for scraping images off gelbooru pools. modules required:requests_html, and os by default saves files with

savantshuia 1 Jan 02, 2022
Searching info from Google using Python Scrapy

Python-Search-Engine-Scrapy || Python-爬虫-索引/利用爬虫获取谷歌信息**/ Searching info from Google using Python Scrapy /* 利用 PYTHON 爬虫获取天气信息,以及城市信息和资料**/ translatio

HONGVVENG 1 Jan 06, 2022