Dependencies
The WordHoard package has these core external dependencies:
backoff
The Python package backoff is used in conjunction with deckar01-ratelimit. The primary function of this module is to provide function decorators which can be used to wrap a function such that it will be retried until some condition is met.
Beautiful Soup
The Python package Beautiful Soup is used to find and parse predefined content from a website related to a news article or from an HTML (HyperText Markup Language) file.
certifi
The Python package certifi is a carefully curated collection of Root Certificates for validating the trustworthiness of SSL certificates while verifying the identity of TLS hosts. This module is a required dependency of the Python library requests.
charset-normalizer
The Python package charset-normalizer is used for language detection from an unknown charset encoding. This module is a required dependency of the Python library requests.
click
The Python package click is used to create command line interfaces. This module is a required dependency of the Python library deepl.
cloudscraper
The Python package cloudscraper is used to bypass websites being protected by Cloudflare's nti-bot protection system. This package has these core dependencies: certifi, charset-normalizer, idna, pyparsing, requests, requests-toolbelt, and urllib3.
deckar01-ratelimit
The Python package ratelimit is used to limit the number of queries to a specific website for a predefined time period. This rate limiting helps to reduce the possibility of a website blocking your IP address for aggressive behavior when requesting multiple articles in succession. This rate limiting is configurable in WordHoard, but the timeout period for violating a rate limit is not configurable.
deepl
The Python package deepl is used for language translation. The package is a wrapper for the DeepL API, which requires an account, which can be either a paid subscription or free one with specific limitation, such as monthly character limits. This package has these core dependencies: certifi, charset-normalizer, idna, requests, and urllib3.
idna
The Python package idna exposes the Internationalised Domain Names in Applications (IDNA) protocol as specified in RFC 5891, which is used for encoding and decoding. This module is a required dependency of the Python library requests.
lxml
The Python package lxml is used for processing XML data. For example the function lxml.html.clean.Cleaner is used to remove unwanted tags and content types from an HTML document. This module is a required dependency of the Python library Beautiful Soup.
pyparsing
The Python package pyparsing provides a library of classes that client code uses to construct the grammar directly in Python code. This module is a required dependency of the Python library cloudscraper.
requests
The Python package requests is the de facto standard for making HTTP requests in Python.
requests-toolbelt
The Python package requests-toolbelt is a collection of tools that can be used by the Python package requests. This module is a required dependency of the Python library cloudscraper.
Soup Sieve
The Python package Soup Sieve is CSS selector library. This module is a required dependency of the Python library Beautiful Soup.
urllib3
The Python package urllib3 is a powerful, user-friendly HTTP client for Python. This module is a required dependency of the Python libraries requests and cloudscraper.