Projects

Scrapy

Very popular web crawling and scraping framework for Python used to write spiders for crawling and extracting data from websites.

Dateparser

Python library to easily parse localized dates in almost any string format commonly found on web pages.

Python library to extract data from HTML and XML using XPath and CSS selectors.

Python library to translate CSS3 selectors into XPath 1.0 expressions.

Python library to parse natural language numbers.

Splash

Headless-browser framework for web crawling and scraping, specifically designed to act as an accessory for Scrapy crawlers, though it can be used as a stand-alone tool as well.

Scrapy plugin for transparent integration with Splash.

Python library for extracting embedded metadata from HTML markup.

Python library of web-related functions.

Collection of persistent, disk-based queues for Python.

Python library for extracting price and currency from raw text strings.

Convert Javascript code into an XML document.

Python library for extracting text from HTML.

Scrapy Download Handler which performs requests using Playwright.

Python library that helps you collect data from HTML and XML sources.

robots.txt parser with support for modern conventions.

Common interface to handle objects of different types in an uniform manner, regardless of their underlying implementation.