Package: python3-scrapy (2.11.1-1)

[ Source: python-scrapy  ]

Python web scraping and crawling framework (Python 3)

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

This package provides the scrapy module for Python 3.

Other Packages Related to python3-scrapy

• dep: python3

  interactive high-level object-oriented language (default python3 version)

• dep: python3-cryptography (>= 36.0.0)

  Python library exposing cryptographic recipes and primitives (Python 3)

• dep: python3-cssselect

  cssselect parses CSS3 Selectors and translates them to XPath 1.0

• dep: python3-itemadapter

  Common interface for data container classes (Python 3)

• dep: python3-itemloaders

  Library to populate items using XPath and CSS with a convenient API (Python 3)

• dep: python3-lxml

  pythonic binding for the libxml2 and libxslt libraries

• dep: python3-openssl

  Python 3 wrapper around the OpenSSL library

• dep: python3-packaging

  core utilities for python3 packages

• dep: python3-parsel (>= 1.8.1)

  Python 3 library to extract HTML/XML data using XPath/CSS selectors

• dep: python3-pkg-resources

  Package Discovery and Resource Access using pkg_resources

• dep: python3-protego

  Pure-Python robots.txt parser with support for modern conventions

• dep: python3-pydispatch

  Python 3 signal dispatching mechanism

• dep: python3-queuelib

  collection of persistent (disk-based) queues (Python 3)

• dep: python3-service-identity

  Service identity verification for pyOpenSSL (Python 3 module)

• dep: python3-tldextract

  Python library for separating TLDs

• dep: python3-twisted

  Event-based framework for internet applications

• dep: python3-w3lib

  Collection of web-related functions (Python 3)

• dep: python3-zope.interface

  Interfaces for Python3

• rec: ipython3

  Enhanced interactive Python 3 shell

• rec: python3-brotli

  lossless compression algorithm and format (Python 3 version)

• rec: python3-pil

  Python Imaging Library (Python3)

• sug: python-scrapy-doc (= 2.11.1-1)

  Python web scraping and crawling framework documentation

• sug: python3-boto3

  Python interface to Amazon's Web Services - Python 3.x

• sug: python3-botocore

  Low-level, data-driven core of boto 3 (Python 3)

Download python3-scrapy

Download for all available architectures

Architecture	Package Size	Installed Size	Files
all	253.1 kB	1,052.0 kB	[list of files]