One skill a day: The latest version of Scrapy is not compatible with scrapy_redis
Original link: https://www.kingname.info/2023/08/20/scrapy-redis-no-crawler/ Many students use Scrapy + scrapy_redis to implement distributed crawlers when writing crawlers. However, scrapy_redis has been updated less and less in recent years, and it feels quite old. With many updates of Scrapy, scrapy_redis can no longer keep up. When you install Scrapy, if you do not specify a specific version, […]
One skill a day: The latest version of Scrapy is not compatible with scrapy_redis Read More »