Blog

Thoughts on AI, software, and life. Short notes and long-form writing.

Sort by

Scrapy Review: Engine, Scheduler, Downloader, Spider, Pipeline, and Selectors

Scrapy is not just an HTML parser. It is a full crawling framework for request scheduling, downloading, parsing, pipelines, and middleware.