"Big Data Collection and Crawlers" mainly explains how to use Python to write web crawler programs. The content includes Python environment construction, basic syntax of Python, basic crawler knowledge, basic network knowledge, commonly used crawler libraries and parsing libraries, data persistent storage, Web API and asynchronous data crawling technology, the usage of Selenium and ChromeDriver, and the basic principles and operations of the Scrapy crawler framework. Finally, a comprehensive case of web crawler is introduced to consolidate the knowledge learned previously.
"Big Data Collection and Crawlers" is suitable as a textbook for big data technology and application majors in higher vocational colleges. It is also suitable for readers who have some Python programming experience and are interested in crawler technology.
Reader comments
The content is detailed and the cases are rich. The part like "Usage of Selenium and ChromeDriver" is very practical. Reminds me of "Python Web Crawler Practice", which is also a good crawler book. There is a sentence in it that impressed me deeply: "Web crawling is an efficient way to obtain information." Both books are suitable for novices.
The content is detailed and the cases are rich. The part like "Usage of Selenium and ChromeDriver" is very practical. Reminds me of "Python Web Crawler Practice", which is also a good crawler book. There is a sentence in it that impressed me deeply: "Web crawling is an efficient way to obtain information." Both books are suitable for novices.