Python3 web crawler learning advice?

For example, the subject python is only familiar with numpy, scipy, matplotlib, and is used for scientific research. Recently, I have written several machine learning algorithms and want to go to the website to crawl some things for fun, because I may want to connect it to an automatic transaction program that I haven't finished, however, it is just a prototype and there is still a long way to go. But after thinking about it in the office for one afternoon, I found that web crawler is a big pitfall. What I know at this stage is that scrapy is not suitable for python3, so now I am just learning re as a question, python is only familiar with numpy, scipy, matplotlib, and is used for scientific research. Recently, I have written several machine learning algorithms and want to go to the website to crawl some things for fun, because I may want to connect it to an automatic transaction program that I haven't finished, however, it is just a prototype and there is still a long way to go.

However, after an afternoon in the office, I found that web crawlers are a big pitfall. At this stage, I learned that scrapy is not suitable for python3. So now I am only learning the requests and beautifulsoup packages. I would like to ask the web crawler experts if they have any recommended tutorials, teaching, blogs, or so. I really want to study them carefully here.

Thank you!