Now, which tool should you use for your project? In a nutshell, go with BeautifulSoup if you want to speed up development or if you just want to familiarize yourself with Python and web scraping. With Scrapy, demanding web scraping applications can be implemented in Python – provided you have the appropriate know-how. Use Selenium if your primary goal is to scrape dynamic content with Python.

I’m sharpening my Python skills on web scraping and I found this tutorial from techwithtim.