Scraping Dynamic Web Pages with Python 3 and Selenium

What you'll learn

There are many ways to collect data, one of which is extracting the tons of data swimming around in the form of websites. However, gathering and analyzing data from dynamic websites can be frustrating, especially when essential information is only available after interacting with web elements. In this course, Scraping Dynamic Web Pages with Python 3 and Selenium, you'll gain the ability to efficiently extract data from dynamically-rendered web pages. First, you'll explore how to understand and navigate dynamic web pages using Selenium WebDriver, as well as how to record, replay, and customize user activity sessions to interact with web elements effectively. Next, you'll discover how to manage wait times, locate elements, and navigate complex web pages with various types of selectors. Then, you'll dive into parsing HTML using Beautiful Soup and applying best practices for web scraping. Finally, you'll learn how to implement a real estate property scraper project, putting all the acquired skills into practice. When you're finished with this course, you'll have the skills and knowledge of web scraping with Python and Selenium needed to efficiently extract valuable data from dynamically-rendered web pages.

Table of contents