Scraping Your First Web Page with Python

This course covers the important tools for retrieving web content using HTTP libraries such as Requests, Httplib2 and Urllib, as well as powerful technologies for web parsing. These include Beautiful Soup, which is a popular library, and Scrapy, which is a powerful, production-grade framework.
Course info
Level
Beginner
Updated
Nov 5, 2019
Duration
2h 39m
Table of contents
Course Overview
Getting Started with Web Scraping
Working with the Parse Tree in BeautifulSoup
Selecting Elements Using the Scrapy Shell
Scraping Web Sites Using Scrapy Spiders
Description
Course info
Level
Beginner
Updated
Nov 5, 2019
Duration
2h 39m
Description

Web scraping is an important technique that is widely used as the first step in many workflows in data mining, information retrieval, and text-based machine learning. In this course, Scraping your First Web Page with Python, you will gain the ability to apply different scraping techniques including Beautiful Soup, and Scrapy. First, you will learn and use various HTTP client libraries such as Requests, httplib2, and urllib to download HTML content. Next, you will discover how Beautiful Soup is an extremely popular Python library that does better than regex in important ways. You will see how Beautiful Soup fixes up badly formed HTML, and constructs a nice parse tree that can be traversed and queried. Finally, you will add to your toolkit the knowledge of Scrapy, which is a full-fledged web scraping framework that combines the steps of retrieving and parsing web content and does so at production-scale. When you’re finished with this course, you will have the skills and knowledge to identify the relative strengths and use-cases of different web retrieval and scraping technologies such as regular expressions, Beautiful Soup, and Scrapy.

About the author
About the author

A problem solver at heart, Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework.

More from the author
More courses by Janani Ravi
Section Introduction Transcripts
Section Introduction Transcripts

Course Overview
[Autogenerated] Hi, My name is Johnny Ravi, and welcome to the scores on scraping your first webpage with bite on a little about myself. I have a master's degree in electrical engineering from Stanford and have worked at companies such as Microsoft, Google and Flip Card at Google was one of the first engineers working on real time collaborative editing in Google Dogs and I hold four patterns for its underlying technology's. I currently work on my own startup Lunatic on a studio for high quality video content. Web scraping is an important technique that is widely used as the first step in many were flows in data mining information retrieval on text based machine learning. In this course, you will gain the ability to apply difference creeping techniques, including beautiful soup on DSS. Creepy. First, you will learn and use various http client library, such as requests STD, be lip toe and you're a lib. Download HTML content. Next, you will discover how beautiful supers and extremely popular bite on library that does better than regular expressions. In important ways, you will see how beautiful soup fixes are badly formed. Html and constructs a nice parts tree that can be travels and credit. Finally, you'll act your pool kit the knowledge of Scree P, which is a full fledged Web scraping from book that combines the steps of retrieving and passing Web content and thus so at production skill. When you're finished with this course, you will have the skills and knowledge teau identify the relative strengths and use cases off different Web retrieval and scraping technologies such as regular expressions. Beautiful Soup on DS creepy.