This lesson covers web scraping: what it is, when you would use it, how to be a good digital citizen, tools for web scraping, and finally, a hands-on example using Python. The hands-on example focuses on scraping United States government websites, but the concepts covered apply to anywhere on the web.
Prerequisites
Basic knowledge of html.
The commands in this lesson pertain to Python 3.
| Setup | Download files required for the lesson | |
| 00:00 | 1. Introduction |
What is web scraping?
Why would I want to web scrape? What issues might I encounter web scraping? |
| 00:25 | 2. Ethics of Web Scraping | When is it okay to web scrape? |
| 00:35 | 3. HTTP, Browser Extensions, and APIs | How do I web scrape? |
| 00:45 | 4. Web Scraping with Python | How do I web scrape with Python? |
| 01:15 | Finish |
The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.