souppyer

Purpose

This app was built to develop my skills as a Python developer. At its core, this is a web scraper.

Installation

Built with Python3

1. Fork and clone
2. cd souppyer
3. Follow the virtualenv steps here
4. pip install -r requirements.txt
5. mkdir data
6. Open app.py and comment out the lines where instructed to
7. python app.py
8. Check out what you scraped data/data.txt

Issues

403 Forbidden

SSL: CERTIFICATE_VERIFY_FAILED

Tools

Beautiful Soup

virtualenv

Resources

20+ Web Scraping Examples

Automate the Boring Stuff

How to Work with virtualenv

Introduction to Web Scraping (with Python and Beautiful Soup)

License

MIT License