Click here to Skip to main content
15,611,613 members
Articles / Web Development / HTML
Posted 14 Sep 2018


12 bookmarked

Web Scraping - Learn The Fundamentals In 60 Minutes

Rate me:
Please Sign up or sign in to vote.
4.87/5 (5 votes)
14 Sep 2018CPOL2 min read
A free video course to learn the fundamentals of web scraping - usually missed by other sources!


One of the things I talk to the community about a lot and always get a good response to is the black-art of web scraping. As the world becomes more and more hungry for data, it seems that more often than not, the data we want can be found on a website somewhere. But how to get that data so you can change it the way you want and do something interesting with it and add value to it? This is where web scraping comes in.

Web scraping involves two core skills - obviously, some programming knowledge to get started, and the other arguably more important, is the ability to know how a website is built, to be able to identify where the data you want actually comes from. Is the data you need embedded on the page? (really?) or is it in a CSS file, a tangled up mess encoded in Java-script, or being generated based on a JSON feed from an AJAX call to an API somewhere. Web scraping at the start is less about programming and more about the investigation - this is something that a lot of folks who start to web scrape miss.

One of my most popular series of articles is all about web-scraping - sometimes, however, the text is not enough, and we need visual help to see what's going on. With this in mind, I have created a free webscraping course that teaches the fundamentals of web scraping - it will take you from knowing little about the subject to having a solid knowledge of what you need to do when you start web scraping.

Image 1

Most of the resources (both free and paid) I have come across assume the reader/student has more knowledge than they do - my aim with this course is to give you that important foundation knowledge, of course, for free :)

I am really enjoying the process of making courses (especially free ones) as a new way to pass skills and knowledge to others in the community - here is some of the amazing feedback I have received so far - I am delighted with it and it is the support of the community over the years that has allowed me to get to this stage.

"Finally, an instructor who knows how to teach students so that they are not lost or confused. Thank you!"

"Great course, wish I would have watched it before reading Python Scrapy documentation."

"I loved this course. It's a great introduction to web scraping! It's short, sweet and to the point!"

"Really impressed about theory and strategies to use... goes beyond my expectation"

If you want to learn the very fundamentals of web scraping - this is a great place to start, and it's free, and we like free:    

Free web scraping course link


  • 14/Sep/2018: Version 1


This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Written By
Chief Technology Officer The DataWorks
United Kingdom United Kingdom
Allen is a consulting architect with a background in enterprise systems. His current obsessions are IoT, Big Data and Machine Learning. When not chained to his desk he can be found fixing broken things, playing music very badly or trying to shape things out of wood. He runs his own company specializing in systems architecture and scaling for big data and is involved in a number of technology startups.

Allen is a chartered engineer, a Fellow of the British Computing Society, and a Microsoft MVP. He writes for CodeProject, C-Sharp Corner and DZone. He currently completing a PhD in AI and is also a ball throwing slave for his dogs.

Comments and Discussions

SuggestionWeb Scraping Legalities Pin
alexcoder9917-Sep-18 5:58
alexcoder9917-Sep-18 5:58 
Not intending this to be a criticism (and I haven't seen the full course, so you might cover this within) but just a comment with regards to Web scraping in general; I strongly feel that any content/article promoting/introducing Web scraping should prominently highlight that you need to be extremely careful when embarking on any Web scraping activities as in my experience, most Websites containing any data of value (particularly if they do not directly provide an API or download) have strict terms and conditions regarding the use of such data and it is very easy to find yourself in breach of their usage terms by Web scraping data without prior permission or agreement.
GeneralMy vote of 5 Pin
David A. Gray16-Sep-18 8:09
David A. Gray16-Sep-18 8:09 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.