Click here to Skip to main content
15,846,342 members
Please Sign up or sign in to vote.
1.00/5 (1 vote)
See more: (untagged)
hi there,
i've done a bunch of googling, but maybe i'm just using the wrong word. (not sure if it's actually called a "crawler", what I'd like to do)

here in germany there are several sites, which post travel deals, like [spam removed]

what i'd like to do is build a tool to "search" (or crawl?!) these websites and pick out only the deals (in this case "articles" because the websites just show articles/posts that link further) that pertain to departure airport in Berlin, and show these on a website.

is it a crawler that i'm looking to build, or how would one call such?

thanks a lot!
best,
zac
Posted
Updated 12-Jun-14 22:13pm
v2
Comments
Thanks7872 13-Jun-14 3:13am    
Don't mention site names like this. It is considered Spam here on Codeproject.com
Member 10881943 13-Jun-14 7:56am    
sorry! wasn't meant that way.
Richard MacCutchan 13-Jun-14 3:40am    
Yes, a web crawler. So what exactly is your question?
Member 10881943 13-Jun-14 7:56am    
Oh, spam? didn't know that. not meant to be!
Well, my question was more or less that, because when I was looking for "Tutorials" or so for crawlers (because i thought it was called a crawler but wasn't 100% sure) they were not really helping me further along.

Anyone know a good place to learn how to build one?!
Richard MacCutchan 13-Jun-14 9:06am    
Lots of things to learn, not all totally connected. You will need to do a lot of research, and learn how to 'find' things on the internet. There are plenty of articles here on CodeProject about the technical bits, but be prepared for a lot of hard work.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS


CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900