The Hypertext Transfer Protocol (HTTP) allows information to be exchanged between a web server and a web browser. C# allows you to program HTTP directly. HTTP programming allows you to create programs that access the web much like a human user would. These programs, which are called bots, can collect information or automate common web programming tasks. This book presents a collection of very reusable recipes for C# bot programming. This book covers many topics related to C# HTTP programming. Both secure and insecure HTTP communications are covered, as well as HTTP authentication. Learn to interact with HTTP forms and support both HTTP POST and HTTP GET requests. Collect data from a wide array of HTML constructs, such as tables, and lists. Learn about advanced topics that complicate the life of a bot, such as AJAX and Javascript. Also learn about the ethical use of bots, and when bots should not be used. This book also introduces the Heaton Research Spider. The Heaton Research Spider is an open source spider framework. Using the Heaton Research Spider you can create spiders that will crawl a web site, much like a real spider crawls the web. The Heaton Research Spider is available in both Java and Microsoft Dot Net form.
| |||||||||||||||
Book Description
Frequently Bought Together
Product Details
Would you like to update product info or give feedback on images?
|
More About the Author
Jeff Heaton is an author, consultant, artificial intelligence (AI) researcher and former college instructor. Heaton has penned more than a dozen books on topics including AI, virtual worlds, spiders and bots. Heaton leads the Encog project, an open source initiative to provide an advanced neural network and bot framework for Java and C#. A Sun Certified Java Programmer and a Senior Member of the IEEE, he holds a Masters Degree in Information Management from Washington University in St. Louis. Heaton lives in St. Louis, Missouri.
Customer Reviews
Most Helpful Customer Reviews
3 of 3 people found the following review helpful
Format:Paperback
I've had this book for a few months and it is the best published bot book.
It tells you need to know about the http protocol to extract data from a site which use javascript and ajax! The parsing libraries are very help, though some tweaking is always necessary given the magnitude of sites.
If you need to write a bot, but don't know how, this book it for you.
It tells you need to know about the http protocol to extract data from a site which use javascript and ajax! The parsing libraries are very help, though some tweaking is always necessary given the magnitude of sites.
If you need to write a bot, but don't know how, this book it for you.
1 of 1 people found the following review helpful
Format:Paperback|Amazon Verified Purchase
I was looking for something not necessarily to make bots but analyze webpages and do automated searches. I found the information I needed here, plus learned a lot of tips if I ever wanted to make a serious bot.
It mixes theory and practical application very well. I would think if you were writing a serious in depth bot this would be the bible for doing so. It has many examples of the concepts it discusses. It talked a bit over my head in some areas but it's a great book. The author clearly knows the subject very well.
I did have a hard time with some of the code getting it to work, but I don't blame the book. The examples were set up in such a way that I could figure it out and make it run.
I think this author mainly sells books by word of mouth, which is how I found it, which probably explains why there aren't many reviews for it. Don't let that sway you, this is a great book.
It mixes theory and practical application very well. I would think if you were writing a serious in depth bot this would be the bible for doing so. It has many examples of the concepts it discusses. It talked a bit over my head in some areas but it's a great book. The author clearly knows the subject very well.
I did have a hard time with some of the code getting it to work, but I don't blame the book. The examples were set up in such a way that I could figure it out and make it run.
I think this author mainly sells books by word of mouth, which is how I found it, which probably explains why there aren't many reviews for it. Don't let that sway you, this is a great book.
1 of 3 people found the following review helpful
Format:Paperback
the author website do not have his last spider in dotnet, only java
and the source code of his spider is only available in java.
but even tough, the recipes are helpful and save time.
to get the most of this book you needs to be a self-learner.
and the source code of his spider is only available in java.
but even tough, the recipes are helpful and save time.
to get the most of this book you needs to be a self-learner.
Inside This Book
(learn more)
First Sentence:
This book shows how to create HTTP programs in C#. Read the first page Key Phrases - Statistically Improbable Phrases (SIPs): (learn more)
programming recipes, multipart post, comes before the desired, multipart response, bot access, hybrid bot, comes after the desired, public void process, marking workload, parse object, workload manager, spider encounters, spider object, recipes site, grabbing information, method downloads, simple web server, spider class, int depth, server headers, download method, search spider, typical web page, new byte, extract function Key Phrases - Capitalized Phrases (CAPs): (learn more)
Recipes Test Site, Hello World, Internet Explorer, Rots Figure, Document Object Model, Searching Google, Internet Protocol, Add Reference, Microsoft Access, Bots Figure, Done Internet, Keep-Alive Cache-Control, New Request, Red Hat Linux, Rots Console, Set Cookie, Src Port New!
Books on Related Topics | Concordance | Text Stats Browse Sample Pages:
Front Cover | Table of Contents | First Pages | Index | Back Cover | Surprise Me!
This book shows how to create HTTP programs in C#. Read the first page Key Phrases - Statistically Improbable Phrases (SIPs): (learn more)
programming recipes, multipart post, comes before the desired, multipart response, bot access, hybrid bot, comes after the desired, public void process, marking workload, parse object, workload manager, spider encounters, spider object, recipes site, grabbing information, method downloads, simple web server, spider class, int depth, server headers, download method, search spider, typical web page, new byte, extract function Key Phrases - Capitalized Phrases (CAPs): (learn more)
Recipes Test Site, Hello World, Internet Explorer, Rots Figure, Document Object Model, Searching Google, Internet Protocol, Add Reference, Microsoft Access, Bots Figure, Done Internet, Keep-Alive Cache-Control, New Request, Red Hat Linux, Rots Console, Set Cookie, Src Port New!
Books on Related Topics | Concordance | Text Stats Browse Sample Pages:
Front Cover | Table of Contents | First Pages | Index | Back Cover | Surprise Me!
Books on Related Topics
(learn more)
|
|
What Other Items Do Customers Buy After Viewing This Item?
Suggested Tags from Similar Products(What's this?)Be the first one to add a relevant tag (keyword that's strongly related to this product).
|
Sell a Digital Version of This Book in the Kindle Store
If you are a publisher or author and hold the digital rights to a book, you can sell a digital version of it in our Kindle Store.
Learn more
Listmania!
|
|
