C#代码处理网页关于登录的code

作者：血饮狂龙
链接：https://www.zhihu.com/question/49452639/answer/117294801
来源：知乎
著作权归作者所有，转载请联系作者获得授权。

private string getHtml(string url) { HttpItem item = new HttpItem() { URL = url, Encoding = null, Accept = "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", KeepAlive = false, UserAgent = userAgent, Expect100Continue = true, Header = new WebHeaderCollection() { {"Accept-Encoding","gzip, deflate"}, {"Accept-Language","zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3"} } }; HttpResult result = http.GetHtml(item); return result.Html; } 

以上代码是再入一个普通网页的代码，采用get方法。下面再贴一段采用post方法的代码：

 private string postHtml(string url, string postData, string referer) { HttpItem item = new HttpItem() { URL = url, Encoding = null, Accept = "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", KeepAlive = true, ContentType = "application/x-www-form-urlencoded", Referer = referer, UserAgent = userAgent, Expect100Continue = false, Method = "POST", Postdata = postData, Header = new WebHeaderCollection() { {"Accept-Encoding","gzip, deflate"}, {"Accept-Language","zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3"} } }; HttpResult result = http.GetHtml(item); return result.Html; } 

上面这段代码一般用于登录之类的提交请求的动作，比如登录。
下面提供一点儿干货：
想学习爬虫的童鞋，你们一定要看看这个网站： [C#HttpHelper]官方产品发布与源码下载 苏菲论坛，这个人把登录网页封装起来用，很方便哟。
你需要用到的工具有：httpwatch或者fiddler抓取网页数据。
win10的亲们，你们需要被特别照顾一下，因为那蛋疼的ie并不兼容httpwatch。firefox或者chrome目前对插件也管控特别严，因此你们需要用到以下组合：
firefox 35.0b8+Httpwatch9.4.17