python2
import urllib2
url = http://www.baidu.com/
request = urllib2.Request(url)
response = urllib2.urlopen(request)
print(response.read())python3
from urllib import request
url = http://www.baidu.com/
req = request.Request(url)
response = request.urlopen(req)
print(response.read().decode()我們開啟fiddler,運(yùn)行完成代碼,然后在fiddler上面查看下我們的數(shù)據(jù)
很明顯就是python的版本,
因此我們?cè)趯W(xué)習(xí)爬蟲的時(shí)候無(wú)論爬什么,代碼最好都要加上這個(gè)頭信息
下面我們?cè)诖a上加入一個(gè)頭
from urllib import request
headers = {
User-Agent:Mozilla/5.0 (Windows NT 10.0; WOW64
}
url = http://www.baidu.com/
req = request.Request(url,headers=headers)
response = request.urlopen(req)
print(response.read().decode())抓包的結(jié)果如下:
更多關(guān)于云服務(wù)器，域名注冊(cè)，虛擬主機(jī)的問(wèn)題，請(qǐng)?jiān)L問(wèn)西部數(shù)碼官網(wǎng)：m.ps-sw.cn
