最新资讯发布日期:2021-02-21
在python中用爬虫再用到代理服务器,有两个办法,第一种接在布署该python爬虫的电脑上设置代理服务器,第二种就是用一些库支持简单的BM代理服务器连接。下面为大家详细介绍python中设置ip代理的详细内容。
实现代码:
import requests headers = { 'Referer': 'https://www.baidu.com', # 伪装成从CSDN博客搜索到的文章 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.75 Safari/537.36' # 伪装成浏览器 } #设置代理ip proxies = { "http":"http://115.159.31.195:8080" } params={ 'wd':'ip地址' } response = requests.request('get', "https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&ch=5&tn=98010089_dg&wd=IP%E5%9C%B0%E5%9D%80&oq=python%25E7%2588%25AC%25E8%2599%25AB%25E4%25B8%25AD%25E7%259A%2584ip%25E4%25BB%25A3%25E7%2590%2586%25E8%25AE%25BE%25E7%25BD%25AE&rsv_pq=823b58a500018356&rsv_t=7c6fTg5nHBZ1%2FD0Isvs0AhKi78NbBaZFMg%2FX%2B%2B9lEIwMcQJDUWhTLFBURNG00Zy1lh8&rqlang=cn&rsv_enter=1&rsv_dl=tb&rsv_sug3=11&rsv_sug1=7&rsv_sug7=101&rsv_sug2=0&inputT=6885&rsv_sug4=6885",proxies = proxies,headers = headers,params=params) print(response.text) with open('ip.html','w',encoding='utf-8') as f: f.write(response.text)
直接复制到python中就可以直接进行运行了,非常简单,希望可以帮助到大家哦~
专属客服竭诚为您服务