Articles under the label of Python

写在开始最近突发奇想想做一个爬取当前宿舍剩余电费的爬虫,至于原因嘛是因为我一个朋友半夜查电费发现没电了......热的一晚上没睡着觉......整体思路先打开山东理工大学后勤服务大厅的登录界面,然后输入人名和学号,然后找到学生宿舍用电查询,在里面输入校区和公寓楼号还有宿舍号,然后点击查询来查询,然后下面会返回一个现在的用电情况,以及剩余电量,抓出来就可以了写几个APIselenium.web...

Writing At FirstPython has a GIL so it can only use one core per process. So using multiprocessing can use more cores.About Python multiprocessing APIWhat I use is :multiprocessing.Process(target =...

Writing At FirstI think BeautifulSoup is easy to be used. And I will just say a little things about it.Installpip install beautifulsoup4UsingInitialsoup = BeautifulSoup(html) # input a html and its...

Writing At FirstBecause some website may ban ip if it do get very quickly or get big data flow for a long time. So mant times we will use proxy.How to use agent in the requestsWithout proxiesheader...

Writing At FirstThe requests default UA is:python-requests/2.11.1.But it is east to be find it is a web spider. So I try to use something to change it in order to make it more likes a normal user.H...