爬虫案例—抓取腾牛网第一页图片列表里的图片src
源码如下
import requests
from lxml import etree
import re
headers = {
'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36'
}
url = 'https://www.qqtn.com/wm/meinvtp_1.html'
pattern = re.compile('.*?\.com')
# 提取url的首页地址
url1 = pattern.findall(url)[0]
# 获取请求第一页的响应
res = requests.get(url, headers=headers)
# 响应的编码设定为gb2312,否则后面提取title会出现乱码
res.encoding = 'gb2312'
content = res.text
tree = etree.HTML(content)
# 获取列表里的所有的超链接a标签
a_lst = tree.xpath('//ul[@class="g-gxlist-imgbox"]/li/a')
for a in a_lst:
# 获取图片列表的超链接
a_href = a.xpath('./@href')
new_res = requests.get(url1 + a_href[0], headers=headers)
new_tree = etree.HTML(new_res.text)
# 提取图片的详细页面的超链接
new_img_src_lst = new_tree.xpath('//div[@id="zoom"]/p/img/@src')
title = a.xpath('./@title')
print(title[0] + '图片SRC列表')
print(new_img_src_lst)结果如下：
/Library/Frameworks/Python.framework/Versions/3.9/bin/python3 /Users/bruce_liu/PycharmProjects/路飞/day04/requests/作业/腾牛图.py
漂亮女生微信朋友圈背景图片精选 遇见你我注定逃不掉了图片SRC列表
['https://pic.qqtn.com/up/2018-7/15317234456242780.jpg', 'https://pic.qqtn.com/up/2018-7/15317234459969206.jpg', 'https://pic.qqtn.com/up/2018-7/15317234452504957.jpg', 'https://pic.qqtn.com/up/2018-7/15317234459141111.jpg', 'https://pic.qqtn.com/up/2018-7/15317234459287916.jpg', 'https://pic.qqtn.com/up/2018-7/15317234467029539.jpg', 'https://pic.qqtn.com/up/2018-7/15317234466321882.jpg', 'https://pic.qqtn.com/up/2018-7/15317234462663160.jpg', 'https://pic.qqtn.com/up/2018-7/15317234467202711.jpg']
美到心碎的古风图片女2018最新 倾我一世繁华陪你看尽盛世烟火图片SRC列表
['https://pic.qqtn.com/up/2018-7/15314716005548856.jpg', 'https://pic.qqtn.com/up/2018-7/15314715968643843.jpg', 'https://pic.qqtn.com/up/2018-7/15314715968937452.jpg', 'https://pic.qqtn.com/up/2018-7/15314715965839582.jpg', 'https://pic.qqtn.com/up/2018-7/15314715964864683.jpg', 'https://pic.qqtn.com/up/2018-7/15314715994273893.jpg', 'https://pic.qqtn.com/up/2018-7/15314715995128355.jpg', 'https://pic.qqtn.com/up/2018-7/15314715995568769.jpg']
性感女生背景图片大全真实有个性 我在等一个人等一个未知数图片SRC列表
['https://pic.qqtn.com/up/2018-7/15313748826185377.jpg', 'https://pic.qqtn.com/up/2018-7/15313748821818998.jpg', 'https://pic.qqtn.com/up/2018-7/15313748821017270.jpg', 'https://pic.qqtn.com/up/2018-7/15313748825650892.jpg', 'https://pic.qqtn.com/up/2018-7/15313748821845365.jpg', 'https://pic.qqtn.com/up/2018-7/15313748827547956.jpg', 'https://pic.qqtn.com/up/2018-7/15313748821913068.jpg', 'https://pic.qqtn.com/up/2018-7/15313748828229246.jpg', 'https://pic.qqtn.com/up/2018-7/15313748884129423.jpg']
甜美小清新图片女生正能量 你说的对我的确是个迷人的妹图片SRC列表
['https://pic.qqtn.com/up/2018-7/15312962524927442.jpg', 'https://pic.qqtn.com/up/2018-7/15312962547167280.jpg', 'https://pic.qqtn.com/up/2018-7/15312962529440626.jpg', 'https://pic.qqtn.com/up/2018-7/15312962523271253.jpg', 'https://pic.qqtn.com/up/2018-7/15312962537381788.jpg', 'https://pic.qqtn.com/up/2018-7/15312962535179716.jpg', 'https://pic.qqtn.com/up/2018-7/15312962531106946.jpg', 'https://pic.qqtn.com/up/2018-7/15312962536768202.jpg', 'https://pic.qqtn.com/up/2018-7/15312962546339186.jpg']
个性另类的女生图片2018超火爆的 你的情话戳中我笑点啦图片SRC列表
['https://pic.qqtn.com/up/2018-7/15312773965500654.jpg', 'https://pic.qqtn.com/up/2018-7/15312773965794264.jpg', 'https://pic.qqtn.com/up/2018-7/15312773975124372.jpg', 'https://pic.qqtn.com/up/2018-7/15312773975832029.jpg', 'https://pic.qqtn.com/up/2018-7/15312773974977567.jpg', 'https://pic.qqtn.com/up/2018-7/15312773975512052.jpg', 'https://pic.qqtn.com/up/2018-7/15312773978169508.jpg', 'https://pic.qqtn.com/up/2018-7/15312773976486952.jpg', 'https://pic.qqtn.com/up/2018-7/15312773977875898.jpg']
好看的女生图片大全霸气潮流2018 做个恶魔吧没有感情自带杀气图片SRC列表
['https://pic.qqtn.com/up/2018-6/15295705277135832.jpg', 'https://pic.qqtn.com/up/2018-6/15295705262050397.jpg', 'https://pic.qqtn.com/up/2018-6/15295705266123167.jpg', 'https://pic.qqtn.com/up/2018-6/15295705266616316.jpg', 'https://pic.qqtn.com/up/2018-6/15295705263759321.jpg', 'https://pic.qqtn.com/up/2018-6/15295705277429441.jpg', 'https://pic.qqtn.com/up/2018-6/15295705273236234.jpg', 'https://pic.qqtn.com/up/2018-6/15295705277497145.jpg', 'https://pic.qqtn.com/up/2018-6/15295705274132032.jpg']
好看的女生图片伤感大全 喜欢你的这些日子就像一本病历图片SRC列表
['https://pic.qqtn.com/up/2018-6/15293955376305952.jpg', 'https://pic.qqtn.com/up/2018-6/15293955374329786.jpg', 'https://pic.qqtn.com/up/2018-6/15293955378722532.jpg', 'https://pic.qqtn.com/up/2018-6/15293955379576994.jpg', 'https://pic.qqtn.com/up/2018-6/15293955381122876.jpg', 'https://pic.qqtn.com/up/2018-6/15293955381149244.jpg', 'https://pic.qqtn.com/up/2018-6/15293955389735197.jpg', 'https://pic.qqtn.com/up/2018-6/15293955381630994.jpg', 'https://pic.qqtn.com/up/2018-6/15293955399133009.jpg']
好看的高清图片女生伤感大全 我可以用多少钱买走你的不快乐图片SRC列表
['https://pic.qqtn.com/up/2018-6/15288754503533689.jpg', 'https://pic.qqtn.com/up/2018-6/15288754507580091.jpg', 'https://pic.qqtn.com/up/2018-6/15288754506605192.jpg', 'https://pic.qqtn.com/up/2018-6/15288754508581358.jpg', 'https://pic.qqtn.com/up/2018-6/15288754502705594.jpg', 'https://pic.qqtn.com/up/2018-6/15288754507606459.jpg', 'https://pic.qqtn.com/up/2018-6/15288754506138410.jpg', 'https://pic.qqtn.com/up/2018-6/15288754508675428.jpg', 'https://pic.qqtn.com/up/2018-6/15288754505991606.jpg']
超伤感的女生图片背影侧脸大全 我不要爱情了我只想快乐图片SRC列表
['https://pic.qqtn.com/up/2018-6/15281021229033308.jpg', 'https://pic.qqtn.com/up/2018-6/15281021227738432.jpg', 'https://pic.qqtn.com/up/2018-6/15281021224934171.jpg', 'https://pic.qqtn.com/up/2018-6/15281021212092145.jpg', 'https://pic.qqtn.com/up/2018-6/15281021211971708.jpg', 'https://pic.qqtn.com/up/2018-6/15281021216044477.jpg', 'https://pic.qqtn.com/up/2018-6/15281021216898939.jpg', 'https://pic.qqtn.com/up/2018-6/15281021223932905.jpg', 'https://pic.qqtn.com/up/2018-6/15281021222397153.jpg']
好看的女生图片欧美风性感点的 车马很慢阳光很暖你很好看图片SRC列表
['https://pic.qqtn.com/up/2018-5/15270628469217741.jpg', 'https://pic.qqtn.com/up/2018-5/15270628456895231.jpg', 'https://pic.qqtn.com/up/2018-5/15270628457042036.jpg', 'https://pic.qqtn.com/up/2018-5/15270628467027067.jpg', 'https://pic.qqtn.com/up/2018-5/15270628466172605.jpg', 'https://pic.qqtn.com/up/2018-5/15270628461832593.jpg', 'https://pic.qqtn.com/up/2018-5/15270628464663221.jpg', 'https://pic.qqtn.com/up/2018-5/15270628461858960.jpg', 'https://pic.qqtn.com/up/2018-5/15270628464584119.jpg']
陈一发儿照片高清无水印 网上那些小姐姐长啥样图片SRC列表
['https://pic.qqtn.com/up/2018-5/15270359169756071.jpg', 'https://pic.qqtn.com/up/2018-5/15270359166003278.jpg', 'https://pic.qqtn.com/up/2018-5/15270359187720030.jpg', 'https://pic.qqtn.com/up/2018-5/15270359195446684.jpg', 'https://pic.qqtn.com/up/2018-5/15270359193790494.jpg', 'https://pic.qqtn.com/up/2018-5/15270359205934889.jpg', 'https://pic.qqtn.com/up/2018-5/15270359208351469.jpg', 'https://pic.qqtn.com/up/2018-5/15270359217881117.jpg', 'https://pic.qqtn.com/up/2018-5/15270359238355726.jpg']
图片2018伤感图片女生大全 你没如期归来这正是离别的意义图片SRC列表
['https://pic.qqtn.com/up/2018-5/15262903222358426.jpg', 'https://pic.qqtn.com/up/2018-5/15262903228140120.jpg', 'https://pic.qqtn.com/up/2018-5/15262903229943114.jpg', 'https://pic.qqtn.com/up/2018-5/15262903233758771.jpg', 'https://pic.qqtn.com/up/2018-5/15262903239807707.jpg', 'https://pic.qqtn.com/up/2018-5/15262903236589399.jpg', 'https://pic.qqtn.com/up/2018-5/15262903238004713.jpg', 'https://pic.qqtn.com/up/2018-5/15262903239273222.jpg', 'https://pic.qqtn.com/up/2018-5/15262903238900511.jpg']
2018小清新图片女生森系大全 可爱之人必遇可爱之事图片SRC列表
['https://pic.qqtn.com/up/2018-5/15260319955115583.jpg', 'https://pic.qqtn.com/up/2018-5/15260319957731703.jpg', 'https://pic.qqtn.com/up/2018-5/15260319952924909.jpg', 'https://pic.qqtn.com/up/2018-5/15260319952510862.jpg', 'https://pic.qqtn.com/up/2018-5/15260319952431760.jpg', 'https://pic.qqtn.com/up/2018-5/15260319955823240.jpg', 'https://pic.qqtn.com/up/2018-5/15260319953018979.jpg', 'https://pic.qqtn.com/up/2018-5/15260319953873441.jpg', 'https://pic.qqtn.com/up/2018-5/15260319952190885.jpg']
好看的小姐姐图片超可爱2018 这样的圆形刘海你敢剪么图片SRC列表
['https://pic.qqtn.com/up/2018-5/15257426901972394.jpg', 'https://pic.qqtn.com/up/2018-5/15257426906018797.jpg', 'https://pic.qqtn.com/up/2018-5/15257426904603483.jpg', 'https://pic.qqtn.com/up/2018-5/15257426902066465.jpg', 'https://pic.qqtn.com/up/2018-5/15257426908529448.jpg', 'https://pic.qqtn.com/up/2018-5/15257426907674986.jpg', 'https://pic.qqtn.com/up/2018-5/15257426912811887.jpg', 'https://pic.qqtn.com/up/2018-5/15257426918273603.jpg', 'https://pic.qqtn.com/up/2018-5/15257426913052762.jpg']
好看的女生图片小清新大全 愿你岁月风平衣襟带花图片SRC列表
['https://pic.qqtn.com/up/2018-4/15240412868012678.jpg', 'https://pic.qqtn.com/up/2018-4/15240412863619932.jpg', 'https://pic.qqtn.com/up/2018-4/15240412885681654.jpg', 'https://pic.qqtn.com/up/2018-4/15240412866476927.jpg', 'https://pic.qqtn.com/up/2018-4/15240412867399092.jpg', 'https://pic.qqtn.com/up/2018-4/15240412866864607.jpg', 'https://pic.qqtn.com/up/2018-4/15240412871948774.jpg', 'https://pic.qqtn.com/up/2018-4/15240412877022810.jpg', 'https://pic.qqtn.com/up/2018-4/15240412879921141.jpg']
2018图片大全唯美小清新女生 希望易来难走的不是肉而是你图片SRC列表
['https://pic.qqtn.com/up/2018-4/15239525007600553.jpg', 'https://pic.qqtn.com/up/2018-4/15239524971461118.jpg', 'https://pic.qqtn.com/up/2018-4/15239525003727323.jpg', 'https://pic.qqtn.com/up/2018-4/15239525017931929.jpg', 'https://pic.qqtn.com/up/2018-4/15239525012364744.jpg', 'https://pic.qqtn.com/up/2018-4/15239525019147703.jpg', 'https://pic.qqtn.com/up/2018-4/15239525026475279.jpg', 'https://pic.qqtn.com/up/2018-4/15239525026208036.jpg', 'https://pic.qqtn.com/up/2018-4/15239525021348508.jpg']
欧美图片女生霸气大全 世人皆有罪且无力自救图片SRC列表
['https://pic.qqtn.com/up/2018-3/15216194519602400.jpg', 'https://pic.qqtn.com/up/2018-3/15216194507426695.jpg', 'https://pic.qqtn.com/up/2018-3/15216194518533430.jpg', 'https://pic.qqtn.com/up/2018-3/15216194516436827.jpg', 'https://pic.qqtn.com/up/2018-3/15216194519267454.jpg', 'https://pic.qqtn.com/up/2018-3/15216194516609999.jpg', 'https://pic.qqtn.com/up/2018-3/15216194519188353.jpg', 'https://pic.qqtn.com/up/2018-3/15216194518774305.jpg', 'https://pic.qqtn.com/up/2018-3/15216194517946211.jpg']
女生图片大全2018最新清新高清 从梦里跑出来我还是长大了图片SRC列表
['https://pic.qqtn.com/up/2018-3/15215343809318541.jpg', 'https://pic.qqtn.com/up/2018-3/15215343805979795.jpg', 'https://pic.qqtn.com/up/2018-3/15215343802200635.jpg', 'https://pic.qqtn.com/up/2018-3/15215343802494245.jpg', 'https://pic.qqtn.com/up/2018-3/15215343806100233.jpg', 'https://pic.qqtn.com/up/2018-3/15215343802294706.jpg', 'https://pic.qqtn.com/up/2018-3/15215343819303572.jpg', 'https://pic.qqtn.com/up/2018-3/15215343815524412.jpg', 'https://pic.qqtn.com/up/2018-3/15215343812426542.jpg']
甜美女生图片小清新大全2018 我想做你的太阳不开心就晒你图片SRC列表
['https://pic.qqtn.com/up/2018-3/15212570602450574.jpg', 'https://pic.qqtn.com/up/2018-3/15212570609941191.jpg', 'https://pic.qqtn.com/up/2018-3/15212570602917356.jpg', 'https://pic.qqtn.com/up/2018-3/15212570592759153.jpg', 'https://pic.qqtn.com/up/2018-3/15212570592439176.jpg', 'https://pic.qqtn.com/up/2018-3/15212570592171933.jpg', 'https://pic.qqtn.com/up/2018-3/15212570597927259.jpg', 'https://pic.qqtn.com/up/2018-3/15212570606696516.jpg', 'https://pic.qqtn.com/up/2018-3/15212570595416609.jpg']
美女图片2018款最新欧美 弱水三千我只瓢你一个图片SRC列表
['https://pic.qqtn.com/up/2018-3/15210157677232374.jpg', 'https://pic.qqtn.com/up/2018-3/15210157678941298.jpg', 'https://pic.qqtn.com/up/2018-3/15210157672184705.jpg', 'https://pic.qqtn.com/up/2018-3/15210155465730955.jpg', 'https://pic.qqtn.com/up/2018-3/15210157673720457.jpg', 'https://pic.qqtn.com/up/2018-3/15210157685262663.jpg', 'https://pic.qqtn.com/up/2018-3/15210157684434568.jpg', 'https://pic.qqtn.com/up/2018-3/15210157689388167.jpg', 'https://pic.qqtn.com/up/2018-3/15210155469096068.jpg']
Process finished with exit code 0
