一、爬取目标
二、完整源码
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
#
# Copyright (c) 2024 愤怒的it男, All Rights Reserved.
# FileName : code.py
# Date : 2024.01.24
# Author : 愤怒的it男
# Version : 1.0.0
# Node : 欢迎关注微信公众号【愤怒的it男】
#
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
import csv
import json
from lxml import etree
import requests
from tabulate import tabulate
def getData(url, headers, pn):
response = requests.get(url=url, headers=headers)
dataList = json.loads(response.text)['data']['list']
result = []
for i,d in enumerate(dataList):
index = (pn-1)*50+i+1
title = d['title']
tname = d['tname']
owner = d['owner']['name']
view = d['stat']['view']
favorite = d['stat']['favorite']
coin = d['stat']['coin']
share = d['stat']['share']
like = d['stat']['like']
dislike = d['stat']['dislike']
pub_location = d['pub_location'] if 'pub_location' in d else '-'
link = 'https://www.bilibili.com/video/{}/'.format(d['bvid'])
result.append([index,title,tname,owner,view,favorite,coin,share,like,pub_location,link])
return result
def printData(result):
headers = ["排名", "标题", "分类", "作者", "播放量", "收藏量", "投币量", "分享量", "喜欢量", "发布位置", "链接"]
table = tabulate(result, headers=headers, maxcolwidths=[None, 20, None, None,None, None, None, None, None, None, 20], tablefmt='grid')
print(table)
def saveData(result):
with open('B站综合热门.csv', 'w', encoding='utf-8', newline='') as file:
writer = csv.writer(file)
writer.writerows(result)
def main():
baseUrl = 'https://api.bilibili.com/x/web-interface/popular?ps=50&pn={}'
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}
result = []
for pn in range(1,11):
url = baseUrl.format(pn)
data = getData(url, headers, pn)
result = result + data
printData(result)
saveData(result)
if __name__== "__main__" :
main()
三、爬取结果
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 排名 | 标题 | 分类 | 作者 | 播放量 | 收藏量 | 投币量 | 分享量 | 喜欢量 | 发布位置 | 链接 |
+========+======================+================+=========================+==========+==========+==========+==========+==========+============+======================+
| 1 | 赵本山：小品不是用来 | 影视杂谈 | 花袭人拳打镇关西 | 1344112 | 34639 | 85566 | 6980 | 118938 | 山东 | https://www.bilibili |
| | 教育人的…… | | | | | | | | | .com/video/BV1mK411a |
| | | | | | | | | | | 7v6/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 2 | 卷 | 小剧场 | 脱缰凯Kk | 425197 | 4675 | 4785 | 571 | 62056 | 辽宁 | https://www.bilibili |
| | | | | | | | | | | .com/video/BV16T4y1b |
| | | | | | | | | | | 7hj/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 3 | 好笑么？用命换的 | 搞笑 | 逗比的雀巢 | 8420078 | 263614 | 624841 | 47143 | 818585 | 四川 | https://www.bilibili |
| | | | | | | | | | | .com/video/BV1aT4y1h |
| | | | | | | | | | | 71M/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 4 | 王牌特工魂穿异世纨绔 | 国产动画 | 哔哩哔哩国创 | 561312 | 1299 | 1222 | 395 | 3926 | 上海 | https://www.bilibili |
| | ，废柴超爽开挂逆袭 | | | | | | | | | .com/video/BV1Yb4y1A |
| | | | | | | | | | | 7UC/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 5 | 你好我是MrBeast野兽 | 日常 | MrBeast官方账号 | 5131140 | 108689 | 138074 | 23776 | 490817 | 北京 | https://www.bilibili |
| | 先生我来B站了！ | | | | | | | | | .com/video/BV1Nw411E |
| | | | | | | | | | | 7MW/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 6 | 这是人我直接吃 | 鬼畜调教 | 如此丶呆逼 | 1080428 | 27418 | 51325 | 19414 | 129180 | 浙江 | https://www.bilibili |
| | | | | | | | | | | .com/video/BV1VC4y1k |
| | | | | | | | | | | 7vN/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 7 | 《崩坏：星穹铁道》美 | 手机游戏 | 崩坏星穹铁道 | 1405608 | 21054 | 42836 | 39909 | 151922 | 上海 | https://www.bilibili |
| | 梦预告PV：「了不起的 | | | | | | | | | .com/video/BV1VC4y1k |
| | 塔塔洛夫」 | | | | | | | | | 7dy/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 8 | 纸飞机可以去任何地方 | 搞笑 | 宋云生- | 4907830 | 48413 | 366794 | 2988 | 926998 | 河南 | https://www.bilibili |
| | ，你也是！ | | | | | | | | | .com/video/BV16T4y1h |
| | | | | | | | | | | 7if/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 9 | 有 个 简 单 的 问 题 | 日常 | 四九九舅 | 573558 | 48631 | 21390 | 12265 | 148227 | 上海 | https://www.bilibili |
| | | | | | | | | | | .com/video/BV1kk4y1D |
| | | | | | | | | | | 7GZ/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 10 | 奢靡、淫乱、暴政，却 | 人文历史 | 木鱼水心 | 152513 | 6698 | 15312 | 332 | 25269 | 北京 | https://www.bilibili |
| | 创造了中华第一盛世！ | | | | | | | | | .com/video/BV1s64y1P |
| | | | | | | | | | | 7MB/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 11 | 这是一张看不见的床！ | 单机游戏 | 幕川北 | 265775 | 2195 | 869 | 216 | 27742 | 广东 | https://www.bilibili |
| | | | | | | | | | | .com/video/BV1GW4y1c |
| | | | | | | | | | | 7Nr/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 12 | 谁能理清本片的人物关 | 小剧场 | 妈妈再灭我一次 | 3049085 | 29376 | 14456 | 26134 | 216283 | 北京 | https://www.bilibili |
| | 系？ | | | | | | | | | .com/video/BV1ge411n |
| | | | | | | | | | | 7Uy/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 13 | 教会他爱的是黑魔导【 | 桌游棋牌 | 水无月菌 | 1085132 | 20837 | 77181 | 9865 | 124115 | 上海 | https://www.bilibili |
| | 水无月菌】 | | | | | | | | | .com/video/BV1pT4y1b |
| | | | | | | | | | | 7sR/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 14 | 不是实验做不起，造假 | 社科·法律·心理 | 耿同学讲故事 | 779348 | 12773 | 54576 | 8537 | 91043 | 北京 | https://www.bilibili |
| | 更具性价比！学术造假 | | | | | | | | | .com/video/BV1aw411E |
| | 被发现不亏，不被发现 | | | | | | | | | 7wy/ |
| | 血赚，所以请给我一个 | | | | | | | | | |
| | 不学术造假的理由！ | | | | | | | | | |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 15 | IU回归先行曲Love | MV | pcyxjy | 815544 | 22644 | 10404 | 29510 | 58385 | 广东 | https://www.bilibili |
| | wins all MV公开 | | | | | | | | | .com/video/BV13C4y1k |
| | | | | | | | | | | 7ph/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 16 | 《明日方舟》生息演算 | 手机游戏 | 明日方舟 | 298378 | 4485 | 10308 | 10360 | 36143 | 上海 | https://www.bilibili |
| | 「沙洲遗闻」玩法介绍 | | | | | | | | | .com/video/BV1qN4y1H |
| | | | | | | | | | | 74W/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 17 | [植物大战僵尸] | 单机游戏 | 北窗遥望 | 4639902 | 213699 | 439068 | 114305 | 664267 | 新西兰 | https://www.bilibili |
| | 自制关卡 胆小菇之梦 | | | | | | | | | .com/video/BV1ZT4y18 |
| | | | | | | | | | | 75k/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 18 | 《植物娘大战僵尸》角 | 单机游戏 | 庄不纯 | 503365 | 11704 | 9483 | 6014 | 51965 | 江苏 | https://www.bilibili |
| | 色演示—大蒜娘 | | | | | | | | | .com/video/BV15K411Y |
| | | | | | | | | | | 7Qt/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 19 | 茶之巅，傲世间，有我 | 搞笑 | 我天亮了才睡 | 1542404 | 23563 | 3819 | 14920 | 176682 | 江西 | https://www.bilibili |
| | 茶帝便有天。 | | | | | | | | | .com/video/BV1Ab4y1N |
| | | | | | | | | | | 7Y5/ |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
| 20 | [SPECIAL VIDEO] | 音乐现场 | SEVENTEEN | 331057 | 39519 | 44706 | 12269 | 68625 | 北京 | https://www.bilibili |
| | SEVENTEEN - | | | | | | | | | .com/video/BV1Zc411e |
| | 相遇的意义 | | | | | | | | | 75Y/ |
| | @SEVENTEEN TOUR | | | | | | | | | |
| | ‘FOLLOW’ TO MACAO | | | | | | | | | |
+--------+----------------------+----------------+-------------------------+----------+----------+----------+----------+----------+------------+----------------------+
四、免责声明
本公众号所有源码均为个人学习所编写，仅可用于计算机技术学习及研究等合法行为，禁止利用本公众号的源码从事任何违反本国（地区）法律法规的业务，如有发现存在违法违规行为我会举报到网监部门。
原文始发于微信公众号（愤怒的it男）：Python实时采集B站热门作品（标题|播放|点赞|投币|分享|收藏|链接等）
版权声明：本文内容由互联网用户自发贡献，该文观点仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 举报，一经查实，本站将立刻删除。
文章由极客之音整理，本文链接：https://www.bmabk.com/index.php/post/234296.html
