一、爬取目标
二、完整源码
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
#
# Copyright (c) 2024 愤怒的it男, All Rights Reserved.
# FileName : code.py
# Date : 2024.01.21
# Author : 愤怒的it男
# Version : 1.0.0
# Node : 欢迎关注微信公众号【愤怒的it男】
#
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
import csv
import json
import requests
from tabulate import tabulate
def getData(baseUrl, headers):
response = requests.get(url=baseUrl, headers=headers)
data = json.loads(response.text)['data']
result = []
for i in data['realtime']:
link = 'https://s.weibo.com/weibo?q=%23{}%23'.format(i['word'])
result.append([i['rank'],i['label_name'],i['word'],i['category'],link])
return result
def printData(result):
headers = ["排名", "标签", "标题", "分类", "链接"]
table = tabulate(result, headers=headers, maxcolwidths=[None, None, None, 50], tablefmt='grid')
print(table)
def saveData(result):
with open('微博热搜.csv', 'w', encoding='utf-8', newline='') as file:
writer = csv.writer(file)
writer.writerows(result)
def main():
baseUrl = 'https://weibo.com/ajax/side/hotSearch'
headers = {'Referer': 'https://www.mi.com/',
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}
result = getData(baseUrl, headers)
printData(result)
saveData(result)
if __name__== "__main__" :
main()
三、爬取结果
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 排名 | 标签 | 标题 | 分类 | 链接 |
+========+========+======================================+===============+========================================================================+
| 0 | 新 | 关于六寸蛋糕放5斤车厘子这件事 | 幽默 | https://s.weibo.com/weibo?q=%23关于六寸蛋糕放5斤车厘子这件事%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 1 | 热 | 微信红包并非转账认定赠与无需返还 | 社会新闻 | https://s.weibo.com/weibo?q=%23微信红包并非转账认定赠与无需返还%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 2 | 新 | 当江浙沪遇上了古诗词 | 社会新闻 | https://s.weibo.com/weibo?q=%23当江浙沪遇上了古诗词%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 3 | 新 | 勇敢的人先加王一博微信 | 综艺 | https://s.weibo.com/weibo?q=%23勇敢的人先加王一博微信%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 4 | 新 | 徕芬 | 网红 | https://s.weibo.com/weibo?q=%23徕芬%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 5 | 热 | 十三年怎么就抵不过三年了 | 剧集 | https://s.weibo.com/weibo?q=%23十三年怎么就抵不过三年了%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 6 | 新 | 砂糖橘摆成了我吃不起的样子 | 美食 | https://s.weibo.com/weibo?q=%23砂糖橘摆成了我吃不起的样子%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 7 | | 考完研后才知道家里有五层别墅 | 幽默 | https://s.weibo.com/weibo?q=%23考完研后才知道家里有五层别墅%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 8 | 热 | 苏增添被查 | 社会新闻 | https://s.weibo.com/weibo?q=%23苏增添被查%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 9 | 新 | 成毅提裙跑 | 作品衍生 | https://s.weibo.com/weibo?q=%23成毅提裙跑%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 10 | 新 | 金莎首次上节目回应比男友大19岁 | 综艺 | https://s.weibo.com/weibo?q=%23金莎首次上节目回应比男友大19岁%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 11 | | 0713春晚联排13进9 | 综艺 | https://s.weibo.com/weibo?q=%230713春晚联排13进9%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 12 | 新 | 阿娇阿Sa真亲了吗 | 演出 | https://s.weibo.com/weibo?q=%23阿娇阿Sa真亲了吗%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 13 | 新 | 文旅局长张大大同框喊麦宣传吉林 | 旅游 | https://s.weibo.com/weibo?q=%23文旅局长张大大同框喊麦宣传吉林%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 14 | 新 | 肖战高奢全球合约汇总 | 艺人 | https://s.weibo.com/weibo?q=%23肖战高奢全球合约汇总%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 15 | | 要久久爱收视率 | 剧集 | https://s.weibo.com/weibo?q=%23要久久爱收视率%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 16 | 新 | 公交车上踩掉大爷的新鞋 | 幽默 | https://s.weibo.com/weibo?q=%23公交车上踩掉大爷的新鞋%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 17 | 新 | 女孩把馒头做成带馅的1天卖500个 | 社会新闻 | https://s.weibo.com/weibo?q=%23女孩把馒头做成带馅的1天卖500个%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 18 | | 原来骑手不知道顾客能看见他全名 | 幽默 | https://s.weibo.com/weibo?q=%23原来骑手不知道顾客能看见他全名%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 19 | | 长沙下雪 | 社会新闻 | https://s.weibo.com/weibo?q=%23长沙下雪%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 20 | 新 | 薛之谦新手机壳 | 艺人 | https://s.weibo.com/weibo?q=%23薛之谦新手机壳%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 21 | | 迪丽热巴婴儿时期旧照 | 艺人 | https://s.weibo.com/weibo?q=%23迪丽热巴婴儿时期旧照%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 22 | | 官方通报大学生夜游网红火车站严重烧伤 | 社会新闻 | https://s.weibo.com/weibo?q=%23官方通报大学生夜游网红火车站严重烧伤%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 23 | 新 | 当女朋友知道我有强迫症后 | 幽默 | https://s.weibo.com/weibo?q=%23当女朋友知道我有强迫症后%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 24 | | 懂得人性才能谈好恋爱 | 情感 | https://s.weibo.com/weibo?q=%23懂得人性才能谈好恋爱%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 25 | 新 | 若华官配 | 剧集 | https://s.weibo.com/weibo?q=%23若华官配%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 26 | 新 | 没见过这么社死的女主角 | 剧集 | https://s.weibo.com/weibo?q=%23没见过这么社死的女主角%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 27 | 暖 | 东北谷爱凌竟是52岁单身奶奶 | 社会新闻 | https://s.weibo.com/weibo?q=%23东北谷爱凌竟是52岁单身奶奶%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 28 | | 杨紫范丞丞情头 | 作品衍生,综艺 | https://s.weibo.com/weibo?q=%23杨紫范丞丞情头%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 29 | | 白鹿跳舞了 | 音乐 | https://s.weibo.com/weibo?q=%23白鹿跳舞了%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 30 | 新 | 不敢想象高中毕业后我是怎么走到今天的 | 情感 | https://s.weibo.com/weibo?q=%23不敢想象高中毕业后我是怎么走到今天的%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 31 | | 男子撸走1岁半幼儿金镯获刑9个月 | 社会新闻 | https://s.weibo.com/weibo?q=%23男子撸走1岁半幼儿金镯获刑9个月%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 32 | | 俞灏明 春晚 | 综艺 | https://s.weibo.com/weibo?q=%23俞灏明 春晚%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 33 | | 俞敏洪回应新东方留不住人才 | 互联网 | https://s.weibo.com/weibo?q=%23俞敏洪回应新东方留不住人才%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 34 | 新 | 蓝亦菲在关超婚礼上出现了 | 剧集 | https://s.weibo.com/weibo?q=%23蓝亦菲在关超婚礼上出现了%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 35 | 新 | CBA裁判 | 体育 | https://s.weibo.com/weibo?q=%23CBA裁判%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 36 | | 蒋翼出现那刻偶像剧弱爆了 | 剧集 | https://s.weibo.com/weibo?q=%23蒋翼出现那刻偶像剧弱爆了%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 37 | 暖 | 女儿接农村妈妈进城3个月后变化惊人 | 社会新闻 | https://s.weibo.com/weibo?q=%23女儿接农村妈妈进城3个月后变化惊人%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 38 | 新 | 过年回村焦虑症 | 情感 | https://s.weibo.com/weibo?q=%23过年回村焦虑症%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 39 | 新 | 国产三蹦子魅力传到外国 | 社会新闻 | https://s.weibo.com/weibo?q=%23国产三蹦子魅力传到外国%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 40 | 新 | 辽宁男篮 | 体育 | https://s.weibo.com/weibo?q=%23辽宁男篮%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 41 | | 年轻人为何不愿去银行工作了 | 社会新闻 | https://s.weibo.com/weibo?q=%23年轻人为何不愿去银行工作了%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 42 | | 吃饭有这4个习惯或会被癌症盯上 | 健康医疗 | https://s.weibo.com/weibo?q=%23吃饭有这4个习惯或会被癌症盯上%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 43 | 暖 | 原来萌兰这么大只啊 | 社会新闻 | https://s.weibo.com/weibo?q=%23原来萌兰这么大只啊%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 44 | | 鹿晗女粉丝为偶像赴深圳见C罗 | 体育,艺人 | https://s.weibo.com/weibo?q=%23鹿晗女粉丝为偶像赴深圳见C罗%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 45 | 新 | 要久久爱 | 剧集 | https://s.weibo.com/weibo?q=%23要久久爱%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 46 | | 许凯痛失真名 | 剧集 | https://s.weibo.com/weibo?q=%23许凯痛失真名%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 47 | 新 | 书瑶 徕芬 | 网红 | https://s.weibo.com/weibo?q=%23书瑶 徕芬%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 48 | 新 | 陈泽直播 | 游戏,网红 | https://s.weibo.com/weibo?q=%23陈泽直播%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
| 49 | 新 | 杨瀚森受伤 | 体育 | https://s.weibo.com/weibo?q=%23杨瀚森受伤%23 |
+--------+--------+--------------------------------------+---------------+------------------------------------------------------------------------+
四、免责声明
本公众号所有源码均为个人学习所编写，仅可用于计算机技术学习及研究等合法行为，禁止利用本公众号的源码从事任何违反本国（地区）法律法规的业务，如有发现存在违法违规行为我会举报到网监部门。
原文始发于微信公众号（愤怒的it男）：新闻神器！Python实时爬取微博热搜
版权声明：本文内容由互联网用户自发贡献，该文观点仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 举报，一经查实，本站将立刻删除。
文章由极客之音整理，本文链接：https://www.bmabk.com/index.php/post/234402.html
