一、爬取目标
二、完整源码
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
#
# Copyright (c) 2024 愤怒的it男, All Rights Reserved.
# FileName : code.py
# Date : 2024.01.22
# Author : 愤怒的it男
# Version : 1.0.0
# Node : 欢迎关注微信公众号【愤怒的it男】
#
#""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
import csv
import json
import requests
from tabulate import tabulate
def getData(baseUrl, headers):
response = requests.get(url=baseUrl, headers=headers)
data = json.loads(response.text)['data']
result = []
for i,d in enumerate(data):
index = str(i+1)
title = d['Title']
label = d['Label']
url = d['Url']
result.append([index,title,label,url])
return result
def printData(result):
headers = ["排名", "标题", "标签", "链接"]
table = tabulate(result, headers=headers, maxcolwidths=[None, None, None, 80], tablefmt='grid')
print(table)
def saveData(result):
with open('头条热榜.csv', 'w', encoding='utf-8', newline='') as file:
writer = csv.writer(file)
writer.writerows(result)
def main():
baseUrl = 'https://www.toutiao.com/hot-event/hot-board/?origin=toutiao_pc'
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}
result = getData(baseUrl, headers)
printData(result)
saveData(result)
if __name__== "__main__" :
main()
三、爬取结果
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 排名 | 标题 | 标签 | 链接 |
+========+==================================+==============+==================================================================================+
| 1 | 应急管理部部长赴云南山体滑坡现场 | hot | https://www.toutiao.com/trending/7326782201008734243/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%222%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326782201008734243%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%221%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E5%BA%94%E6%80%A5%E7%AE%A1%E7%90%86%E9%83%A8%E9%8 |
| | | | 3%A8%E9%95%BF%E8%B5%B4%E4%BA%91%E5%8D%97%E5%B1%B1%E4%BD%93%E6%BB%91%E5%9D%A1%E7% |
| | | | 8E%B0%E5%9C%BA%22%7D&rank=1&style_id=40132&topic_id=7326782201008734243 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 2 | 唐山打人案保护伞马爱军获刑12年 | hot | https://www.toutiao.com/trending/7326209470705926196/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%222%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326209470705926196%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%222%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E5%94%90%E5%B1%B1%E6%89%93%E4%BA%BA%E6%A1%88%E4%B |
| | | | F%9D%E6%8A%A4%E4%BC%9E%E9%A9%AC%E7%88%B1%E5%86%9B%E8%8E%B7%E5%88%9112%E5%B9%B4%2 |
| | | | 2%7D&rank=2&style_id=40132&topic_id=7326209470705926196 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 3 | 大山里的“超级充电宝” | | https://www.toutiao.com/article/7326741290912350739 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 4 | 云南镇雄发生山体滑坡47人被埋 | hot | https://www.toutiao.com/trending/7326732326904758309/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%222%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326732326904758309%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%224%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E4%BA%91%E5%8D%97%E9%95%87%E9%9B%84%E5%8F%91%E7%9 |
| | | | 4%9F%E5%B1%B1%E4%BD%93%E6%BB%91%E5%9D%A147%E4%BA%BA%E8%A2%AB%E5%9F%8B%22%7D&rank |
| | | | =4&style_id=40132&topic_id=7326732326904758309 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 5 | 国足今天出线还是回家 | vote | https://www.toutiao.com/trending/7326469768016297995/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%224%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326469768016297995%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%225%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E5%9B%BD%E8%B6%B3%E4%BB%8A%E5%A4%A9%E5%87%BA%E7%B |
| | | | A%BF%E8%BF%98%E6%98%AF%E5%9B%9E%E5%AE%B6%22%7D&rank=5&style_id=40132&topic_id=73 |
| | | | 26469768016297995 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 6 | 国常会：采取更有力有效措施稳市场 | | https://www.toutiao.com/trending/7326881104743874586/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%226%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326881104743874586%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%226%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E5%9B%BD%E5%B8%B8%E4%BC%9A%EF%BC%9A%E9%87%87%E5%8 |
| | | | F%96%E6%9B%B4%E6%9C%89%E5%8A%9B%E6%9C%89%E6%95%88%E6%8E%AA%E6%96%BD%E7%A8%B3%E5% |
| | | | B8%82%E5%9C%BA%22%7D&rank=6&style_id=40132&topic_id=7326881104743874586 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 7 | 美媒称“中国游客消失” | | https://www.toutiao.com/trending/7326422863819309108/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%220%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326422863819309108%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%227%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E7%BE%8E%E5%AA%92%E7%A7%B0%E2%80%9C%E4%B8%AD%E5%9 |
| | | | B%BD%E6%B8%B8%E5%AE%A2%E6%B6%88%E5%A4%B1%E2%80%9D%22%7D&rank=7&style_id=40132&to |
| | | | pic_id=7326422863819309108 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 8 | 哈马斯首次承认“犯错了” | | https://www.toutiao.com/trending/7326737945778946088/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%226%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326737945778946088%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%228%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E5%93%88%E9%A9%AC%E6%96%AF%E9%A6%96%E6%AC%A1%E6%8 |
| | | | 9%BF%E8%AE%A4%E2%80%9C%E7%8A%AF%E9%94%99%E4%BA%86%E2%80%9D%22%7D&rank=8&style_id |
| | | | =40132&topic_id=7326737945778946088 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 9 | 申万宏源否认江疏影雪球爆仓 | hot | https://www.toutiao.com/trending/7323361328456863268/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%221%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227323361328456863268%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%229%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A% |
| | | | 2240132%22%2C%22title%22%3A%22%E7%94%B3%E4%B8%87%E5%AE%8F%E6%BA%90%E5%90%A6%E8%A |
| | | | E%A4%E6%B1%9F%E7%96%8F%E5%BD%B1%E9%9B%AA%E7%90%83%E7%88%86%E4%BB%93%22%7D&rank=9 |
| | | | &style_id=40132&topic_id=7323361328456863268 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
| 10 | 男子造谣“敬老院虐待老人”被拘7天 | refuteRumors | https://www.toutiao.com/trending/7326796046855503935/?category_name=topic_innerf |
| | | | low&event_type=hot_board&log_pb=%7B%22category_name%22%3A%22topic_innerflow%22%2 |
| | | | C%22cluster_type%22%3A%222%22%2C%22enter_from%22%3A%22click_category%22%2C%22ent |
| | | | rance_hotspot%22%3A%22outside%22%2C%22event_type%22%3A%22hot_board%22%2C%22hot_b |
| | | | oard_cluster_id%22%3A%227326796046855503935%22%2C%22hot_board_impr_id%22%3A%2220 |
| | | | 2401222218110CF11B59C11B26D3DE94%22%2C%22jump_page%22%3A%22hot_board_page%22%2C% |
| | | | 22location%22%3A%22news_hot_card%22%2C%22page_location%22%3A%22hot_board_page%22 |
| | | | %2C%22rank%22%3A%2210%22%2C%22source%22%3A%22trending_tab%22%2C%22style_id%22%3A |
| | | | %2240132%22%2C%22title%22%3A%22%E7%94%B7%E5%AD%90%E9%80%A0%E8%B0%A3%E2%80%9C%E6% |
| | | | 95%AC%E8%80%81%E9%99%A2%E8%99%90%E5%BE%85%E8%80%81%E4%BA%BA%E2%80%9D%E8%A2%AB%E6 |
| | | | %8B%987%E5%A4%A9%22%7D&rank=10&style_id=40132&topic_id=7326796046855503935 |
+--------+----------------------------------+--------------+----------------------------------------------------------------------------------+
四、免责声明
本公众号所有源码均为个人学习所编写，仅可用于计算机技术学习及研究等合法行为，禁止利用本公众号的源码从事任何违反本国（地区）法律法规的业务，如有发现存在违法违规行为我会举报到网监部门。
原文始发于微信公众号（愤怒的it男）：Python实时采集今日头条热榜（完整源码）
版权声明：本文内容由互联网用户自发贡献，该文观点仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 举报，一经查实，本站将立刻删除。
文章由极客之音整理，本文链接：https://www.bmabk.com/index.php/post/234353.html
