python爬取淘宝商品销量信息

Aba ·

更新时间:2024-11-13

· 545 次阅读

python爬取淘宝商品销量的程序，运行程序，输入想要爬取的商品关键词，在代码中的‘###'可以进一步约束商品的属性，比如某某作者的书籍，可以在###处输入作者名字，以及时期等等。最后可以得到所要商品的总销量


import requests
import bs4
import re
import json
def open(keywords, page):
   headers={"User-Agent":"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36"}
   payload = {'q':keywords, 'sort':"sale-desc", 's':(page-1)*44}
   url = "https://s.taobao.com/search"
   res = requests.get(url, params = payload)
   return res
def get_item(res):
   g_page_config = re.search(r'g_page_config = (.*?);\n', res.text)
   page_config_json = json.loads(g_page_config.group(1))
   page_item = page_config_json['mods']['itemlist']['data']['auctions']
   result = []#整理出我们关注的信息(ID,标题，链接，售价，销量和商家)
   for each in page_item:
      dict1 = dict.fromkeys(('id','title','link','price','sale','shoper'))
      dict1['id'] = each['nid']
      dict1['title'] = each['title']
      dict1['link'] = each['detail_url']
      dict1['price'] = each['view_price']
      dict1['sale'] = each['view_sales']
      dict1['shoper'] = each['nick']
      result.append(dict1)
   return result
def count_sales(items):
   count = 0
   for each in items:
      if '###' in each['title']:#规定只取标题中‘###'的商品
         count += int(re.search(r'\d+',each['sale']).group())
   return count
def main():
   keywords = input("请输入搜索关键词：")#可以为各种商品名称
   length = 10#淘宝商品页数
   total = 0
   for each in range(length):
      res = open(keywords, each+1)
      items = get_item(res)
      total += count_sales(items)#销售总量
   print(total)
if __name__ == "__main__":
   main()

您可能感兴趣的文章:Python爬虫爬取新浪微博内容示例【基于代理IP】利用Python爬取微博数据生成词云图片实例代码Python实现的爬取百度文库功能示例Python3实现爬取简书首页文章标题和文章链接的方法【测试可用】Python3爬虫爬取英雄联盟高清桌面壁纸功能示例【基于Scrapy框架】通过抓取淘宝评论为例讲解Python爬取ajax动态生成的数据(经典)python爬取网站数据保存使用的方法Python实现爬取知乎神回复简单爬虫代码分享python爬虫实战之爬取京东商城实例教程Python爬虫：通过关键字爬取百度图片Python实现爬取马云的微博功能示例

淘宝淘宝商品 Python

1024 个赞