解决python多线程报错:AttributeError: Cant pickle local object问题

Rachel ·
更新时间:2024-09-21
· 732 次阅读

报错信息:

Traceback (most recent call last):
File “D:/flaskProject/test.py”, line 35, in test
pool.apply(self.out, args=(i,))
File “Python37-32\lib\multiprocessing\pool.py", line 261, in apply
return self.apply_async(func, args, kwds).get()
File "\lib\multiprocessing\pool.py”, line 657, in get
raise self._value
File “\Python37-32\lib\multiprocessing\pool.py", line 431, in _handle_tasks
put(task)
File "\Python37-32\lib\multiprocessing\connection.py”, line 206, in send
self._send_bytes(_ForkingPickler.dumps(obj))
File “*\Python37-32\lib\multiprocessing\reduction.py”, line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: can't pickle _thread._local objects

原类的构造函数:

class threadtest: def __init__(self, ipList, user, password): self.ipList = ipList self.httpAuth = HTTPDigestAuth(user, password) return def out(self, i): url = "http://" + i + "/name" response = requests.get(url, self.httpAuth) print(response.text) return def test(self): pool = Pool(processes=2) for i in self.ipList: pool.apply(self.out, args=(i,)) pool.close() pool.join() return if name == ‘main': ipList = [‘192.168.2.1', ‘192.168.2.2', ‘192.168.2.3', ‘192.168.2.4', ‘192.168.2.5', ] a = threadtest(ipList, ‘admin', ‘admin') a.test()

原因:

在class中对属性进行初始化使用了其它类返回的句柄进行初始化导致,HTTPDigestAuth的返回值不能进行序列化,也就是不能作为cls(buf, protocol).dump(obj)的参数进行序列化。

将self.httpAuth = HTTPDigestAuth(httpUser, httpPassword)修改为:

self.httpUser
self.httpPassword

并将函数HTTPDigestAuth放到类的方法中

修改后:

class threadtest: def __init__(self, ipList, user, password): self.ipList = ipList self.user = user self.password = password return def out(self, i): url = "http://" + i + "/name" response = requests.get(url, HTTPDigestAuth(self.user, self.password)) print(response.text) return def test(self): pool = Pool(processes=2) for i in self.ipList: pool.apply(self.out, args=(i,)) pool.close() pool.join() return if name == ‘main': ipList = [‘192.168.2.1', ‘192.168.2.2', ‘192.168.2.3', ‘192.168.2.4', ‘192.168.2.5', ] a = threadtest(ipList, ‘admin', ‘admin') a.test()

以上这篇解决python多线程报错:AttributeError: Can't pickle local object问题就是小编分享给大家的全部内容了,希望能给大家一个参考,也希望大家多多支持软件开发网。

您可能感兴趣的文章:Python多线程实现支付模拟请求过程解析Python 多线程共享变量的实现示例浅谈python多线程和多线程变量共享问题介绍解决python ThreadPoolExecutor 线程池中的异常捕获问题Python实现多线程下载脚本的示例代码Python多线程通信queue队列用法实例分析解决python父线程关闭后子线程不关闭问题



pickle python多线程 object 线程 Python

需要 登录 后方可回复, 如果你还没有账号请 注册新账号