报错信息:
UnicodeEncodeError: 'ascii' codec can't encode characters in position 1-3: ordinal not in range(128)
解决方法:
一、首先运行:
import sys
reload(sys)
sys.setdefaultencoding('utf-8')
二、将网页以gbk解码后转为utf-8:
result = urllib2.urlopen(req).read()
result = unicode(result,'GBK').encode('UTF-8')
这样子就可以继续爬虫了
三个资料Q群下载不了也转发不了,先放这里Fine_tuning.zipLangChain.zipdata_clear.rar