python3过大数据如何读取？
yang
2020-05-29 13:51:213209浏览 · 0收藏 · 0评论
python中读取大文件的方法：
1、利用yield生成器读取
def readPart(filePath, size=1024, encoding="utf-8"): with open(filePath,"r",encoding=encoding) as f: while True: part = f.read(size) if part: yield part else: return None filePath = r"filePath" size = 2048 # 每次读取指定大小的内容到内存 encoding = 'utf-8' for part in readPart(filePath,size,encoding): print(part) # Processing data
2、利用open()自带方法生成迭代对象，这个是一行一行的读取
with open(filePath) as f: for line in f: print(line) # Processing data
更多Python知识请关注Python自学网
关注公众号，随时随地在线学习
分享到微博
微信扫一扫
流芳
9889
