gevent 透過 greenlet 實現輕量級協程,在 IO 阻塞時自動切換執行緒,以單執行緒達到高併發。本文從猴子補丁原理、gevent.spawn 建立協程、gevent.sleep 主動讓出、自動 IO 切換實戰,到生產部署整合完整解析。
from gevent import monkey
monkey.patch_socket() # 或 monkey.patch_all() 替換所有標準庫
import gevent
def f(n):
for i in range(n):
print(gevent.getcurrent(), i)
g1 = gevent.spawn(f, 5)
g2 = gevent.spawn(f, 5)
g3 = gevent.spawn(f, 5)
g1.join()
g2.join()
g3.join()
<Greenlet at 0x10e49f550: f(5)> 0
<Greenlet at 0x10e49f550: f(5)> 1
...
<Greenlet at 0x10e49f910: f(5)> 0
...
def f(n):
for i in range(n):
print(gevent.getcurrent(), i)
gevent.sleep(0) # 關鍵:主動交出控制權
# 輸出:三個 greenlet 交替印出 0,1,2,3,4
from gevent import monkey
monkey.patch_all() # 必須在 import urllib2 之前
import gevent
import urllib2
def f(url):
print('GET:', url)
resp = urllib2.urlopen(url)
data = resp.read()
print('%d bytes received from %s.' % (len(data), url))
gevent.joinall([
gevent.spawn(f, 'https://www.python.org/'),
gevent.spawn(f, 'https://www.yahoo.com/'),
gevent.spawn(f, 'https://github.com/'),
])
GET: https://www.python.org/
GET: https://www.yahoo.com/
GET: https://github.com/
45661 bytes received from https://www.python.org/.
14823 bytes received from https://github.com/.
304034 bytes received from https://www.yahoo.com/.
最神奇特性:應用代碼完全無需引入 gevent,僅在部署時換用支援 gevent 的 WSGI 伺服器:
# Gunicorn + gevent
$ gunicorn -k gevent -w 4 myapp:app
# uWSGI + gevent
$ uwsgi --gevent 100 --http :8000 --wsgi-file myapp.py
同步阻塞代碼瞬間獲得協程級併發能力。
import 之前執行multiprocessing 或線程池gevent 以最小侵入性為 Python 帶來高併發能力。核心價值在於:既有同步代碼零修改,部署層切換即獲得效能提升。適合 IO 密集型 Web 服務、爬蟲、API 聚合等場景。