前 20 Python 任务队列、调度与工作流工具
Celery, RQ, Airflow, Prefect, Dagster and message-broker clients for running work in the background
更新于 · GitHub stars (stars)
为什么是这20个
Ranked by GitHub stars: how many developers bookmarked the project. Stars measure attention, not quality, so each row also shows forks, licence, the last push and the section of the community list it sits in. Three kinds share the list: task queues (Celery, RQ, Dramatiq) run jobs from your app, schedulers and orchestrators (APScheduler, Airflow, Prefect) run them on a timetable or as pipelines, and messaging clients (Kafka, RabbitMQ, MQTT) move the messages. Orchestrators are whole platforms with web UIs, so they collect more stars than a small library that does one job well.
-
1
apache-airflow
Airflow is a platform to programmatically author, schedule and monitor workflows.
47,263 stars 18,121 forkslast push 2026-10-22PythonApache-2.0
-
2
celery
An asynchronous task queue/job queue based on distributed message passing.
29,032 stars 5,236 forkslast push 2026-10-22PythonNOASSERTION
-
3
prefect
A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines.
24,061 stars 2,609 forkslast push 2026-10-22PythonApache-2.0
-
4
dagster
An orchestration platform for the development, production, and observation of data assets.
16,313 stars 2,366 forkslast push 2026-10-21PythonApache-2.0
-
5
-
6
-
7
apscheduler
A light but powerful in-process task scheduler that lets you schedule functions.
7,666 stars 807 forkslast push 2026-10-12PythonMIT
-
8
huey
A little task queue with multi-process, multi-thread, or greenlet workers.
6,055 stars 405 forkslast push 2026-10-21PythonMIT
-
9
faststream
A framework for building async services over Kafka, RabbitMQ, NATS, MQTT, and Redis.
5,379 stars 411 forkslast push 2026-10-21PythonApache-2.0
-
10
dramatiq
A fast and reliable background task processing library for Python 3.
5,330 stars 386 forkslast push 2026-10-15PythonLGPL-3.0
-
11
pika
Pure-Python RabbitMQ/AMQP 0-9-1 client library.
3,888 stars 854 forkslast push 2026-10-22PythonBSD-3-Clause
-
12
paho-mqtt
The Eclipse Paho MQTT client for Python.
2,430 stars 752 forkslast push 2026-10-12PythonNOASSERTION
-
13
taskiq
Distributed task queue with native asyncio support and pluggable brokers.
2,361 stars 156 forkslast push 2026-10-12PythonMIT
-
14
temporalio
Temporal SDK for durable, fault-tolerant workflows that survive crashes and retries.
1,228 stars 271 forkslast push 2026-10-22PythonMIT
-
15
confluent-kafka
Confluent's Python client for Apache Kafka, built on librdkafka.
523 stars 970 forkslast push 2026-10-21PythonNOASSERTION
如何衡量
Every project in the Task Queues, Job Schedulers and Messaging sections of the community list vinta/awesome-python on GitHub that has a public repository, ranked by GitHub stars from the GitHub API; archived repositories are left out. Refreshed every 6 hours.
参考资料
- vinta/awesome-python: Task Queues, Job Schedulers and Messaging, GitHub community list (list text CC BY 4.0; star counts from the GitHub API). Checked 2026-10-22 08:48 UTC.
- vinta/awesome-python (Task Queues, Job Schedulers, Messaging), GitHub community list, 15 tools with a public repository.
