|
|
hai 5 meses | |
|---|---|---|
| application | hai 5 meses | |
| configs | hai 5 meses | |
| crawler_worker | hai 5 meses | |
| pipelines | hai 5 meses | |
| scheduler | hai 5 meses | |
| utils | hai 5 meses | |
| .gitignore | hai 5 meses | |
| README.md | hai 5 meses | |
| main.py | hai 5 meses |
整体流程: MQ 消息推送 ↓ main.py 消费并生成线程 ↓ handle_message() → 解析消息体(platform + mode) ↓ 加载 user_list / rule_dict(数据库) ↓ 执行 UniversalCrawler.run() ↓