李顺东 3cacaf040a feat(job_crawler): enhance logging and tracking for data filtering and Kafka production ...

- Add logging when API returns empty data to track offset progression
- Track expired job count separately from valid filtered jobs
- Initialize produced counter to handle cases with no filtered jobs
- Consolidate logging into single comprehensive info log per batch
- Log includes: total fetched, valid, expired, and Kafka-produced counts
- Improves observability for debugging data flow and filtering efficiency

2026-01-15 17:59:12 +08:00

docs

feat(job_crawler): implement reverse-order incremental crawling with real-time Kafka publishing

2026-01-15 17:46:55 +08:00

job_crawler

feat(job_crawler): enhance logging and tracking for data filtering and Kafka production

2026-01-15 17:59:12 +08:00

Description

No description provided

110 KiB

Languages

Python 86%

Shell 8.6%

Batchfile 4.1%

Dockerfile 1.3%