李顺东 3cacaf040a feat(job_crawler): enhance logging and tracking for data filtering and Kafka production ...

- Add logging when API returns empty data to track offset progression
- Track expired job count separately from valid filtered jobs
- Initialize produced counter to handle cases with no filtered jobs
- Consolidate logging into single comprehensive info log per batch
- Log includes: total fetched, valid, expired, and Kafka-produced counts
- Improves observability for debugging data flow and filtering efficiency

2026-01-15 17:59:12 +08:00

..

__init__.py

feat(job_crawler): initialize job crawler service with kafka integration

2026-01-15 17:09:43 +08:00

api_client.py

feat(job_crawler): initialize job crawler service with kafka integration

2026-01-15 17:09:43 +08:00

crawler.py

feat(job_crawler): enhance logging and tracking for data filtering and Kafka production

2026-01-15 17:59:12 +08:00

kafka_service.py

feat(job_crawler): initialize job crawler service with kafka integration

2026-01-15 17:09:43 +08:00

progress_store.py

feat(job_crawler): implement reverse-order incremental crawling with real-time Kafka publishing

2026-01-15 17:46:55 +08:00