lazar-bit/automated-warspotting-scraper
This Python-based automation tool periodically fetches and updates geolocated equipment loss data from the WarSpotting public API. It supports full historical scans and recent 30-day incremental updates, storing results in a CSV file for analysis, visualization, or machine learning purposes.
What's novel
This Python-based automation tool periodically fetches and updates geolocated equipment loss data from the WarSpotting public API. It supports full historical scans and recent 30-day incremental updates, storing results in a CSV file for analysis, visualization, or machine learning purposes.
Code Analysis
4 files read · 2 roundsA single ~100-line Python script that scrapes geolocated Russian equipment loss records from the WarSpotting.net API (full scan on Sundays, 30-day rolling window otherwise), flattens them into a CSV, and a GitHub Actions workflow commits the CSV and uploads it to Kaggle.
Strengths
Clean, readable, and functional: sensible pagination with 404/empty/last-page handling, a tidy flatten() that parses geo coordinates, dedup by id on incremental runs, and a well-structured CI pipeline that actually produced the committed 3.2MB dataset.
Weaknesses
No tests, no requirements.txt (despite the README referencing one), no retry/backoff on transient failures, and the README is internally inconsistent (claims Mon/Wed/Fri incremental scans while the workflow runs Mon–Sat).
Score Breakdown
Signal breakdown
Innovation
Craft
Traction
Scope
Evidence
Commits
237
Contributors
2
Files
5
Active weeks
34
Repository
Language
Python
Stars
1
Forks
0
License
MIT