feat: Implement smart yearly data downloading with completeness check

- Added is_yearly_data_complete() function to check if yearly CSV files are complete
- Complete data criteria: file ends with 31.12.YYYY and starts with valid first working day
- Prevent re-downloading of complete yearly data files
- Improved efficiency by avoiding unnecessary downloads of multi-megabyte files
- Added proper CSV parsing for completeness checking
- Updated data_fetcher.py with intelligent download logic
- Maintains backward compatibility with force download option
This commit is contained in:
Kadu
2025-08-19 16:08:21 +02:00
parent 06685c855a
commit 03ba5eb99e
29 changed files with 104 additions and 6190 deletions