Skip to content

Add environment-based config and parallel tile downloads#4

Open
TheBestJohn wants to merge 1 commit intofistulareffigy:mainfrom
TheBestJohn:main
Open

Add environment-based config and parallel tile downloads#4
TheBestJohn wants to merge 1 commit intofistulareffigy:mainfrom
TheBestJohn:main

Conversation

@TheBestJohn
Copy link

  • Use dotenv to load API key, regions, workers, and zoom levels from .env
  • Add concurrent downloads with ThreadPoolExecutor for faster processing
  • Organize tiles into per-region subdirectories
  • Skip already-downloaded tiles to support resume
  • Add .env_sample, .gitignore, and requirements.txt

The threadpool greatly increases download speed. If you decide to include nothing else, I suggest at least take a look at doing that.

Forgot to mention in my commit message. During the load regions function I sanity check that min < max for lon/lat

- Use dotenv to load API key, regions, workers, and zoom levels from .env
- Add concurrent downloads with ThreadPoolExecutor for faster processing
- Organize tiles into per-region subdirectories
- Skip already-downloaded tiles to support resume
- Add .env_sample, .gitignore, and requirements.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant