retrieving Packages/Sources files from mirrors
Johannes Schauer <[email protected]>
| Newsgroups | gmane.linux.debian.user.mirrors |
|---|---|
| Message-ID | <20140803051651.19236.84351@hoothoot> |
Hi, I maintain the service bootstrap.debian.net which so far was using snapshot.debian.org to retrieve Packages and Source files for all architectures of Debian Sid daily at midnight UTC. I used snapshot instead of a mirror because I want to: - be able to retrieve the exact same Packages/Sources files at any later point in time to investigate why a run failed - avoid that some Packages/Sources files for different architectures come from two different mirror pushes (in case I happen to download just at the time the mirror updates) On the other hand, using snapshot.debian.org has the disadvantage that I'm stressing its bandwidth for something that can maybe achieved using normal mirrors. For example if I download from a normal mirror and additionally store the Release file, it should be easily possible to verify later that I'm using the correct snapshot from snapshot.debian.org. The harder problem is to make sure that I obtain the Packages/Sources from all arches for the exact same mirror push. My internet connection is not the fastest, so downloading all Packages/Sources files will take a while. Is there a way to make sure that I do not start the download when a mirror update is imminent? Or the other way round: is there a way to know the time of a mirror push so that I can download right after it is done? For my purposes, is there a difference between which mirror I am using? Using mirrors like http.debian.net might make my situation worse because it might redirect me to different mirrors with different state between individual requests, right? On the other hand, if I use, say, ftp.us.debian.org then those requests are also distributed over several servers, right? Please keep me CC-ed because I'm not subscribed. cheers, josch