Re: FTP Troubles w/ many servers

--=-VcNJajj8Vn1VlDZgi02y
Content-Type: text/plain
Content-Transfer-Encoding: 7bit


On Mon, 2004-02-09 at 15:31, Keller wrote:
> I know that this list is fairly dormant, but I hope someone will get
> this who can help me.  I'm currently trying to index a bunch of rpms
> from one server in many directories (in my case, the different
> directories in ftp://speakeasy.rpmfind.net/linux/).  If I try to just
> recursively index that one directory, I get a timeout from grab.  If I
> try to manually input each of the subdirectories (/mandrake, /freshmeat,
> etc) of that directory, then grab runs fine for a while, but inevitably
> gives me a "cannot connect to rpmfind.speakeasy.net" and then ends the
> update.  If I run with debug, I find that it connects to the server fine
> many times and then simply can't.  I assume that it's just an anomaly
> that occurs once in a while, but since I'm updating so many directories,
> occurs once in the many connections that grab makes for my server list. 
> In case it helps, here's the command line I'm using ::
> 
> grab --update -W -debug
> 
> I've also attached my config and servers files, just in case they help. 
> Is there any way to force grab to continue even after it can't connect
> to a server?  Can I setup perl's ftp to retry a server if it's unable to
> connect?  Thanks so much for the help!
> 
> Sincerely, 
> Keller
> 
> 
> _______________________________________________
> Grab mailing list
> [email protected]
> http://www.runlevelzero.net/mailman/listinfo/grab
> 

--=-VcNJajj8Vn1VlDZgi02y
Content-Disposition: attachment; filename=config
Content-Type: text/plain; name=config; charset=
Content-Transfer-Encoding: 7bit

# GRAB general config 1.5

########################################################################
#                   GRAB -- General Configurations                     #
########################################################################

# UPDATE ME
# Should a GRAB update automatically update this file when GRAB gets updated
# and there are changes to this file? Warning: Any customizations to this
# file will be changed during an update if you select 'yes'. (yes/no)

  update me = no

# CACHE DIR
# This is the default cache dir that GRAB uses

  cache dir = /var/cache/grab

# RPM REPOSITORY
# Location that GRAB downloads the RPMS to.

  rpm repository = /var/cache/grab/RPMS

# RPM INFO REPOSITORY
# Location that GRAB uses to store the rpm information files

  rpm info repository = /var/cache/grab/PKG-Info

# PASSIVE
# Should FTP Transfers be in passive mode? (yes/no)

  passive = yes

# DUPLICATE PACKAGES
# Packages listed here will be installed as new as opposed to updated.
# Leaving this option will allow duplicate packages to be installed
# (i.e. kernel-2.4.7-10 and kernel-2.4.9-13). If You do not want GRAB
# to install any duplicate packages, simply remove this option.

  duplicate packages = kernel, kernel-smp

# RPM OPTS
# String of _extra_ arguments that must be called with RPM during package
# validation and installation.

   rpm opts = #rpm opts#

# SKIP LIST
# A comma delineated list of strings to skip when doing the cron, or
# auto args This list will skip all  matched RPMS when using GRAB. You
# override this option by invoking GRAB with the '--noskip' argument.
# note: Entries are regex matched (i.e. ke.+l will match kernel).

  skip list = kernel, ximian, pre\d+, rc\d+

  # kernel: skip all kernels
  # ypbind: versioning nomenclature changed (affects RH 6.2)
  # mutt: Bad versions (i.e. 1.2.5i-17 is older then 1.2.5-17) (affects RH 7.2)
  # ximian/helix: Any packages with this in the name CANNOT be upgraded by standard
  #    distribution packages or you will break your system! (all distributions)
  # beo: Packages from SCYLD CAN NOT be upgraded by standard RH packages! (affects SCYLD)



--=-VcNJajj8Vn1VlDZgi02y
Content-Disposition: attachment; filename=servers
Content-Type: text/plain; name=servers; charset=
Content-Transfer-Encoding: 7bit

########################################################################
#                 GRAB -- Server Configurations                        #
#        After any change below these lines you must run the           #
#                    --update option to grab!                          #
########################################################################

# Uncomment the line(s) that you wish to use (remove the ';').

# SERVER
# Use server option for each FTP server/dir
# Format: server [ftp-server] [ftp-path to RPMS] [description/location]
# note: If you end the [ftp-path to RPMS] with '//' then GRAB will search
# recursively.

  ## GRAB repository at Runlevelzero.net
; server ftp.runlevelzero.net /pub/greg/grab/RPMS/ [email protected]

  ## Warewulf cluster repository at Warewulf-cluster.org
; server warewulf-cluster.org /pub/greg/warewulf// WAREWULF

  ## FreshRPMS repository (notice the '//' to GRAB recursively)
;  server ftp.freshrpms.net /pub/freshrpms/redhat-8.0// FRESHRPMS
;  server ftp.freshrpms.net /pub/freshrpms/redhat-7.3// FRESHRPMS
;  server ftp.freshrpms.net /pub/freshrpms/redhat-7.2// FRESHRPMS

## RPMFind Directories on speakeasy.speakeasy.rpmfind.net
server speakeasy.rpmfind.net /linux/ASPLinux// ASPLinux@SPEAKEASY
server speakeasy.rpmfind.net /linux/KDE// KDE@SPEAKEASY
server speakeasy.rpmfind.net /linux/LinuxRouter// LinuxRouter@SPEAKEASY
server speakeasy.rpmfind.net /linux/Mandrake// MDK@SPEAKEASY
server speakeasy.rpmfind.net /linux/Mandrake-devel// MDK-Devel@SPEAKEASY
server speakeasy.rpmfind.net /linux/MySQL// MySQL@SPEAKEASY
server speakeasy.rpmfind.net /linux/PLD// PLD@SPEAKEASY
server speakeasy.rpmfind.net /linux/RPM/mandrake/9.1// 9.1RPM@SPEAKEASY
server speakeasy.rpmfind.net /linux/RPM/mandrake/9.2// 9.2RPM@SPEAKEASY
server speakeasy.rpmfind.net /linux/RPM/mandrake/updates// updatesRPM@SPEAKEASY
server speakeasy.rpmfind.net /linux/SGILinux// SGILinux@SPEAKEASY
server speakeasy.rpmfind.net /linux/SuSE-Linux// SuSE@SPEAKEASY
server speakeasy.rpmfind.net /linux/blinux// blinux@SPEAKEASY
server speakeasy.rpmfind.net /linux/coda// coda@SPEAKEASY
server speakeasy.rpmfind.net /linux/conectiva// conectiva@SPEAKEASY
server speakeasy.rpmfind.net /linux/contrib// contrib@SPEAKEASY
server speakeasy.rpmfind.net /linux/engarde// engarde@SPEAKEASY
server speakeasy.rpmfind.net /linux/falsehope// falsehope@SPEAKEASY
server speakeasy.rpmfind.net /linux/fedora// fedora@SPEAKEASY
;server speakeasy.rpmfind.net /linux/freshmeat// freshmeat@SPEAKEASY
server speakeasy.rpmfind.net /linux/freshrpms// freshrpms@SPEAKEASY
server speakeasy.rpmfind.net /linux/gnome.org// gnome.org@SPEAKEASY
server speakeasy.rpmfind.net /linux/kernel// kernel@SPEAKEASY
server speakeasy.rpmfind.net /linux/mandrake// LittleMDK@SPEAKEASY
server speakeasy.rpmfind.net /linux/netwinder.org// netwinder.org@SPEAKEASY
server speakeasy.rpmfind.net /linux/rawhide// rawhide@SPEAKEASY
server speakeasy.rpmfind.net /linux/redhat// redhat@SPEAKEASY
server speakeasy.rpmfind.net /linux/rpm.org// rpm.org@SPEAKEASY
server speakeasy.rpmfind.net /linux/solaris// solaris@SPEAKEASY
;server speakeasy.rpmfind.net /linux/sourceforge// sourceforge@SPEAKEASY
server speakeasy.rpmfind.net /linux/ultrapenguin// ultrapenguin@SPEAKEASY
server speakeasy.rpmfind.net /linux/ximian// ximian@SPEAKEASY
server speakeasy.rpmfind.net /linux/yellowdog// yellowdog@SPEAKEASY

## LOCAL
# Use local option for each local directory/MP/NFS/ETC that contains RPMS
# Format: local [directory] [description/location]

; local /mnt/cdrom/RedHat/RPMS/ RedHat_CDROM
; local /var/cache/grab/RPMS/ LOCAL_CACHE
local /home/keller/Download/RPMS/ KELLER_DOWNLOAD

# SERVER_LIST
# Use server_list option for remote server lists (http or ftp)
# These lists have ftp servers already defined for you, so you only need
# to uncomment (remove the ';') the line that matches your
# OS/architecture.

  ## Keller's FTP Test
;  server_list ftp://chkv.d2g.com/grab.txt


  ## Devin's ia32 Mandrake lists  <[email protected]>
; server_list ftp://ftp.vibechild.com/public/linux/mandrake-current.txt
; server_list ftp://ftp.vibechild.com/public/linux/mandrake-cooker.txt

  ## Greg's ia32 RedHat 6.2 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-6.2.txt

  ## Greg's ia32 RedHat 7.0 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-7.0.txt

  ## Greg's ia32 RedHat 7.1 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-7.1.txt

  ## Greg's ia32 RedHat 7.2 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-7.2.txt

  ## Greg's ia32 RedHat 7.3 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-7.3.txt

  ## Greg's ia32 RedHat 8.0 list  <[email protected]>
; server_list ftp://ftp.runlevelzero.net/pub/greg/grab/srv_lists/redhat-8.0.txt



--=-VcNJajj8Vn1VlDZgi02y--