[daip] [physics.umn.edu#7958] rsync timeout in MNJ

[Wes Young]

No we haven't had too many issues with rsync. Usually it's a blocked  
port.  I'll poke around tomorrow, I'm taking today (Monday) off.

wes
wyoung at aoc.nrao.edu


On Oct 22, 2007, at 10:29 AM, Alex Schumann wrote:

> It seems to be the LOAD bit that kills it, so i went into the UPDATE
> directory and tried manually rsyncing the LOAD directory only.. and  
> can
> reproduce the error.
>
> Then, i moved all the files out of there, and tried to run it..  
> success.
>
> Then, i attempted to run it again, and failure again.
>
> Somehow, rsync is breaking when there is an existing install in LOAD/.
> There are only 500 or so files in there, under 1 gig worth.. I cant
> understand it.
>
> It could be a speed thing, maybe rsync is timing out or the server is,
> while it tries to calculate something?
>
> Has noone else seen this happen?
>   -Alex
>
> Wes Young wrote:
>> If the reboot fails, then do
>>
>> cd /tmp
>> rsync -avz rsync.aoc.nrao.edu::31DEC06LINUX .
>>
>>
>> wes
>> wyoung at aoc.nrao.edu
>>
>>
>> On Oct 17, 2007, at 3:54 PM, Alex Schumann wrote:
>>
>>> That command seemed to run fine:
>>>
>>> .
>>> .
>>> .
>>> sent 82 bytes  received 24805 bytes  9954.80 bytes/sec
>>> total size is 786370753  speedup is 31597.65
>>>
>>>
>>> Nothing has changed on our end that I can think of. I will try  
>>> rebooting
>>> the system, maybe its just gone nutty.
>>>   -Alex
>>>
>>> Wes Young wrote:
>>>> Hmmm.... I tried this from a non-NRAO site and had not trouble  
>>>> with the
>>>> rsync.  Has some networking changed on your end? Somebody block  
>>>> rsync?
>>>> Let just try the following rsync command
>>>>
>>>> rsync -avz rsync.aoc.nrao.edu::31DEC06LINUX
>>>>
>>>> This won't transfer any data but will show if rsync is working OK.
>>>>
>>>> wes
>>>> wyoung at aoc.nrao.edu
>>>>
>>>>
>>>> On Oct 17, 2007, at 1:51 PM, Alex Schumann wrote:
>>>>
>>>>> Hi Wes,
>>>>>
>>>>> I ran it again today, with the same results.
>>>>>   -Alex
>>>>>
>>>>> Wes Young wrote:
>>>>>> Well it could be a network hiccup.  Did you try three times in  
>>>>>> a row?
>>>>>> It might make sense to try this morning and see if it still  
>>>>>> fails.
>>>>>> If it
>>>>>> does let me know and I'll try from a non NRAO computer and see  
>>>>>> what
>>>>>> happens.
>>>>>>
>>>>>> wes
>>>>>> wyoung at aoc.nrao.edu
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Oct 16, 2007, at 2:06 PM, Alex Schumann wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> We are having difficulties running our midnight job here at  
>>>>>>> the UMN
>>>>>>> physics department. Larry suggested you might have an idea,  
>>>>>>> so I'v
>>>>>>> attached the output:
>>>>>>>
>>>>>>>  /local/astro/bin> ./do_daily.farscape
>>>>>>> AIPSUPD - cd /local/astro/aips/31DEC06/LINUX/UPDATE
>>>>>>> AIPSUPD - RunTime is 20071016.175012
>>>>>>> AIPSUPD - LogFile is
>>>>>>> /local/astro/aips/31DEC06/LINUX/UPDATE/UPD20071016.175012.LOG
>>>>>>> AIPSUPD - ErrorFile is
>>>>>>> /local/astro/aips/31DEC06/LINUX/UPDATE/UPD20071016.175012.ERR
>>>>>>> AIPSUPD - Using CVS for copying files.
>>>>>>> AIPSUPD - calling UPDCVS
>>>>>>> UPDCVS - cvs update of 31DEC06 completed
>>>>>>> cvs update: cannot open directory /home/aipssrc/cvs/TEXT/ 
>>>>>>> UPDATE: No
>>>>>>> such
>>>>>>> file or directory
>>>>>>> cvs update: skipping directory TEXT/UPDATE
>>>>>>> UPDCVS - cvs update of TEXT completed
>>>>>>> AIPSUPD - calling UPDCONTROL
>>>>>>> UPDCONTROL - Syncing LASTGOOD.DAT.mnj.aoc.nrao.edu
>>>>>>> UPDCONTROL - calling UPDOBSLT on sorted PUTBCK, REMOVE
>>>>>>> UPDCONTROL - UPDOBSLT done, new PUTBCK.UPD
>>>>>>> UPDCONTROL - calling UPDSRTUNQ REMOVE
>>>>>>> UPDCONTROL - calling UPDLSTDAT REASONS.UPD
>>>>>>> UPDCONTROL - calling UPDSRTUNQ PUTBCK
>>>>>>> UPDCONTROL - applying COMRPL/LNK.ADD to .UPD files
>>>>>>> UPDCONTROL - removing any aipssrc compiles/links
>>>>>>> UPDCONTROL - Calling UPDSRTUNQ COMRPL
>>>>>>> UPDCONTROL - Calling UPDSRTUNQ COMLNK
>>>>>>> UPDCONTROL - Done.
>>>>>>> UPDCONTROL - created temporary file 20071016.175012.SPECIAL
>>>>>>> UPDCONTROL - nothing special, removing 20071016.175012.SPECIAL
>>>>>>> UPDCONTROL - regenerating COMRPL.UPD.SUM
>>>>>>> UPDCONTROL - regenerating COMLNK.UPD.SUM
>>>>>>> AIPSUPD - UPDCONTROL done
>>>>>>> AIPSUPD - dates wrong: LASTREMOVE is 20071015.162153
>>>>>>> AIPSUPD -          and   LASTGOOD is 20071015.162153
>>>>>>> UPDRSYNC:  doing binary synchronization
>>>>>>> UPDRSYNC: rsync SYSTEM
>>>>>>> UPDRSYNC: rsync LIBR
>>>>>>> UPDRSYNC: rsync LOAD
>>>>>>> rsync error: timeout in data send/receive (code 30) at io.c(165)
>>>>>>> [sender=2.6.9]
>>>>>>> rsync: connection unexpectedly closed (16726 bytes received  
>>>>>>> so far)
>>>>>>> [receiver]
>>>>>>> rsync error: error in rsync protocol data stream (code 12) at
>>>>>>> io.c(359)
>>>>>>> rsync: connection unexpectedly closed (16726 bytes received  
>>>>>>> so far)
>>>>>>> [generator]
>>>>>>> rsync error: error in rsync protocol data stream (code 12) at
>>>>>>> io.c(359)
>>>>>>> AIPSUPD - calling UPDREPORT
>>>>>>> AIPSUPD - UPDREPORT done, MNJ finished.
>>>>>>>
>>>>>>>
>>>>>>> I'll also attach the logs from the last run.
>>>>>>>
>>>>>>> I tried it 3 times with the same results. Any ideas? We have run
>>>>>>> it in
>>>>>>> the past without difficulty.
>>>>>>>
>>>>>>> --Alex Schumann
>>>>>>> University of Minnesota School of Physics & Astronomy
>>>>>>> Tate Lab room S43   (612)626-1139
>>>>>>> http://www.physics.umn.edu/support/
>>>>>>> <UPD20071016.175012.DOC>
>>>>>>> AIPSUPD - dates wrong: LASTREMOVE = 20071015.162153
>>>>>>> AIPSUPD -          and LASTGOOD   = 20071015.162153
>>>>>>> _______________________________________________
>>>>>>> Daip mailing list
>>>>>>> Daip at listmgr.cv.nrao.edu
>>>>>>> http://listmgr.cv.nrao.edu/mailman/listinfo/daip
>>>>>>
>>>>>
>>>>> --Alex Schumann
>>>>> University of Minnesota School of Physics & Astronomy
>>>>> Tate Lab room S43   (612)626-1139
>>>>> http://www.physics.umn.edu/support/
>>>>
>>>>
>>>
>>> --Alex Schumann
>>> University of Minnesota School of Physics & Astronomy
>>> Tate Lab room S43   (612)626-1139
>>> http://www.physics.umn.edu/support/
>>
>>
>
> -- 
> Alex Schumann
> University of Minnesota School of Physics & Astronomy
> Tate Lab room S43   (612)626-1139
> http://www.physics.umn.edu/support/