[evlatests] Fwd: Fwd: Re: Generator test Antenna communication outages

Wed Mar 6 14:34:07 EST 2019

Hello all,

Antennas dropping coms is not as bad as first suspected. The monitor 
points that were used for coms, by me were not good choices.  It appears 
there are six constantly problem antennas them being 6, 8, 10, 14, 15 
and 17 according to Jeff Long's email. Jerry Langevin and myself did 
some work on Antenna 15 on 27 Feb, and Antenna 10 on 4 March, we plan on 
doing checks on Antennas 14 and 17 Monday 11 March and not touching 
Antennas 6 and 8 to give us an indication if what we are doing is making 
a major radiance.

Jerry and myself removed a test power strip from Antennas 22 and 25 that 
was installed on 4 March sense these antennas have not been having problems.

Dave Parker

-------- Forwarded Message --------
Subject: 	Fwd: Re: Generator test Antenna communication outages
Date: 	Wed, 6 Mar 2019 07:23:18 -0700
From: 	Dave Parker <dparker at nrao.edu>
Organization: 	NRAO
To: 	Jerry Langevin <jlangevi at nrao.edu>, Jim Jackson 
<jjackson at aoc.nrao.edu>

-------- Forwarded Message --------
Subject: 	Re: Generator test Antenna communication outages
Date: 	Tue, 5 Mar 2019 16:55:10 -0700
From: 	Jeff Long <jlong at nrao.edu>
To: 	Dave Parker (dparker at aoc.nrao.edu) <dparker at aoc.nrao.edu>
CC: 	Ken Sowinski <ksowinsk at aoc.nrao.edu>

Interesting, the pdu did not lose power during both generator tests you 
can see a coldstart on the 4th when it was power cycled.

--Jeff L.

ea10-pdu logs
03/04/2019     09:37:20     System: Coldstart.
02/25/2019     11:49:20     System: Set Date or Time.
02/11/2019     11:49:19     System: Set Date or Time

Date     Time     I     IMax     IMin
02/27/2019       09:26:49       1.5       1.5       1.5
02/27/2019       09:16:49       1.5       1.6       1.3
02/27/2019       09:06:49       1.5       1.5       1.5

On 03/05/2019 03:23 PM, Jeff Long wrote:
> *_Both Generator test days these Antennas were affected 6, 8, 10, 14, 
> 15, 17._*
>
> All switches below indicate from up time, that they power cycled 
> during loss of communication.
>
> Wed 13th Feb statseeker ping outage to these antennas started at 
> 9:42am back up at times below and how long ping was down
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-7     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-11     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-11b up     0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-15b up     0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-8b     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-15     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-8     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:44     EVLA-ant-sw-7b     up 0 days 00 
> hrs 01 min
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-28     up 0 days 00 
> hrs 02 mins
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-28b up     0 days 00 
> hrs 02 mins
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-10b up     0 days 00 
> hrs 02 mins
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-10     up 0 days 00 
> hrs 02 mins
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-17b up     0 days 00 
> hrs 03 mins
> Note     Wed 13th Feb 2019 09:45     EVLA-ant-sw-17     up 0 days 00 
> hrs 03 mins
> Note     Wed 13th Feb 2019 09:46     EVLA-ant-sw-6     up 0 days 00 
> hrs 03 mins
> Note     Wed 13th Feb 2019 09:46     EVLA-ant-sw-6b     up 0 days 00 
> hrs 03 mins
> Note     Wed 13th Feb 2019 09:49     EVLA-ant-sw-14     up 0 days 00 
> hrs 06 mins
> Note     Wed 13th Feb 2019 09:49     EVLA-ant-sw-14b up     0 days 00 
> hrs 06 mins
>
> Wed 27th Feb statseeker ping outage to these antennas started at 
> 9:13am back up at times below and how long ping was down
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-10b up     0 days 00 
> hrs 01 min
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-10     up 0 days 00 
> hrs 01 min
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-8b     up 0 days 00 
> hrs 02 mins
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-8     up 0 days 00 
> hrs 02 mins
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-15b up     0 days 00 
> hrs 02 mins
> Note     Wed 27th Feb 2019 09:16     EVLA-ant-sw-15     up 0 days 00 
> hrs 02 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-27b up     0 days 00 
> hrs 03 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-27     up 0 days 00 
> hrs 03 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-6b     up 0 days 00 
> hrs 03 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-17b up     0 days 00 
> hrs 03 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-17     up 0 days 00 
> hrs 03 mins
> Note     Wed 27th Feb 2019 09:17     EVLA-ant-sw-6     up 0 days 00 
> hrs 04 mins
> Note     Wed 27th Feb 2019 09:20     EVLA-ant-sw-14     up 0 days 00 
> hrs 07 mins
> Note     Wed 27th Feb 2019 09:20     EVLA-ant-sw-14b up     0 days 00 
> hrs 07 mins
>
> --Jeff L.
>
> On 03/05/2019 12:47 PM, Dave Parker wrote:
>> Jeff,
>>
>> The antennas you noted losing coms this morning (with location) were 
>> 14 at BE7, 17 at BN9, 6 at BN7, 8 at BN5, 26 at BW9, 27 at BE8, 10 at 
>> BE2, and 15 at BN3. I do not think antenna 28, now BW2, was affected 
>> this outage but was the week before when on the master pad. You might 
>> recheck antennas 11 BN8, 9 BN4, 18 BW8, and 12 BE4.
>>
>> Work was done on antenna 15 on the 27th of FEB. Antennas 10, 22, and 
>> 25 had the network switches bypassed from the PDU's on 4 March so 
>> they may want to be rechecked also.
>>
>> Below are comments from Ken Sowinski regarding coms failures on the 
>> last 2 generator test. On, I believe the 13 and 27th of Feb.
>>
>> Dave
>>
>>
>> -------- Forwarded Message --------
>> Subject: Re: [evlatests] generator testing side-effects
>> Date: Mon, 4 Mar 2019 13:54:19 -0700 (MST)
>> From: Ken Sowinski <ksowinsk at nrao.edu>
>> To: Ken Sowinski <ksowinsk at nrao.edu>
>> CC: evlatests at nrao.edu
>>
>> On Tue, 19 Feb 2019, Ken Sowinski wrote:
>>
>>> During the generator testing last Wednesday I recorded 48V powerplant
>>> voltage and current from the M302, and sampler temperatures for all
>>> four modules at the antennas chosed to be distributed over all three
>>> arms and the master pad.  The antennas used were:
>>> West arm:  ea01, ea02, ea28 (master pad)
>>> North arm: ea04, ea06, ea11, ea15
>>> East arm:  ea10, ea16, ea23
>>>
>>> This is the first of two notes and describes the overall antenna and
>>> power plant response.  The second will describe the sampler behavior.
>>>
>>> An unexpected result is that about half the antennas suffered a
>>> communication outage when AC power was removed from the antenna.
>>> At least one antenna on the East arm had communications restored
>>> before AC power was restored.  The antennas which experienced
>>> a communication outage are:
>>>
>>>   ea28, ea06, ea11, ea15, ea10,
>>
>> During the generator tests of last Wednesday, Feb 27, I monitored
>> the east arm antennas with the following results.
>>
>> Network unaffected:  ea05, ea06, ea16, ea21, ea23
>> Network lost:        ea10, ea14, ea27
>>
>> The three antennas that were monitored both a week ago and this
>> time behaved the same way on both days.
>>
>> ea06 returned power plant voltage as exepcted, but always zero for
>> current.
>>
>> ea12 is on the east arm but I neglected to notice that.
>>
>>
>> _______________________________________________
>> evlatests mailing list
>> evlatests at listmgr.nrao.edu
>> https://listmgr.nrao.edu/mailman/listinfo/evlatests
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listmgr.nrao.edu/pipermail/evlatests/attachments/20190306/7cfaae77/attachment.html>