[evlatests] Trouble with WIDAR last night ...

[Vivek Dhawan]

I looked at some cbe logs and telcal from that day, yes it was
only this project, a later one also used the same full-widar
setup and was fine. there were subbands in A1 A2 with high zeros
and missing data, lasted for that one config. no BLB was making
zeros, according to the frame counter (but i did not check the
integration time, which if it is more than 1sec can mask zeros)
my guess yesterday was a network switch mis-config, maybe between
the STB and BLB, to be re-thought today.   Ken’s suggestion of
the ‘drop one blb/subb’ bug is correct, i think this vci did
drop 1, unnecessarily. but that seems to be separate problem
at least for my current thinking.


On Tue, November 28, 2023 17:11, Paul Demorest via evlatests wrote:
| We can take a closer look tomorrow.  Whatever is going on, it seems to have
| only affected this one observation (I'm assuming this is 24A-130).  Other data
| taken over the past day, including some other Ka, look OK to me.
|
| -Paul
|
|> The pipeline has not yet completed on this observation, but from where it?s
|> gotten, I can see 4.353% zeros out of all data taken. I think seven spws in
|> Ka
|> are fully flagged, but I don?t yet know why or if they are all zeros
|> (116,117,120, 124, 136, 144, 154).
|>
|>
|> Cheers,
|> Drew
|>
|>
|> Drew Medlin
|> dmedlin at nrao.edu
|>
|> VLA Scientific User Support
|> National Radio Astronomy Observatory
|>
|>> On Nov 28, 2023, at 3:56 PM, Rick Perley via evlatests
|>> <evlatests at listmgr.nrao.edu> wrote:
|>>
|>> Something bad happened to the correlator last night.
|>>
|>> I'm reducing data taken at various bands from ~ 1AM last night. All seems
|>> find at Ku-band and below.
|>>
|>> But in Ka band -- there are many SPWs which either have no data (evidently
|>> all zero) or completely trashed data -- full of random numbers.  Only 63
|>> SPWs are present, so we didn't have the full complement of station boards.
|>> But there's more wrong than that. I'm not sure the Ka-band data can be
|>> salvaged.
|>>
|>> Rick
|>>
|>> _______________________________________________
|>> evlatests mailing list
|>> evlatests at listmgr.nrao.edu
|>> https://listmgr.nrao.edu/mailman/listinfo/evlatests
|>
|> _______________________________________________
|> evlatests mailing list
|> evlatests at listmgr.nrao.edu
|> https://listmgr.nrao.edu/mailman/listinfo/evlatests
|>
|
|
| _______________________________________________
| evlatests mailing list
| evlatests at listmgr.nrao.edu
| https://listmgr.nrao.edu/mailman/listinfo/evlatests
|