[daip] further outline for comment

Eric Greisen egreisen at nrao.edu
Tue Sep 6 17:36:01 EDT 2005


Bullet points for the talk I am not going to give



           AIPS Group

Eric Greisen - Scientist, 75%

Amy Mioduszewski - Asst. Scientist, <= 75% (really ~ 50%)

Leonia Kogan - Scientist, 40%  (+ 35% EVLA planning)

Wes Young - Software Engineer, 15% AIPS

--------------------------------------

Lorant Sjouwerman - Assoc. Scientist, <= 50 %


*************************************************************

Major accomplishments in last 2 years (since proposal)

0. Support AIPS users world-wide, helping with installation and usage
      problems, fixing bugs and inconveniences

1. VLBI:
      APCAL - estimate opacity with weather tables
      VLA, GBT, Arecibo as VLBA stations - calibration transfer
      Earth orientation Parameter - correction for poor estimates
      VLBAARCH - pipeline to archive VLBA data, concatenating multiple
            jobs, doing basic corrections, separating frequency IDs

2. VLA:
      FILLM - read archive data from disk, avoid bad concatenations
      Models for primary flux calibrators - Claire Chandler models
          at high frequency, Amy now doing lower frequencies

3. Calibration (VLA and VLBA):
      DELZN - fit calibrators for clock, atmosphere
      ATMCA - interpolate multiple calibrators to target
      CALIB, FRING - overlapping intervals
      CALIB - robust solution methods added, allows auto-flagging

4. Work toward pipelines:
      VLARUN - VLA pipeline procedure, good first start
      VLBAPIPE - VLBA pipeline procedure
      SYSTEM - new verb to do system commands from inside AIPS
      FLAGR/FINDR - auto-editing tasks
      RLDIF - new task to return parameter for pol. calibration
      IMFIT/SETFC,others - return results to AIPS

5. Plotting - full color control of line drawing:
         separate contours by spectral channel
         color polarization vectors by angle
         separate IFs, polarizations in point plots

6. Documentation:
      CookBook kept up to date
      CookBook now available in cross-linked html and pdf forms
      XHELP links help files using browser also with the html and pdf
          CookBook

6. Systems:
      Mac OS/X - AIPS port
      Binary installation: Mac w IBM, Solaris w SUN, Linux w Intel
      Read-only file systems for DATs, security purposes
      MNJ - updates systems area, POPS automatically
      

*************************************************************

   Slide showing the shipping data


*************************************************************

Current VLA Pipeline "VLARUN"

calvlarun:  (SNPLT between steps)
    SETJY  - clear then calculate for flux calibrators
    CALIB  - P solution on all calibrators
    CLCAL  - move above to CL table
    CALIB  - apply previous cal, average, do A&P
    GETJY  - convert gains of all cals to same scale
    CLCAL  - apply above to CL table
    If (line work) then
       copy tables to line data
       BPASS  - find bandpass calibration
       POSSM  - plot bandpass calibration
    TASAV  - save tables to null file

imavlarun:
    SPLIT  - apply calibration
    For each source in dataset (read SU table to find)
        IMAGR - each IF separately in line data

*************************************************************

Current continuum VLBA Pipeline "VLBAPIPE"

1. Load data: merge tables, sort & subarray, split FQIDs

Loop over FQIDs

2. Calibrate amplitude: sampler offsets, gain curves, Tsys

3. Calibrate phase: parallactic angles, instrumental delay
                    from pulse cal or manual

4. Extras: some flagging, scalar bandpass, TEC-correction

5. FRING: fringe strong sources, phase-reference weak ones

6. SPLIT: multi-source data into calibrated single-source

7  Image: make images with optional self-cal

Do data inspection, backup

 - have flow diagram slide

*************************************************************

Future VLARUN - work in progress

Script: Fetch project from archive
        FILLM - load data to AIPS
        Discard line data, separate FQIDs
        Examine data - integration times, cal sources, array
        FLAGR - auto-edit with scalar average = 3 int time
        construct RUN file to process data
           have AIPS run the RUN file
        output to archive

VLAPIPE - run by RUN file
        QUACK - edit start of scans
        CALRD - read any calibrator models
        SETJY - calculate for flux calibrators
        CALIB - P, then A&P with models
        CALIB - P, then A&P for cal sources w/o models
        GETJY - bring all cals onto same scale
      * FLAGR - vector functions such as VDIF
      * SETFC - choose image parameters, multi-facet
        IMAGR - clean to 3 x theoretical noise
      *       - multi-facet, self-cal with SCIMG
      * FLATN - multi-facet -> single image
      * PBCOR - correct primary beam
      * FITAB - write out cal tables,
              - calibrated single-source UV data
              - images
   Where * are planned functions soon to be implemented

Future capabilities:
   Polarization - calibrate
                - RLDIF
                - image in polarization
   Spectral line - bandpass calibration
                 - imaging with continuum subtraction??

*************************************************************

Longer range (2006-2009) plans for AIPS

1. Assumption that personnel will not increase and we hope not
   decrease

2. Continue to support the majority of VLA and VLBA users plus some
   users of other instruments (e.g. GBT imaging):
   - install AIPS on whatever computers are used by astronomers
   - correct bugs in exsiting capabilities
   - enhance existing capabilities for convenience issues

3. Pipeline development:
   - enhance tasks in aid of pipelines
   - develop and test pipelines for polarization and spectral line
     for VLA and VLBA
   - new tasks if needed to support pipeline data calibration
   - upgrade FLAGR auto-flagging task

4. VLBA support:
   - additional astrometry tasks e.g. DELZN, ATMCA
   - additional data corrections as needed (e.g. Earth orientation)
   - CALC in AIPS

5. EVLA development
   - Support old and then prototype correlator
   - experiment with algorithms
        -  for spectral index
        -  for mosaicing
   - calibration modes
        - full combined total intensity and polarization solutions if
          needed
        - fringe-fitting across wide bandwidth before bandpass cal
   




More information about the Daip mailing list