User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


r4659

Hb

  • (20:36 UT, Lucia): Large clock drifts (delay differences) from the beginning. After several DBBC config/reboots, looks stable now. First good scan# 303-2028 @303/20:28
  • recording to module HOB+0105. 0 GB.
  • strong RFI in last two s-band channels
  • Deficit of ~120 GB due to late start (vk)
  • 304/02:28 UT - Delay difference has been drifting since around 01:30 UT. JMc says to keep an eye on it until it drops below -0.300 msec.
  • 03:19 UT - Halting schedule to reconfigure DBBC as delay difference has hit -0.330 msec.
  • 03:30 UT - Restarted missed scan: 304-0324
  • 04:00 UT - Halting schedule to reconfigure DBBC as delay difference is drifting.
  • 04:08 UT - Restarted. Missed scans: 304-0353,304-0407a

Ke

  • recording to module USN-0033. 0 GB
  • two dodgy chanels in DBBC and high Tsys. This is a known problem.
  • setup: couldn't snychronise times; restart DBBC

Yg

  • (20:27 UT, Lucia): persistent ERROR 2014.303.20:28:37.16?ERROR s5 -104 rfpcn: time-out, connection closed
  • (20:27 UT, Lucia): lost antenna control due to power failure. Lost scans between 19:29 and 19:48 UT (scan# 303-1940 and 303-1945)
  • recording to module USN-0178. 0 GB
  • troubles with Internet Connection to Yg while setting up (could not even ssh to). Yg people fixed that by rebooting the router (?).
  • More internet problems at about 09:09 UT lost connection and did not get it back until 10:21UT (could have been a lot sooner if I hadn't been holding out false hope that it might fix itself), guys rebooted the D-link

error for fringe check: not successful. Automatically selected source was not visible from Yg (antenna limits reached).

Qcode   % of Total   % of Correlated
          scans          scans
 5-9       92%           93%
  0         4%            4%
 B-H        2%            2%
Removed     1%

Qcodes 7-9 Correlated 92% Qcode N Not Correlated 0%

+CORRELATOR_NOTES

+STATION_NOTES

HOBART12 (Hb/H): Station experienced large clock drifts from start

               of session to 303-2028.
               Clock again drifted after approximately 303-0130, 
               continuing until DBBC reset at 304-0407.
               Low fringe amplitudes in channel SR6U, 
               leading to occasional 'G' codes.
               Channel SR6U removed from fringe fitting.

KATH12M (Ke/A): Ok. YARRA12M (Yg/Y): Ok.

+DROP_CHANNELS

Ft SR4U Hb SR6U

Other comments: a clock break in clock rates reported by the correlator for HOBART12. The effect is visible only for the single band delays, no additional break were added to the station. A small clock break is on YARRA12M baselines at the X-band.


Session Statistics

Observations:     2104 scheduled 
                  2031 correlated (in database)
                  1853 recoverable (usable)
                  1783 used
Session fit:        36.421 ps

Station Performance

                         Number of Observations
                  Scheduled   Recoverable*        Used   % of scheduled
                                                            obs used
HOBART12                471           387          369        78.3%
KATH12M                 546           495          480        87.9%
YARRA12M                504           447          431        85.5%
---------------   ---------   -----------    ---------       ------
Station Total**        2104          1853         1783        84.7%
  • Recoverable: can be included in the solution.
  • * Total includes distinct observations only.
MISSED:    Station was scheduled, but it did not observe.
NOT CORR:  Station was scheduled but not correlated.
NOT USED:  Usable data was generated for this station,
           but the analyst rejected it all.
2014/10/30 07:22 · 0 Comments
RD1410

Ho only, recording on HOB+0042

Wind stows from 03:18 UT (no summary file available so scans not noted):

  • 03:18 to 03:24
  • 03:49 to 03:55
  • 03:59 to 04:05
  • 04:12 to 04:29
  • 04:36 to 05:16
  • 05:21 to 05:26
  • 05:34 to 05:45
  • 06:03 to 06:08
  • 12:33 to 12:36 ??(JS)
  • 14:25 to 14:45 ??(JS)
2014/10/28 17:04 · 0 Comments
r1659

Hb TR-00014

  • RFI spikes in ch 14, 15 (0-15) (Liza)
  • 22:07 UT - Windstowed (vk)
  • 22:46 UT - Observations resumed. Missed scans: 300-2210b to 300-2241 corresponding to deficit of 36 Gb
  • 23:19 UT - Windstowed
  • 23:31 UT - Obs resumed. Missed scans: 300-2320a, 300-2325b and 300-2327 corresponding to cumulative deficit of 42 Gb
  • Hb needed manual intervention to recover from above windstows.
  • 301/00:43 UT - Windstowed
  • 00:52 UT - Obs resumed. Missed scans: 301-0040, 301-0046 and 301-0050 corresponding to cumulative deficit of 62 Gb.
  • Reported cumulative deficit with disk_pos is ~20 Gb, not 62 Gb. This is because mk5 begins to record after command to exit windstow is issued, even though the antenna drives do not activate until fs is restarted.
  • 01:24 UT - Windstowd
  • 07:12 UT - Returned from windstow. First scan 301-0712a. (DH)

Ke BKG+013

  • Experiment started OK by Dave (vk)
  • Steep slopes on chans 11 & 12 in autocorrelation plot
  • 301/01:54 UT - disk_pos is 40 GB in excess?

Yg USN-0035

  • Experiment started OK by Dave (vk)
+SUMMARY 
 Qcode      % of Total   % of Correlated 
                scans          scans     
 
  5-9            89%            94% 
   0              4%             4% 
 4-1,A-H,N        2%             2% 
 Removed          6%             - 

+CORRELATOR_NOTES

+STATION_NOTES

HOBART12 (Hb/d): Missed scans:

                from UT 300-2210b to UT 300-2241, 
                at UT 300-2320a, UT 300-2325b and UT 300-2327,
                at UT 301-0040, UT 301-0046 and UT 301-0050, 
                from UT 301-0124 to UT 301-0712
                due to windstow.
                Note that some of the above scans contribute to the 
                statistics as non-detections.

KATH12M (Ke/a): Ok.

YARRA12M (Yg/i): Ok.

Problems: Hobart12 had several windstows, one lasting ~6 hrs.

        The cable cal at NYALES20 was unstable, with 2 breaks.
        It was not applied. This has happened several times
        recently and is being investigated. 

Parameterization comments: None.

Other comments: None.


Session Statistics

Observations:     2766 scheduled 
                  2585 correlated (in database)
                  2353 recoverable (usable)
                  2265 used
Session fit:        42.591 ps

Station Performance

                         Number of Observations
                  Scheduled   Recoverable*        Used   % of scheduled
                                                            obs used
HOBART12                690           433          422        61.2%
KATH12M                 717           617          590        82.3%
YARRA12M                703           577          553        78.7%
---------------   ---------   -----------    ---------       ------
Station Total**        2766          2353         2265        81.9%
  • Recoverable: can be included in the solution.
  • * Total includes distinct observations only.
MISSED:    Station was scheduled, but it did not observe.
NOT CORR:  Station was scheduled but not correlated.
NOT USED:  Usable data was generated for this station,
           but the analyst rejected it all.
2014/10/27 22:21 · 0 Comments
R4658

Hb:

  • Started OK, writing on USN-0054 with 1523GB (Liza)
  • S-band Tsys are elevated (115-160K) (Liza)
  • RFI spikes in ch 14, 15 (0-15) (Liza)
  • Huge clock jump at 294.763 (from -0.25 to ~0.0), alarms did NOT go off - probably because DIMINO switched off (Ellen and Liza)

Ke:

  • Started OK, written on HOB+0108 with 8054GB (Liza)
  • S-band Tsys are elevated (110-190K) (Liza)
  • RFI slopes in ch 11, 12 (0-15) (Liza)

Yg:

  • Started OK, written on USN-0017, blank (Liza)
  • Some channels in S-band have elevated Tsys (Liza)
  • RFI spikes in ch 12, slope in ch 15 (0-15) (Liza)
  • Huge clock jump at the same time as Hb (day number 294.763) from -0.3 to 0.0 (Ellen)
2014/10/21 19:22 · 0 Comments
R1658

Hobart:

  • Recording to 6TB module USN-0054 in bank A, +0GB (Ross).
  • 17:00 UT: Experiment started OK (Ross).
  • (Jesse) Manual module swap (w/ Brett and Liza) swap at ~00:47:20 UT, schedule restart (line #1758) onsource at 00:51:08.20 UT (Note: This scan was due to start at 00:51:03 UT)

Katherine:

  • Recording to 2TB module IAA-0023 in bank B, +0GB (Ross).
  • 17:00 UT: Experiment started OK (Ross).
  • 19:34 UT: Large jump in time offset, -0.2703s at 19:32:58 and -0.4028s at 19:34:04, up to -1.1178s at 19:40:06, schedule halted (Ross).
  • 19:41 UT: Field system reset, time offset steady at -0.0689s, schedule restarted (Ross).
  • 19:51 UT: Time offset greater than -1s again, schedule halted (Ross).
  • 20:24 UT: Restarted DBBC and resynced field system, time offset stable at -0.0034s, schedule resumed (Ross).
  • Missed scans 293-1932 through 293-2029 (Ross). ~60 GB short (VK)
  • 06:37 UT: ~40 GB short as opposed to exp. 60

Yarragadee:

  • Recording to 2TB module NYAL-019 in bank B, +0GB (Ross).
  • 17:00 UT: Experiment started OK (Ross).

+SUMMARY Qcode % of Total % of Correlated

              scans          scans     

5-9 94% -

 0              4%             - 

4-1,A-H,N 2% - Removed - -

+CORRELATOR_NOTES

+STATION_NOTES

HOBART12 (Hb/d): A few G-codes due to lower signal amplitude in the

                last two channels of the S-band.

KATH12M (Ke/a): Missed scans from UT 293-1934 to UT 293-2032, because

                FS had to be resynced.

YARRA12M (Yg/i): Ok.

Problems: Several clock breaks at Hobart12. Breaks set at 00:33

        (-3.44 nsec) and at 11:52 (-.67 nsec). Also the scans 
        from ~22:23-22:56 on the HB baselines are offset by 
        ~.7 nsec and were deselected.
        There may be one or two breaks at Yarragadee, but they
        are not so clear and applying one did not help. The 
        clock constraint was relaxed instead to 6.E-14.

Parameterization comments: None.

Other comments: Hart15m reported bad refraction corrections for

        the first 14 hrs, but the data looks okay.

Session Statistics

Observations:     6207 scheduled 
                  6118 correlated (in database)
                  5588 recoverable (usable)
                  5350 used
Session fit:        36.954 ps

Station Performance

                         Number of Observations
                  Scheduled   Recoverable*        Used   % of scheduled
                                                            obs used
HOBART12               1108           977          918        82.9%
KATH12M                1323          1188         1153        87.2%
YARRA12M               1163          1045          983        84.5%
---------------   ---------   -----------    ---------       ------
Station Total**        6207          5588         5350        86.2%
  • Recoverable: can be included in the solution.
  • * Total includes distinct observations only.
MISSED:    Station was scheduled, but it did not observe.
NOT CORR:  Station was scheduled but not correlated.
NOT USED:  Usable data was generated for this station,
           but the analyst rejected it all.

2014/10/20 16:47 · 0 Comments
AUST55

Hb

  • Recording on HOB+0088, +5285 GB (Liza)
  • Autocorrelations, RFI: peaks in ch 14, 15 (0-15) (Liza)

Ke

  • Recording on HOB+0108, +5709 GB (Liza)
  • Autocorrelations, RFI: peaks in ch 11, 12 slope in ch 15 (0-15) (Liza)
  • Started appr. 8 min late due to FS software crash, first allegedly valid scan 292-1616 (Liza)
  • Network is very slow, running on backup control (Liza)
  • 22:00 returned back eRC gui (Liza)

Yg

  • Recording on HOB+0100, +5164 GB (Liza)
  • Autocorrelations, RFI: spike and slope in ch 15 (0-15) (Liza)
2014/10/19 15:21 · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan