User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


r4660

hb

  • Recorded to HOB+0055, start 0 GB

ke

  • Recorded to GSFC+021 (along with crf84 bound for Washington), start 2227 GB

yg

  • Recorded to USN-0119 (along with crf84 bound for Washington), start 1883 GB
  • 23:30 UT: Antenna moving off source, but subsequently reaquiring target (Ross).
  • 23:32 and 01:05 UT: Antenna stuck, but problem resolved itself (Ross).
  • 01:47 UT: Antenna still moving off source for most/every source (Ross).
  • 05:44 UT: As above, antenna still moving off source for most/every source (Ross).
  • 07:18 Antenna stuck, then onsource/TRACKING, then off-source and re-acquired - kept repeating through scan 311-0722 (Ellen)
  • 11:40 e-remote keeps disconnecting and trying (though failing) to reconnect, even though there is nothing wrong with the network - I can still connect to the pcfsyg VNC and timeing VNC. I tried restarting e-remote and then closing it completely but that didn't work. Dave's backup works but I can't set up the log monitor with that. (Ellen)
  • 12:30 eventually got e-remote to work again, no idea how (Ellen)
2014/11/06 21:55 · 0 Comments
CRF84

Hb:

  • Started ok, writing on FGI-0004, at 0 (Liza)

Ke:

  • Started relatively OK, writing on GSFC+021, from 0 (Liza)
  • Tsys are too high in both bands (Liza)
  • Clock jump at 2014.309.18:34:39 (Large difference between formatter and maser delays). Also was problem before the start. Scans 309-1834, 309-1841 are affected, 18:45: halt, 18:55:38 restarted (Liza)
  • 19:58:08 ALARM: Large difference between formatter and maser delays, 20:02 halted, 20:07 restarted (Liza)

Yg:

  • Writing on USN-0119 (Liza)
  • Scan 309-1834 was lost due to manipulations with the procedure (new procedure built and loaded) (Liza)
2014/11/05 18:52 · 0 Comments
RD1411
  • UT 16:40: At schedule start getting ?ERROR ch -309 v6 alarm is on alarm. This didn't appear in the notes but valarm in pcfs seems to have made it happy. (JS)
  • UT 17:35: ready_message.pl doesn't have a ho option. Ready message not sent (JS)
  • UT 17:35: mk4 rack seems happy; all values within 0.1 - 1.0 (JS)
  • UT 19:57: I awoke to an alarm, but there is no indication of what it was in the log (smothered in amongst all of the power overflow errors I can't find anything). The system seems happy, the alarm has not restarted.
  • UT 7:54: ERC shows year 1969. This seems to be a problem with the ERC reading of information. (Lucia)
  • UT 9:06: 2014.309.09:02:00.59?ERROR ch -309 v6 alarm is on. muted with command “valarm” in the input. Seems to occur every time when changing from setup02/03 back to setup01. (Lucia)
  • UT 9:27: 2014.309.09:26:53 ALARM: error m5 -900 check formatter serial number even (Lucia)
2014/11/04 17:00 · 0 Comments
r1660

Hb

  • USN0-0202 (vk)
  • Noticed that the mark 5 formatter offset is just above 5ms, still within normal parameters, but not usually that high, need to keep an eye on it (Imogen)

Ke

  • UAO-0026 (vk)
  • 05:11UT antenna stuck - scan 308-0511 is rubbish, schedule halted after this, waiting for Martin to manually fix. We (Brett, Jamie and I) tried resetting and rebooting everything, but antenna stayed in a state where it was not permitted to drive - ie PERMIT was RED, with INACTIVE and BRAKE ON. (EM)
  • 06:22UT re-cycling the power didn't fix it, experiment scrapped for Katherine, Jamie says people will investigate it tomorrow (EM)

Yg

  • HOB+0096 (vk) - Also contains AUST56/57. Needs to be delivered to Hobart immediately after observations.
  • Start disk_pos 10043.532 GB

Correlator notes:

+SUMMARY

Qcode      % of Total   % of Correlated 
               scans          scans     
5-9            83%            93%   
0              2%             3%    
4-1,A-H,N        4%             4% 
Removed         11%             - 

+CORRELATOR_NOTES

+STATION_NOTES

HOBART12 (Hb/d): A few (5-10%) non-detections in S-band.

KATH12M (Ke/a): No data after UT 308-0511. Station reported:

YARRA12M (Yg/i): A few (5%) non-detections in S-band.

Problems: HOBART12 has a small clock break at ~06:27 (-.67 nsec).

        YARRA12M has 3 small clock breaks, at ~17:11, ~23:30, and
         ~00:17. Only the 00:17 break (+.73 nsec) is set and the
         others require deselecting a few dozen observations.
        KATH12M died after the first 12 hrs, reason unknown.
        

Station Performance

                         Number of Observations
                  Scheduled   Recoverable*        Used   % of scheduled
                                                            obs used
HOBART12                936           731          703        75.1%
KATH12M                1108           581          552        49.8%
YARRA12M               1078           862          796        73.8%
---------------   ---------   -----------    ---------       ------
Station Total**        4418          3537         3341        75.6%
  • Recoverable: can be included in the solution.
  • * Total includes distinct observations only.
MISSED:    Station was scheduled, but it did not observe.
NOT CORR:  Station was scheduled but not correlated.
NOT USED:  Usable data was generated for this station,
           but the analyst rejected it all.
2014/11/03 09:26 · 0 Comments
aust57

Hb:

  • 6460 GB recorded prior to start
  • Started okay. Missed first 2 scans as schedule files had not been prepared.
  • 01:55 UT: wind stowed
  • 02:05 UT: returned to schedule

Ke:

  • 5397 GB recorded prior to start
  • Started okay. Missed first 2 scans as schedule files had not been prepared.

Yg:

  • 4976 GB recorded prior to start
  • Started okay. Missed first 2 scans as schedule files had not been prepared.
  • Half way through experiment disk position 200GB behind schedule but nearing 500GB at end (no additional missed scans etc.)
2014/11/02 00:24 · 0 Comments
aust56

hb

  • observer Warren
  • recorded to HOB+0105
  • start at 1.7TB
  • first scan 305-0008
  • wind stowed 2:58 - 3:08 UT
  • wind stowed 3:39 UT
  • schedule halted 3:46:10 UT
  • out of stow 04:03 UT and back onsource for scan 305-0409
  • wind stowed 4:38 UT
  • schedule halt 04:43:42 UT
  • out of stow 0508 UT and onsource for scan 305-0509
  • wind stow 5:17:30 UT
  • out of windstow 05:44 ready for scan 305-0546
  • observer Imogen
  • 05:53UT - antenna in wind stow; schedule halted to avoid breaking anything
  • 05:45UT lost connection to yarragadee field system, still seems to be running
  • 06:09UT had to restart field system due to antenna getting stuck from wind stow, restarted schedule; scans 305-0543b to 305-0608 missed
  • Observer Lucia
  • 19:45 UT while searching for error (no fs activity alarm), fs restarted, dimino restarted
  • 20:14 UT: pcfshb out of disk space. probably no data between 19:30 and 20:15. Deleted test* and temp.txt in psfs/home/oper. now 260 MB free, but still 100% full. might check in a terminal on pcfshb with df -kh
  • tsys measurement not working

ke

  • observer Warren
  • recorded to BKG-0101
  • start at 0.0 GB
  • first scan 305-0012
  • observer Imogen
  • observer Lucia
  • two dodgy channels in DBBC - this is a known problem

yg

  • observer Warren
  • recorded to HOB+0096
  • start at 0.0 GB
  • first scan 305-0013a
  • observer Imogen
  • 05:45UT lost connection to yarragadee field system, still seems to be running
  • 06:38UT restarted router at control station, network connection is back online
  • observer Lucia
  • 15:24 Autocorr show one bad channel
2014/11/01 00:31 · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan