User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


R1747

Katherine VSN: MAT+0010 Starting vol.: 1292.5 GB

  • 1705UT Experiment started OK

Yaragadee VSN: WSRT-061 Starting vol.: 0 GB

  • 1705UT Experiment started OK
2016/07/04 16:08 · Jesse Swan · 0 Comments
R4746

Katherine

Module: HOB+0117, start pos: 7723.730 GB

  • 18:30 UT - Experiment started ok. (Ellen)
  • 22:13 UT - Modules swapped as I was recording to the wrong one and it needs to be shipped down today. First scan on the Module UAA-0034 is 182-2220a. Missed scan 182-2214. (Ellen)
  • 13:50 UT - Channel 9's system temperature hight (160 K).

Yarragadee

Module: USN-0177, start pos: 0 GB

  • 18:30 UT - Experiment started ok. (Ellen)
  • 13:50:36.73; Channels' 9, 10, 12, 13 system temperature high; 170, 160, 240, 160 K respectively. (Lucas).
2016/06/30 13:09 · Jesse Swan · 0 Comments
CRF95

Katherine

Disk VSN: HOB+0117 Starting volume: 6680.4GB

  • 18:00UT Experiment started OK (JR)
  • 03:10UT WARNING: error ib -4 gpib device time-out on response c2. Everything seems to be okay, both counters were responsive. (Arwin)
  • 14:00 UT - tsys bands 05, 09-1 too high consistently. Autocorrelation is a little fuzzy, but nothing too odd. (Ellen)

Yarragadee

Disk VSN: HOB+0104 Starting volume: ~8250GB

  • 18:00UT Experiment started OK (JR)
  • 18:00UT Due to econtrol repeatedly freezing I did not manage to see the exact starting volume (JR)
  • 14:00 UT - tsys bands 09-11, 14 too high consistently. Autocorrelation is a little fuzzy, but nothing too odd. (Ellen)

Hobart 26m

Disk VSN: HOB+0034 Starting volume: 2176.609

  • 18:00UT Experiment started OK (JR)
  • 19:19UT Drives not switching on. Attempting drvon in vdesk. Contacted on call person (Jamie) who advised to try it a few times. If it did not work then will have to reset the drives manually.
  • 20:37UT Drives manually reset and now fixed. First good scan should be 181-2038 (source 2106-413) (JR)
  • 04:32UT unsure of exactly how much data has been missed. Disk position currently 49 gb behind according to me but I could be wrong. Will keep and eye on it. (Arwin)
  • 06:29UT disk currently 56 gb behind, another 7gb from the last check two hours ago. (Arwin)
  • 12:00UT Disk position seems normal based on the starting volume. Drifts from predicted at ~2 GB per hour (Bryn)
2016/06/29 18:38 · Jesse Swan · 0 Comments
RD1605

Hobart 26m

VSN: HOB+0029/6000/1024 Starting volume: 0gb

  • 17:32.47UT – antenna acquired for first source (recording due at 17:33:38UT) (JS)
  • 22:30 UT - After the recording stops in every single scan (as far as we could tell) get the error “ALARM: error m5 -104 mk5cn: time-out, connection closed”. Because it is happening consistently, suspect something worse than just bad connection. Jamie is on the case. (Ellen)
  • 22:50 UT - Swapped modules as Jamie thinks there's a bad disc (disc 6 was sometimes reporting a fault). Last scan on module HOB+0029 is 180-2245 at 731.787 GB. First scan on module HOB+0034 is 180-2252. (Ellen)
  • 01:45 UT - Schedule restarted to implement edit to snp file (Jamie removed “source=stow” command) because drives are getting snarky when turned off. (Ellen)
2016/06/28 13:15 · Jesse Swan · 0 Comments
r1746

Katherine 12m:

Disk VSN: HOB+0105

Data volume at beginning: 10141 gb Data at end: 13072.8GB

  • 15:52 UT Suddenly had many instances of the following error “WARNING: error st -27 computer acu time difference exceeded 0.25 seconds, see value above.”. It eventually stopped, all seems okay. Wiki says this error arises when etransfers are going on, can be safely ignored. (Arwin)
  • 17:00 UT Experiment started OK (Arwin)
  • Setup code was “setup8f” not “setupsx” (Arwin)
  • Temp sensor on system monitor not working (Arwin)
  • 12:39 UT disk_pos is approx. 15 gb behind where it should be. At the previous check (10:36 UT) disk_pos lagged by 4 gb, keeping an eye on it.(Arwin)

Yarragadee 12m:

Disk VSN: HOB+0102

Data volume at beginning: 10141 gbd Data at end: 12742.6GB

  • 17:00 UT Experiment started OK (Arwin)
  • 17:05 UT Mark5 lost connection and fmset would not display anything. Halted the schedule. Tried restarting the fs and Dimino but to no avail. Jamie rebooted mark5 and Dimino and made sure ntpq -nq servers were sensible. Fmset came back at this point. Restarted the schedule. Scans missed 179-1705 - 179-1829. (Arwin)
  • 18:32 UT started recording again. (Arwin)
  • Humidity showing up as zero despite some light rain in the area, sensor not working? (Arwin)
2016/06/27 16:53 · Ross Turner · 0 Comments
R4745

Katherine 12m

Disk VSN: USN-0155

Data volume at beginning: ??

  • 1830 UT Katherine hasn't started yet. Getting errors about “2016.175.18:32:07.65?ERROR m5 -23 mk5cn: error opening, mark 5 probably not running, see above for error” But I don't know how to make it run? Tried IP switching it (the mk5) off and on again but now the ssh's don't work? Internet failure? (Lucas).
  • 19:10 UT Ellen said that if the ssh oper@mk5ke isn't working then it is most likely the internet being down at Kath. I'll keep looking through the wiki and reach Brett and/or talk to Jesse about the issue (Lucas).
  • 24:04 UT Jamie has fixed the mk5 problem. Finishing set up. Jamie's response “ Mick had swapped modules and restarted the mark5 units so that we could use mk5ke for recording again, while mk5-2ke was conditioning another module. DIMino was not running on mk5-2ke, which lead to the mk5cn errors in the FS. I fixed it this morning by terminating the FS, editing /usr2/control/mk5ad.ctl to use mk5ke again, and restarting the FS.”
  • Intermittent status us slewing errors. (Arwin)

Yarragadee 12m

Disk VSN: USN-0005/ 2000.138

Data volume at beginning: 0.673 GB

  • 2016.175.18:22:44 Total data recorded = at beginning of experiment to A
  • 18:40UT E-control froze and couldn't reboot. Turns out the field system crashed.
  • 19:16:44 Recording started. First good scan 175-1926b. Disk_pos gives 62.917 GB at this point. (Lucas).
  • 19:25:06 Eremote control has disappeared on the screen (like has a 'bar' but no 'under bit'). [This was eventually fixed by maximising eremote control]. Continuously monitoring e-remote control monitoring on ops4. (Lucas).
  • 15.15 UT Eremotectrl lost connection, had to restart it. There shouldn't be any interruptions to the experiment. (Arwin)
  • 16.20 UT disk_pos was about 50 gb behind where it should be, pretty consistent over the night. (Arwin)
2016/06/23 18:24 · Ross Turner · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan