User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


CRDS99

Yarragadee 12m

Disk VSN: A HOB+0042/15999.863 GB | Data volume at beginning: 1.282 GB

  • 1730UT - Experiment started OK (Prad).
2019/01/15 17:15 · Tiege McCarthy
R1877

Katherine 12m

Disk VSN: MED-0026 | Data volume at beginning: 0.0 GB

  • 1700UT - Delay drifting still persists, otherwise experiment started OK (Tiege)
  • 2136UT - Halting to reset delay drift back to something reasonable. Scans missed were 014-2137b and 014-2139 (Tiege)
  • 2200 UT - Experiment halted because drifts really bad. (katie)

Yarragadee 12m

Disk VSN: JIVE-020 | Data volume at beginning: 0.0 GB

  • 1700UT - Experiment started OK (Tiege)
  • 0230 UT - Yg connection down. Waiting for it to be fixed on site. (katie)
2019/01/14 21:35 · Tiege McCarthy
R4876

Katherine 12m

Disk VSN: MPI-0405/3200 | Data volume at beginning: 0.0 GB

* 1830 UT - Delay drift apparent. No fix. Experiment started despite this. (Atifur)

Yarragadee 12m

Disk VSN: CURT-102/6000 | Data volume at beginning: 0.0 GB

* 1830 UT - Experiment started OK. (Atifur)

2019/01/10 06:31 · Patrick Yates · 0 Comments
R1876

Katherine 12m

Disk VSN: USN-0070/4000 | Data volume at beginning: 0.256 GB

  • 0600UT - Delays are drifting for Ke. Known problem, no fix yet (Patrick)
  • 1650UT - Ke fs locked up, rebooted pcfske to fix (Patrick)
  • 1700UT - Experiment started okay (Patrick)
  • 1728UT - Field system lost connection to the antenna controller (ERROR st -998 reading SystemClock1; ERROR st -999 TCP/IP connection was closed by remote peer; ERROR st -5 Error return from antenna, see Mbus error.). Fixed with antenna=open in the field system. This kept on happening throughout the experiment. (Patrick)
  • 22:49 halted schedule to reboot timeke (warren)
  • 23:02 resumed schedule, dbbc delay still drifting (w)

Yarragadee 12m

Disk VSN: USN-0097/4000 | Data volume at beginning: 0.256 GB

  • 0600UT - Booted windyg ip switch to fix anemonitor not connecting (Patrick)
  • 0633UT - Restarted Monica.weather on pcfsyg to get weather info to show up in system monitor (Patrick)
  • 1700UT - Experiment started okay (Patrick).
2019/01/07 06:02 · Patrick Yates · 0 Comments
R4875

Katherine 12m

Disk VSN: OSOD-114/2000 | Data volume at beginning: 0.160 GB

  • 1704UT - Synced DBBC to fix delay. Will keep an eye on it in case it drifts. It is likely still broken from previous experiment. (Patrick)
  • 1715UT - Delays still drifting. Restarted dbbc and mk5ke, resynced, to try to fix. (Patrick)
  • 1830UT Experiment started okay (Patrick)
  • 22:19 halt for dbbc surgery, missed 003-2120 to 003-2249 (warren)
  • 22:57 resumed schedule with 003-2257 (w)
  • 01:19 stopped recording scan 004-0118 (w)
  • 01:20 resynced formatter and recorder (w)
  • 1023 UT - The ckloff value dropped to the order of E-001. Tried both re-configuring and rebooting the dbbc but to no avail. The fmset values were also in sync until around 1100UT (when the mark 5B clock was ahead by 0.2). Did an fmset sync at this stage which fixed the issue. The scans from 004-1026 to 004-1044 were probably affected due to the high clkoff value. The schedule was halted from 004-1046 to the 004-1053a (Prad).
  • 1343UT-The ckloff value dropped to the order of E-001. Tried both re-configuring and rebooting the dbbc. resolved the problem around 1420UT.The schedule was halted from 004-1348 to 004-1420b (Jay)
  • 1553UT-The ckloff value dropped to the order of E-001. Tried re-configuring the dbbc. Think it worked well this time. The delays looks stable now. Keeping an eye for further improvement.The schedule was halted from 004-1556 to 004-1607 (Jay)

Yarragadee 12m

Disk VSN: USN-0049/4000 | Data volume at beginning: 0.128 GB

  • 1830UT Experiment started okay (Patrick).
2019/01/03 17:00 · Tiege McCarthy · 0 Comments
R1875

Katherine 12m

Disk VSN: NYAL-019/2000 | Data volume at beginning: 0.00 GB

  • Estop was tripped and required Mick to go manually reboot drives.
  • 1700UT Experiment started okay (Lucas).
  • 17:30 Maserdelay was reading way off (around 5-7us instead of ~2) so I reconfigured and synced the dbbc and delays have settled to nominal values with an offset of -0.3 (Lucas).
  • 18:20 DBBC delay shifted dramatically. Delay difference has been slowly drifting also (Lucas).
    • Power cycling both dbbc and mk5, reconfiguring, restarting dimino and resyncing.
    • Delays and offsets back to normal. Probably will drift again. Missed scans 1824a to 1836 (Lucas).
  • Offsets gradually shifted again then at 20:40 ish the dbbc delay began shifting. At this point I again reset the dbbc but in the time since I have written this the offsets have shifted again. Something seems seriously wrong (Lucas).
  • 21:32:20 Ran dbbc=pps_sync to adjust dbbc delay as offsets began to plateau out (Lucas).
  • 22:03 halted schedule for another dbbc restart , missed scans 002-2203b to 002-2217a (warren)
  • 22:30 resumed schedule with 002-2222 (w)
  • 23:02 halted schedule for dbbc 2 hr cool-down, missed scans 002-2304b to 003-0053a (w)
  • 00:55 resumed at scan 003-0055 (w)
  • 01:00 dbbc delay still drifting! (w)
  • 03:03 abandoning experiment dbbc faulty (w)
  • 03:55 yet another attempt to fix dbbc, to no avail, resumed at 003-0352 (w)
  • 05:32 recording anyway in case some sense can be made of data (w)
  • 05:38 fmset to set delay back to 0.29 us

Yarragadee 12m

Disk VSN: USN-0147/2000 | Data volume at beginning: 0.00 GB

  • 1700UT Experiment started okay (Lucas).
2019/01/02 17:34 · Tiege McCarthy · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan