AuScope VLBI Operations Wiki

User Tools

Site Tools

You are here: start » operations » handover
Trace: • handover

Sidebar

operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes 

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.

r4734

Hobart 12m:

Disk VSN: HOB+0118

Data volume at beginning: 13354.874 GB

  • 1830 UT Experiment started OK (Ross)
  • 11:15 UT - PCFS computer ran out of room for the log file (again). Missing all log entries up until 11:32 UT. (Ellen)

Katherine 12m:

Disk VSN: NAIC-004

Data volume at beginning: 0.000 GB

  • 1830 UT Experiment started OK (Ross)

Yarragadee 12m:

Disk VSN: UVLBI-36

Data volume at beginning: 0.000 GB

  • 1830 UT Experiment started OK (Ross)
  • * 1908 UT power outage due to severe storms; dbbc had to be restarted twice on site. Google Chrome on ops2 was also helpfully unresponsive too for some reason, too little memory still?? Missed scans 098-1909 through 098-1943 (Ross)
  • 2110 UT another power outage, dbbc restarted again. Missed scans 098-2111 through 098-2115 (Ross)
  • 2221 UT dbbc restarted again. Missed scan 098-2223 (Ross)
  • 2326 UT GPS clock monitoring was not running on timing PC. Restarted now (Lucia)
  • 2326 UT data lagging 67GB behind at the moment (Lucia)
  • 0046 UT monitoring alarm because of break between scans of >15min (Lucia)
  • 0155 UT dbbc died again due to power glitches in Yarragadee in bad weather. Missed scans 099-0129 through 099-0148. First good scan (though a bit late on source) is 099-0152. If this happens again, we intend to change the battery - Randall is looking for one at the moment. (Lucia)
  • 0250 UT dbbc failure due to power irregularities. New backup power module (UPS) is in now. Missed scans: 099-0232, 099-0235, 099-0238. (Lucia)
  • 0702 UT realised that the GPS receiver is not working properly. Antenna controller clock changed to the Hobart GPS clock. Run fmset several times. Then ACU time difference was huge (up to 8 sec). Fixed itself once the antenna had the new clock. In fmset, clocks are synchronised but 0.1 sec offset (how to fix (that?). Also the FS was restarted. Affected scans: ~ 06:30UT until 099-0707. First good scan 099-0712. (Lucia)
  • 09:16 UT - Occasionally checking the fmset, but there is still a consistent offset between the mark 5 and the other 2 of either 0.1 or 0.2 sec. Combined efforts of Jim, Jamie and Lucia could not fix this, so are continuing in the hope that it might fix itself. (Ellen)
  • 09:16 UT - Disc pos ~ 138 GB behind due to missed scans. (Ellen)
  • 09:33 UT - Tsys bands 09, 10, 12 slightly too high, bands 13, 14 way too high, though storm seems to have passed. (Ellen)
  • 13:13 UT - Checked the clocks and they are now synced, not sure exactly when this occurred - somewhere in the last 2 hours. (Ellen)
2016/04/07 18:47 · Lucia McCallum · 0 Comments
crds82

Hobart 26m:

Disk VSN: PKS+0021

Data volume at beginning: 0 GB

  • 1800 UT Errors from IF3, IF2, v1 and ve. Calling on-call (Warren) to sort things out. (Bryn)
  • 1820 UT Experiment started, still getting ve error: ERROR ch -308 ve total power integrator overflow. First scan is 097-1834 (Bryn)

Hobart 12m:

Disk VSN: HOB+0118

Data volume at beginning: 11492 GB

  • 1800 UT Experiment started OK (Bryn)

Katherine 12m:

Disk VSN: HOB+0097

Data volume at beginning: 9591 GB

  • 1800 UT Experiment started OK (Bryn)

Yarragadee 12m:

Disk VSN: HOB+0115

Data volume at beginning: 8976 GB

  • 1800 UT Experiment started OK (Bryn)
2016/04/06 18:38 · Lucia McCallum
t2110

Hobart 12m:

Disk VSN:HOB+0118

Data volume at beginning: 10861.56 Gb

  • 16:15 UT Unable to run system monitor for the hb 12m. Cannot connect to pcfs.phys.utas.edu.au, called on call person (Warren) after multiple attempts to start system monitor. Warren suggested running experiment without having hb 12m system monitor running. Tsys also not displaying.(AK)
  • 16.45 UT eremotectrl kept loosing connection and showing as the loaded module being full.(AK)
  • 18:00 UT Antenna got stuck. Had to call Warren again after turning the drives on/off didn't work. Warren suggesting rebooting system, it worked on the second attempt.(AK)
  • 18:00 UT As per Warren's instructions, skipped pointing and fringe checks because of the delays resulting from the aforementioned problems with hb and ke.(AK)
  • 18:30 UT Experiment started started late. (AK)
    1. Missed scans 096-1730b through to 096-1916 (48 Gb).
    2. First successful scan 096-1923
  • 13:10 UT Lots of Computer ACU time differences exceeding 0.25 seconds, resolved of own accord after ~2 mins (Bryn)

Katherine 12m:

Disk VSN:HOB+0097

Data volume at beginning: 8866.43 Gb

  • 17:25 UT eremotectrl lost connection. Tried multiple times to reconnect but it wouldnt work. Had to kill process and restart, worked on the second or the third go.(AK)
  • 18:00 UT As per Warren's instruction, skipped pointing and fringe checks because of the delays resulting from the aforementioned problems with hb and ke.(AK)
  • 18:30 UT Experiment started started late. (AK)
    1. Missed scans 096-1730b through to 096-1828 (27.7 Gb).
    2. First successful scan 096-1847

Yarragadee 12m:

Disk VSN:HOB+0115

Data volume at beginning: 8329.60 Gb

  • 18:00 UT As per Warren's instruction, skipped pointing and fringe checks because of the delays resulting from the aforementioned problems with hb and ke.(AK)
  • 18:30 UT Experiment started started late. (AK)
    1. Missed scans 096-1730b through to 096-1828 (27.7 Gb)
    2. First successful scan 096-1847
2016/04/05 20:10 · Lucia McCallum · 0 Comments
R4733
Hobart 12m:

Disk VSN: HOB+0118

Data volume at beginning: 3.9 GB

  • 18:30UT Experiment started OK (Tiege)
  • 00:16UT onsource slewing; never reached the source of scan 092-0004 at 00:04. (Lucia)
  • 14:11UT WARNING: error qo -301 warning: onsource status is slewing! (AK)
Katherine 12m:

Disk VSN: HAY-0010

Data volume at beginning: 1.8 GB

  • 18:30UT Experiment started OK (Tiege)
  • 12:34UT WARNING: error qo -301 warning: onsource status is slewing. (AK)
  • 14:00UT WARNING: error qo -301 warning: onsource status is slewing! (AK)
Yarragadee 12m:

Disk VSN: USN-0109

Data volume at beginning: 1.2 GB

note: during setup for Yarragadee, Mark5 was playing up and not allowing for DIMino to be exited, rebooted using IPS. Seems to be working fine since.

  • 18:30UT Experiment started OK (Tiege)
  • 19:00UT Shortly after experiment start began to get “ALARM: error s5 -104 rfpcn: time-out, connection closed” have restarted Rxmon and Monica, I believe it is resolved. Scans from the first (091-1830b) through to 091-1851 may have been effected. It appears this same problem occured for Nick a few nights ago, may need looking into. (Tiege)
2016/03/31 16:56 · Lucia McCallum · 0 Comments
r1733
Hobart 12m:

Disk VSN: USN+0221

Data volume at beginning: 5751.396 GB

  • 12:30UT output for iread was (was not sure how to fix the 63, however target and actual power level seemed close enough anyway!) (Nick)
    • 2016.089.11:50:59.39/ifa/1,agc,1,40000,36,39988
    • 2016.089.11:50:59.39/ifb/4,agc,4,48000,36,47992
    • 2016.089.11:50:59.40/ifc/2,agc,2,32500,51,38534
    • 2016.089.11:50:59.40/ifd/2,agc,2,35000,63,33581not
  • 13:30UT clkoff on ke went bonkers, reconfiguring the DBBC didn't work, Jamie resetting something worked, though we're not sure why. (Nick)
  • 17:00UT Experiment started OK (Nick)
Katherine 12m:

Disk VSN: USN-0014

Data volume at beginning: 9.872 GB

  • 17:00UT Experiment started OK (Nick)
Yarragadee 12m:

Disk VSN: TR-00001

Data volume at beginning: 0.000 GB

  • 17:00UT Experiment started (Nick)
  • 17:00UT ALARM: error s5 -104 rfpcn: time-out, connection closed (repeated for the first few scans)
    • Had to restart monica and Rxmon, seems to be working okay now though
    • Possibly affected Scans: 089-1700 through to 089-1721
    • First non-affected scan: 089-1726b
2016/03/29 12:41 · Nick Ham · 0 Comments
r1732
Hobart 12m:

Disk VSN: HOB+1006

Data volume at beginning: 11079.463 GB

  • 17:00UT Experiment started OK (Ross)
Katherine 12m:

Disk VSN: USN-0085

Data volume at beginning: 77.372 GB

  • 17:00UT Experiment started OK (Ross)
Yarragadee 12m:

Disk VSN: USN-0012

Data volume at beginning: 77.500 GB

  • 17:00UT Experiment started OK (Ross)
2016/03/21 13:48 · Ross Turner · 0 Comments

<< Newer entries | Older entries >>

/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan

Page Tools

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki