User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


A1520

Hobart

Module: HOB+130, Start disk pos: 3039.91 GB

  • Experiment started ok. (JS)
  • 04:24 UT - disk_pos has been drifting. As of now ~80 GB deficit. (vk)
  • 06:14 UT - mk5 crash. Missed scans: 162-0614 - 162-0631 corresponding to 58 GB deficit. (vk)
  • 11:14 UT - Log monitor reported the antenna stuck but everything looked completely fine (everything was green). I checked onsource and it reported that it was tracking so I'm not sure what happened. Scan 1114a may be affected. [As a side note, I noticed that this scan was meant to start at 11:14:13 but in fact didn't start till 11:14:21! And since the total scan length was less than a minute, this is a terrible percentage lost! (Ellen)
  • 11:43 UT - Disc pos ~ 200 GB behind! (Ellen)

Katherine

Module: HOB+0125, Start disk pos: 16809.96 GB

  • Experiment started ok. (JS)
  • 22:52 UT - Halted schedule to restart DBBC because of clock drift. Restarted at 23:03. Missed scans 161-2252 to 161-2300 corresponding to a 27 GB deficit (js/vk)
  • 23:41 UT - Restarted fs after discovering that it had crashed since 23:01 UT. Missed scans 161-2303 to 161-2342 corresponding to a 122 GB deficit (vk)
  • 00:08 UT - Maser power highlighted blue at 23.8 - it should be 24. Brett has been informed. (vk)
  • 00:40 UT - Restarting DBBC — again! (vk)
  • 01:01 UT - Schedule starting. Missed scans 162-0040 - 162-0058 corresponding to a deficit of 54 GB (vk)
  • 01:10 UT - Halting schedule to restart DBBC. Resuming at 01:19 UT. Missed scans 162-0110b to 162-0118 (vk)
  • 08:06 UT - pps_delay has jumped from 61950 to 61949. Seems stable for now (vk)
  • 11:25 UT - pps_delay slowly started drifting again. At 11:31 I gave up hope that it would stop and so halted the schedule to restart the DBBC. Schedule resumed at 11:35. Scans missed: 162-1132 and 162-1133. Scans 162-1135b and 162-1136a only started recording halfway through so is going to be bad. This corresponds to ~20 GB missing. (Ellen)
  • 11:47 UT - ~170 GB lost due to missing scans but disc pos is about 20 GB AHEAD?! (Ellen)

Yarragadee

Module: HOB+0129, Start disk pos: 17125.73 GB

  • Experiment started ok. (JS)
2015/06/10 17:32 · 0 Comments
R1691

Fringes detected between baseline hb-ke only. Fringes detected in S and X bands. (Ellen)

Hobart

Module: TR-00014, Start disk pos: 0 GB

  • Experiment started ok. (Ellen)
  • On-going interference in last two channels. (Dave)
  • WARNING: 2015.161.13:15:50.17#trakl#antenna stuck - Didn't seem to be an issue? Still onsource/Tracking and moved to next source OK (JS)

Katherine

Module: MED-0020, Start disk pos: 0 GB

  • Experiment started ok. (Ellen)
  • 00:10 UT: Skycam not updating. Restarting VLC did not fix. Rebooting `timeke` fixed the problem. Did not affect observations. (Dave)
  • On-going interference in last two channels. (Dave)
  • 2015.161.09:33:52 ALARM: Delay through DBBC has changed. Monitor for stability and reset DBBC if it drifts. Unchanged from previous values, but will be monitored (Ross).

Yarragadee

Module MPI-0153, Start disk pos: 0 GB

  • Experiment started ok. (Ellen)
  • Tsys bands 13 14 very high values every time. (Ellen)
  • 2300 UT: Still RFI in S-band (Dave)
2015/06/09 07:29 · 0 Comments

pcfs rebooted (Lucia)

System checks to follow before A1520!

A1519

Hobart 12m:

Disk VSN: HOB+0122/32000, Data volume at beginning: 30347.87 GB

Late start missed scans 156-1900 to 157-1921 54.5 GB deficit (JS)

Changed to HOB+0130/32000 at 01:05 UT Data volume at beginning: 0 GB

  • Module will have to be changed (~11.20 LT (something else recorded to it?)) (JS)– module is problematic, only the second half of the disks are visible, so the actual capacity was 16TB (Liza)
  • 01:03UT - Windstow activated, on intermittently till 01:24UT, scans lost 158-0103,158-0105,158-0107,158-0108b,158-0109b,158-0111,158-0113,158-0115,158-0116a,158-0117, 158-0119,158-0120, 158-0122,158-0124 (Liza)
  • ~01:05UT - Switched to the module HOB+0130/32000 during the windstow (Liza)
  • 01:33UT - windstow activated, on till 01:39UT. Scans affected: 158-0133a, 158-0135, 158-0136,158-0137a,158-0138 (Liza)
  • 0231 UT windstow until 0236 scans missed: 158-0230 to 158-0235a (JS)
  • 0240 UT windstow until 0306 scans missed: 158-0241 to 158-0305b (JS)
  • 0308 UT windstow until 0336.19 scans missed:158-0308 to 158-0336 (JS)
  • 0339.48 UT windstow until 04:34 scans missed: 158-0340 to 158-0433 (JS)
  • 0436 UT windstow until 0457 scans missed: 158-0436 to 158-0455 (JS)
  • 0500 UT Windstow until 0555 scans missed: 158-0500 to 158-0553 (JS)
  • 0604 UT Windstow until 0619 scans missed: 158-0604 to 158-0617b (JS)
  • 0621 UT Windstow until 0628 scans missed: 158-0621 to 158-0628 (JS)
  • 0631 UT Windstow until 0636 scans missed: 158-0633 to 158-0636a (JS)
  • 0638 UT Windstow until 0642 scans missed: 158-0637 to 158-0642 (JS)
  • 09:11 UT - Windstowed until 09:16. Scans affected: 158-0911a to 158-0916. (Ellen)
  • 09:20 UT - Windstowed until 09:33. Scans affected: 158-0919 to 158-0932a. (Ellen)
  • 09:37 UT - Windstowed until 09:42. Scans affected: 158-0937 to 158-0942. (Ellen)
  • 09:59 UT - Windstowed until 10:05. Scans affected: 158-1000b to 158-1003. (Ellen)
  • 10:41 UT - Windstowed until 10:53. Scans affected: 158-1041b to 158-1051c. (Ellen)
  • 11:06 UT - Windstowed until 11:13. Scans affected: 158-1106 to 158-1113b. (Ellen)
  • 11:36 UT - Windstowed until 11:50. Scans affected: 158-1136b to 158-1150a. (Ellen)
  • 12:04 UT - Windstowed until 12:09. Scans affected: 158-1204 to 158-1207a. (Ellen)
  • 13:07 UT - Windstowed from 13:00 until 13:06. Scans affected: 158-1301 to 158-1305b. (Lucia)
  • 13:36 UT - rfpcn: time-out Alarm. Monica restarted (Lucia)
  • 13:56 UT - Windstowed from 13:45 until 13:50. Scans affected: 158-1345 to 158-1350. Scan 158-1352 tracked, then windstowed again. (Lucia)
  • 14:20 UT - Windstowed from 13:54 until 14:20. Scans affected: 158-1353 to 158-1419. (Lucia)
  • 15:40 UT - rfpcn: time-out Alarm. Monica restarted (Lucia)
  • 16:34 UT - rfpcn: time-out Alarm. Alarm acknowledged (?)(Lucia)

Katherine 12m:

Disk VSN: HOB+0125/32000

Data volume at beginning: 12680.74 GB

Missed scans 156-1900 to 156-1919b 53.6 GB deficit (JS)

Yarragadee 12m:

Disk VSN: HOB+0129/32000

Data volume at beginning: 13544.61 GB

Missed scans 156-1900 to 156-1919b 50.8 GB deficit (JS)

13:05 UT: high Tsys in last two sband channels - RFI? - Called station but they don't know anything about a WLAN or so. (Lucia)

2015/06/06 19:24 · 0 Comments
A1518

Hobart 12m:

Disk VSN: HOB+0122/32000

Data volume at beginning: 26286.214 GB

Katherine 12m:

Disk VSN: HOB+0125/32000

Data volume at beginning: 8440.107 GB

  • 0537 - Minor clock jump. Offsets stable however. (Dave).
  • 0657 - Another minor clock jump (Dave).

Yarragadee 12m:

Disk VSN: HOB+0129/32000

Data volume at beginning: 9899.846 GB

2015/06/05 19:00 · 0 Comments
R4690

Hobart

Module: BKG+0136, 1.0 GB

Katherine

Module: NAIC-004, 1.0 GB

  • Maser AHM power ~/= on 23.8 (blue number). Should call Brett during the day (Lucia)
  • 02:31:06 UT PPS Delay through DBBC changed. This may cause a small break in the clock offset (Imogen)

Yarragadee

Module: USN-0087, 1.0 GB

  • ifc is on 63 attenuation but the power levels look good (Lucia)
  • 02:55:16UT ifc has righted itself to about 20 attenuation (Imogen)
2015/06/04 07:04 · 0 Comments

Achtung! R1 TRANSFER IN PROGRESS! MONITORING REQUIRED!

R1 monitoring instructions: operations:monitoring.ivs.etransfer

13:18 UT: transfer seems to be finished (Lucia)

A1517

system checks done fro all three antennas at the end of the experiment. Records included in the a1517 logs. Monica data exported to a1517$s_check.txt/png. (Lucia)

Hobart 12m:

Disk VSN: HOB+0122/32000

Data volume at beginning: 22157.891 GB

  • Missed scans 154-1730 through 154-1732a due to late finish of previous experiment (Ross).

UT 01:07 Disk deficit of 50GB (JS)

UT 02:38 Disk deficit of 68GB (JS)

UT 05:31 Disk deficit of 93GB (JS)

UT 13:05 disk deficit 150 GB (Lucia)

Katherine 12m:

Disk VSN:HOB+0125/32000

Data volume at beginning: 4201.143 GB

  • Missed scans 154-1730 through 154-1732b due to late finish of previous experiment (Ross).
  • 16:30 UT: Maser shows blue number! AHM power ~/+ dropped to 23.7 - Hobart has 24.2 and is green. Keep watching! (Lucia)

Yarragadee 12m:

Disk VSN:HOB+0129/32000

Data volume at beginning: 6270.240 GB

  • Missed scans 154-1730 through 154-1732b due to late finish of previous experiment (Ross).
2015/06/03 14:45 · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan