User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


AUA006

Hobart 12m:

Disk VSN: HOB+0126/32000

  • Exp started OK. (Dave)

Data volume at beginning: 18493 GB

Katherine 12m:

Disk VSN: HOB+0128/32000

Data volume at beginning: 7316.3 GB

  • Exp started OK. (Dave)

Yarragadee 12m:

Disk VSN: HOB+0115/16000

Data volume at beginning: 0TB

  • Exp started OK. (Dave)

Parkes 64m:

  • Exp started OK. (Dave)
  • 06:12 - Structure stress alarm raised, which halted the Az/El drives. As per the advice of staff, “atsnap unstow” released the drive halt. Schedule restarted by 06:16. Scan 133-0614 likely missing. (Chris)
2015/05/11 03:11 · 0 Comments
R1687

Hobart 12m:

Disk VSN: IAA-0023/2000

Data volume at beginning: 0TB

  • 17:00 UT - Experiment started OK (vk)
  • 00:36 UT - record pointer 15GB behind the schedule (Liza)
  • 02:00 UT - rxmon and ifbox restarted due to repeating error (Liza)
  • 02:59 UT - autostow, affected scans 132-0258a onwards, 0320a being a first valid scan (Liza)
  • 03:55 UT - autostow, 06:06 recorder off, halt schedule. Restarted 04:07 UT. Lost scans: 132-0352a onwards, 132-0415b being first valid scan (Liza)
  • 06:24 UT - restarted Rfmon and IFBox (Liza)
  • 06:27 UT - the pointer is 40GB behind, difference grows progressively due to windstows (Liza)
  • 06:27 UT and before - autocorrelation spectra demonstraed signatures of RFI - slopes and peaks - in the following channels: X5, X7, X8, S5, S6(Liza)

Katherine 12m:

Disk VSN: OSOD-118/2000/

Data volume at beginning: 0TB

  • Experiment started OK (vk)

Yarragadee 12m:

Disk VSN: HOB+0120/32000

Data volume at beginning: 25.85TB

  • Experiment started OK (vk)
  • 01:20UT restarted RXmon and IFBox due to repeating error messages. disk_pos is unaffected. (Liza)
  • 2015.132.09:37:39 WARNING: 2015.132.09:37:36.16#trakl#waiting at limit (Ross).
  • 2015.132.12:27:40 WARNING: 2015.132.12:27:38.12#trakl#waiting at limit (Ross).
2015/05/11 02:19
AUA005

Hobart 12m:

Disk VSN: HOB+0126/32000

Data volume at beginning: 16372.7 GB

  • Wind stowed from:
    • 01:45-01:51
    • 01:58-02:03
    • 02:38-02-43
    • 03:04-03:12

Katherine 12m:

Disk VSN: HOB+0128/32000

Data volume at beginning: 4428.194 GB

  • 04:18: Delay difference < -0.5 us, restarted DBBC after counters and fmset made no difference. Delay back to -0.274 us, no scans lost thanks to large gaps in schedule. (Chris)

Yarragadee 12m:

Disk VSN: HOB+0120/32000

Data volume at beginning: 17172 GB

  • AUA005 starts late, because AUA004 finishes late (finish 130-00:00:58, start 130-00:00:00). Schedule did not automatically start - first scan at 130-0007 (missed scan 130-0000). (Chris)

Parkes 64m:

Data volume at beginning: 3610 GB

  • Schedule started on time, no missed scans. (Chris)
  • 04:28 - Wind stow. Missed scan 130-0438a. (Chris)
2015/05/09 17:07 · 0 Comments
aua004

Hobart 12m:

Disk VSN: HOB+0126/32000

Data volume at beginning: ~11000 GB

  • 00:00 UT - Experiment started OK (vk)
  • 06:17 UT - Hobart disk_pos drifting ~8.3 GB/hr (vk)
  • 17:25 UT - pcfshb disk space ran out - deleted some old files. No log written since ~15:30 UT (Chris)

Katherine 12m:

Disk VSN: HOB+0128/32000

Data volume at beginning: 0 GB

  • 00:00 UT - Experiment started OK (vk)

Yarragadee 12m:

Disk VSN: HOB+0120/32000

Data volume at beginning: ~11300 GB

  • 00:00 UT - Experiment started OK (vk)

Parkes

  • 04:40 UT - Telescope ground to a halt unexpectedly. FROG was sounding alarms citing “structural stress” (amongst other things) and tripped the drives. John Sark. was informed. After investigating, he asked me to unstow the dish using atsnap. I restarted the .psn file after doing this. Recording and schedule on fs were not halted. Fault report submitted to Parkes staff. Observing resumed normally on scan 129-0456 at 4:51 UT (vk)
2015/05/08 23:31
r4686

Hobart 12m:

Disk VSN: NYAL-019/2000

Data volume at beginning: 0 GB

  • 22:55 UT Windstowed, missed scans 127-2256 through 127-2306 (Ross).
  • RFI signatures in autocorrelation spectra in channels X5, X7, S1, S5, S6 (slopes, peaks) (Liza)

Katherine 12m:

Disk VSN: USN-0079/2000

Data volume at beginning: 0TB

  • 23:24:57 - mk5 module lost vsn after other module swapped, connection to mk5 was lost, module lost pointers. Power-cycled Mark5, erased last scan to restore the pointer. Missed scans 127-2323b through 128-0034 (Ross, Liza).
  • 04:57UT – FS sowtware stopped responding at pcfske. Given it a power cycle, wasn't able to switch on, so had to call Sam at Ke.(Liza)
  • 067:20UT – pcfske is back on. Scans lost:128-0452b (may contain valid data in the beginning though)-128-0636 (may contain some useful data though, all in between are lost) (Liza)
  • RFI signatures in autocorrelation spectra in channels X6,S3, S4 (slopes, peaks) (Liza)

Yarragadee 12m:

Disk VSN: USN-0035/2000

Data volume at beginning: 0TB

  • 06:10 UT – X-band Tsys are too low (58-65K), S-band Tsys are too high (100-192K)(Liza)
  • RFI signatures in autocorrelation spectra in channels X8, S1, S2, S6 (slopes, peaks) (Liza)
2015/05/07 18:02 · 0 Comments
AUA003

Achtung! R1 TRANSFER IN PROGRESS! MONITORING REQUIRED!

R1 monitoring instructions: operations:monitoring.ivs.etransfer

Monitoring Observations on Parkes 64-m: Parkes Monitoring and Setup Instructions]

Hobart 12m:

Disk VSN: HOB+0126/32000/1024

Data volume at beginning: 5040.692 GB ← This value was stop position from aua002. aua003hb.log says that disk_pos is actually 5357.358 GB (vk)

  • 18:00 UT - Experiment started OK (vk)
  • 11:30 UT - Disc position keeps falling behind. Is now ~130 GB behind schedule (lost 30 in 2.5 hours). (Ellen)

Katherine 12m:

Disk VSN:HART+104/8000

Data volume at beginning: 3483.581 GB

  • 18:00 UT - Experiment started OK (vk)
  • 06:15 UT - brief network latency spike caused the computer acu time difference to raise to ~1s. Resolved after 2 min.
  • 12:36 UT - difference between maserdelay and clkoff reached -0.5 us. Counter didn't help. Ran fmset at the end of the scan, didn't help. So I halted the schedule at 12:52 UT shutdown the DBBC and reconfigured it and that fixed it. (Ellen)
  • 12:57 UT - schedule resumed. Missed scan 127-1251. (Ellen)
  • 13:41:04 - Large difference between formatter and maser delays. Resynced clocks though is drifting slowly still. No scans missed (Ross).

Yarragadee 12m:

Disk VSN: HOB+0124/32000

Data volume at beginning: 5448.063 GB

  • 18:00 UT - Experiment started OK (vk)
  • S band tsys consistently high (Dave)

Parkes

  • atsnap schedule not running for first ~6 hours. First good source at 23:54. (Dave)
  • 06:05 UT - Finished to make way for next experiment. (Dave)
2015/05/04 07:26
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan