User Tools

Site Tools


operations:handover

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Handover notes

Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.

Notes should be placed below the horizontal line as a new blog entry.

Continuing problems should be copied to the Current Issues page.

**Template for Handover notes:**

Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.

It is ESSENTIAL to put your name after EVERY entry. Copy and paste the template into the new handover notes

====== Experiment Name ======

**Hobart 12m**

Disk VSN: abc-123 | Data volume at beginning: 2.34 GB

   * 1300UT a comment from me (user)

**Katherine 12m**

Disk VSN: | Data volume at beginning:  GB

   * 

**Yarragadee 12m**

Disk VSN: | Data volume at beginning:  GB

   * 1300UT Experiment started okay (JMc).

Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!

Time stamp in UT * Comment * (Your Name)

For Example:

20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)

20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)

Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.


R1718

Hobart

Module: BKG+0101, start pos 0 GB

  • 17:00 UT - Experiment started ok. (Ellen)
  • 22:04 halted for SpaceX tests for 59 minutes, first scan back 348-2303a (Warren)

Katherine

Module: USN-0131, start pos 0 GB

  • 09:00 UT - Autocorrelation is quite jumpy across bands 4-7, 9 and 12. Reconfiguring the DBBC 3 times and redoing test scans did not fix this. (Ellen)
  • 17:00 UT - Experiment started ok. (Ellen)
  • 17:10 UT - Autocorrelation is now fine. (Ellen)
  • 01:30 UT - Reconf DBBC. (Dave)
  • 07:25 UT - Ran fmset. (Dave)
  • 08:06 UT - Clock jump, stable at 08:09 (Dave)
  • 09:40 UT - Clock jump. Stable by 09:42 (Dave)
  • 10:45 UT - DBBC delay changed. Change in delay difference small however. (Dave)
  • 10:50 UT - There's a lightning storm in the area. (Dave)
  • 10:00 UT - Clock jump. Stable afterwards.

Yarragadee

Module: USN-0155, start pos 0 GB

  • 17:00 UT - Experiment started ok. (Ellen)
2015/12/14 08:43 · David Horsley · 0 Comments
R4717

Hb

VSN: HOB+0068, +2528 GB

  • Exp started OK (Dave)
  • 06:10 UT - large clock jump noticed, schedule halted and dbbc reset. Missed scans 345-0609b through 345-0622. Earlier scans before shift handover may have been affected too (Ross)

Ke

VSN: HAY-0029, 0 GB

  • Exp started OK (Dave)
  • 06:30 UT - large clock jump noticed, schedule halted and dbbc reset. Missed scans 345-0605 and 345-0632b. Earlier scans before shift handover may have been affected too (Ross)
  • 06:45 UT - clock still unstable, resetting dbbc again Missed scans 345-0639 through 345-0656 (Ross)
  • 10:13 UT - clock still unstable, resetting dbbc again Missed scans 345-1015a through 345-1016b (Ross)
  • 10:58 UT - clock still unstable, power-cycled dbbc again Missed scans 345-1058a through 345-1106a (Ross)
  • 11:06 UT - clock unstable after six dbbc reboots, and a power-cycle. Giving up for now and leaving clock for remainder of experiment (Ross)

Yg

VSN: USN-0179, 0 GB

  • Exp started OK (Dave)

General comments:

  • Screens showing in incorrect order on AuScope computer and can not be corrected by restart (e.g. upper-right connects to middle, connects to bottom-left etc.).
2015/12/10 21:32 · David Horsley · 0 Comments
APSG37

Hobart

Module: HOB+0068, start pos 1654.996 GB

  • 17:30 UT - Experiment started ok. (Ellen)
  • 19:21 UT - Windstowed. (Ellen)
  • 22:04 UT - basically still wind stowed, a couple of scans might be good in between (Lucia)
  • 23:34 UT - antenna didn't recover automatically from wind stow (elevation stuck). Schedule halted, trying to fix it. Then auto wind stow again. (Lucia)
  • 07:52 UT - throughout day approximately one out of every three scans is partially recorded, rarely unstowed for longer than a few minutes. A few scans may be okay though (Ross).
  • 09:31 UT - Onsource and recording from 343-0931a through 343-1019b, (missed 343-1021a through 343-1023), 343-1033, 343-1038, (missed 343-1040a) and 343-1043 onwards (Ross)

Katherine

Module: USN-0097, start pos 0 GB

  • 17:45 UT - Experiment started late due to DBBC issues. First scan: 342-1754. (Ellen)
  • 10:04 UT - clock jump, missed scans 343-1003 and 343-1007b. (Ross)

Yarragadee

Module: UVLBI-27, start pos 1274.471 GB

  • 17:30 UT - Experiment started ok. (Ellen)
2015/12/08 17:19 · Jesse Swan · 0 Comments
R1717

Hobart

Module: HOB+0068, start pos 0 GB

  • 13:10 UT - Clock jump. (Ellen)

Katherine

Module: ULVBI-27, start pos 0 GB

  • 20:16 - dbbc would not reconnect after restart for clock drift. Missed scans 341-2016 onwards.(Ross)
  • 05:20 schedule halted after several clock breaks.
  • 08:50 schedule halted after several clock breaks. Reconfiguring DBBC (Dave)
    • 342-0856a missed
  • 09:41 DBBC still skipping. Trying another reconfig.
  • 12:42 UT - Delay difference started drifting. I logged on the DBBC VNC ready to reconfig and watched it just re-start itself. The drives also turned off mid way through the scan 342-1242a. Missed scan 342-1245b and half of 342-1249b. (Ellen)
  • 12:51 UT - Delays still drifting. Halting schedule and restarting DBBC again. And again. Looks to have stabilised. The field system then crashed. I restarted everything again and now it looks ok. Missed scans 342-1254 to 342-1333b inclusive. (Ellen)
  • 13:52 UT - started drifting AGAIN. Following Jamie's advice I'm giving up and leaving it. (Ellen)

Yarragadee

Module: NAIC-004, start pos 0 GB

2015/12/07 14:42 · Jesse Swan · 0 Comments
R4716

Hobart

Module: HOB+0114, start pos 12938.493 GB

* 18:45 UT - Experiment started late due to massive clock jump noticed in first few scans. First full scan is 337-1856 (Ross).

Katherine

Module: ULVBI-29, start pos 0 GB

  • UT0735 DBBC crashed, and was reset. Affected scans 338-0731 through 338-0752b (JS)
  • UT0746 field system manually restarted (JS)
  • UT0749 Antenna control restored (JS)
  • UT0752 Onsource and tracking for scan 338-0752b (JS)
  • UT0754 disk_record manually started. 338-0754 scan NOT successful (SEE BELOW) (JS)
  • UT0815 system temps are high +150-200K (JS)
  • UT0816 there has been no pcfs activity for 15min I believe that after manual disk_record=on the recording continued but the telescope did not move according to the schedule. I have issued a schedule=r4716ke in the hopes that this fixes the issue at the cost of a further 5min of data (JS)
  • UT0829 Scan 338-0829 successful. It can be assumed that everything between this and 338-0731 is affected. (JS)
  • 12:09 UT - Wind monitor reporting speed of 1000 km/h and says the telescope is stowed. It is actually not stowed and from what I can tell, it is tracking and following the schedule as it should. Noted in the log. (Ellen)
  • 13:31 UT - DBBC computer restarted itself again and this took the drive computer offline and the telescope got stuck on the horizon. Bad/missed scans: 338-1330 to 338-1334. (Ellen)
  • 13:46 UT - And again DBBC crashed and took the drive computer offline and the antenna got stuck. Restarted everything. Bad/missed scans: 338-1347a and 338-1349. (Ellen)

Yarragadee

Module: USN-0186, start pos 0 GB

2015/12/03 14:50 · David Horsley · 0 Comments
RD1510

Hobart 26 m

Module: HOB+0055 starting at 3563.5 GB

  • 1711UT .sum file isn't written anywhere that I can find, and I'm not sure how to build a sum file from a .vex (JS)
  • 1723UT The calu can't be released to the rakbus, needs to be switched manually before temps can be displayed (JS)
  • 22:15UT Antenna had multiple panics and got stuck on it's side, halted schedule and stopped recording while Brett fixes (Imogen)
  • 22:40UT There was a power outage at Mt Pleasant which caused everything to crash. The generator is now operating everything, schedule was restarted at 22:49UT. (Imogen)
  • 01:30UT Wind stow, schedule halted. While the antenna is in wind stow, Brett and Eric are fixing a problem with receiver communication. (Imogen)
  • 02:36UT Schedule restarted after wind had died down and receiver communication problem fixed. (Imogen)
  • 02:41UT Had to restart field system as it had lost connection with the drive pc, had to reboot drive pc and Hobart control pc, restarted field system and restarted schedule at 02:56UT. (Imogen)
  • 03:31UT another power interruption caused the field system to become unresponsive, had to restart the field system. (Imogen)
  • 06:13UT Vacuumed cryos. Restored tsys measurements with `calu -m pcfs` (Dave)
2015/12/01 17:15 · Ross Turner · 0 Comments
/home/www/auscope/opswiki/data/pages/operations/handover.txt · Last modified: 2018/10/29 16:27 by Jesse Swan