User Tools
Sidebar
This wiki is not maintained! Do not use this when setting up AuScope experiments!
Handover notes
Please use this page to write up any notes on anything that needs to be passed on to the next observer or should go into the end of experiment message.
Notes should be placed below the horizontal line as a new blog entry.
Continuing problems should be copied to the Current Issues page.
**Template for Handover notes:**
Be sure to add any specific notes about the experiment if required, for example “Special back end configuration for x reason”. Put as much detail as you can - the more the better.
====== Experiment Name ====== **Hobart 12m** Disk VSN: abc-123 | Data volume at beginning: 2.34 GB * 1300UT a comment from me (user) **Katherine 12m** Disk VSN: | Data volume at beginning: GB * **Yarragadee 12m** Disk VSN: | Data volume at beginning: GB * 1300UT Experiment started okay (JMc).
Format for entering a comment It is important to stick to this formula - there is a good reason we need this information, so please include it!
Time stamp in UT * Comment * (Your Name)
For Example:
20:00UT: Wind stows, Missed scans 012-3456 to 012-3457 (Jim)
20:50UT: Mark5 lost connection, had to restart Mark5 and reconfigure DBBC, called Jamie on call to fix, missed scans 012-3456 to 012-4567 (Jim)
Again - as much detail as you can. It is important to remember that these notes will be sent to the correlator, so please make sure they make sense to others.
c1702/v1702
Hobart 26
Disk VSN: HOB+0132
Data Volume at Beginning:
- 0000 UT Experiment started OK (Bryn)
- 0145 UT SX Receiver pressure hit 5 microns Hg, called Warren at Mt. P (Bryn)
- 0300 UT SX receiver pressure still fluctuating between 4.5 and 5.3 (Bryn)
- 0545 UT SX receiver pressure still fluctuating between 3.5 and 5.2, although higher values are less frequent (Jonny)
Katherine
Disk VSN: GSFC+018
Data Volume at Beginning: 0 GB
- 0000 UT Experiment started OK (Bryn)
Yarragadee
Disk VSN: HOB+0083
Data Volume at Beginning: ~2126 GB
- 0000 UT Experiment started OK (Bryn)
C1701
Experiment Name
Hobart 26m
Disk VSN: HOB+122/32000 | Data volume at beginning: 5475.5 GB
- Fringes found in c1700f fringe test.
- Live page reporting spurious error (MULTIPLE_LIMITS) and drive PC misreading wind speeds.
- Using dbbchb/mk5hb (fs-mk5hb). clkoff and maserdelay now reading correctly from the mk5hb.
- 20k temperature is 420K, has been since setup. However is consistent slash the 70k is 50k. Bug?
Katherine 12m
Disk VSN: USN-0150/4000 | Data volume at beginning: 3.974 GB
- Fringes found in c1700f fringe test.
Yarragadee 12m
Disk VSN: HOB+0083 | Data volume at beginning: 0.224 GB
- Experiment started ok.
aua032
Hobart 26m
Disk VSN : HOB+0132
Data volume at beginning: 1849.6 GB
- experiment started late due to schedule file. Missed the first scan no0001 (mas)
- 03:40 UT - Lost connection to telescope, seems to be a lightening strike which has knocked out multiple systems. The antenna stowed due to a high wind speed reading and cannot talk to the mark 5 or receiver. Hobart has left the experiment as of 08:00 UT (Ross)
Katherine 12m
Disk VSN : HOB+1010
Data volume at beginning: 1567.368 GB
- experiment started late due to schedule file. Missed scan no0001,no0002,no0003,no0004,no0005,no0006, no0007,no0008 (mas)
- received quite regular warnings: error an -103 pointing computer tracking error are too large (mas)
- ALARM: error m5 -900 not while recording or playing following with warning:error m5 -906 mark5 return code inconsistent or conflicting request, occurred at UT 16:00:34, 16:36:02, 17:09:31 & 17:49:48 (mas)
Yarragadee 12m
Disk VSN : HOB+0112
Data volume at beginning: 1815.829 GB
- experiment started OK (mas)
- received quite regular warnings: error an -103 pointing computer tracking error are too large (mas)
- 06:23 UT - The connection to the mark5 has been lost. Rebooted the mark 5 but cannot reconnect. Reconfigured the dbbc and rebooted the mark5 again. Resumed observing at 07:13 UT. Missed scans no0188 through no0196 (Ross)
CRDS92
Hobart 26m
Disk VSN: HOB+0132
Data volume at beginning: 0.163 GB
- 1100UT: S/X receiver pressure too high, 70K stage is very high temp (186K), heading to MtP to fix (Tiege)
- 1150UT: Arrived on site, Brett is walking me through process now. (Tiege)
- 1200UT: Experiment started on time, however, S/X temperatures are going to be well above normal for the first couple of hours of data (Tiege)
- 1210UT: Turbo-pump is working its magic, however, will be staying on site until the 70K stage is <100K so I can manually turn off the pump (Tiege)
- 1440UT: closed valve, turned pump off, re-armed alarm at station and have head back to AuScope Control room. (Tiege)
Katherine 12m
Disk VSN: HOB+1010
Data volume at beginning: 0.170 GB
- 1200UT: Experiment started OK (Tiege)
Yarragadee 12m
Disk VSN: HOB+0112
Data volume at beginning: 0.180 GB
- 1200UT: Experiment started OK (Tiege)
r4819
Katherine 12m
Disk VSN: NTO-0002
Data volume at beginning: 0.192 GB
- 1830UT: Experiment started OK (Patrick)
- 0624UT - Drives stuck during scan 326-0622, fixed within one minute, data probably not useable for this scan. (Tiege)
- 0629UT - Drives knocked out again, this time tried stopping recording, terminating fs, then rebooting drives, drives are green again but FS will not start, rebooting pcfske now (Tiege)
- 0653UT - pcfske wasnt pingable after ~8 mins, tried rebooting again and am just going to have to wait until it lets me ping it (Tiege)
- 0710UT - pcfske back up, however hardware clock is wrong. Corrected hardware clock using 'hwclock -w' however ERC is still showing the wrong time (despite restarting fs and ERC), Bryn mentioned that after setting hwclock pcfske needs to rebooted again so I am trying that. (Tiege)
- 0830UT - pcfske is back up again, however hwclock is back to 2008 again.. working on a solutions (Tiege)
- 0850UT - With the help of Jamie, clock issues have been fixed. Needed to run 'hwclock -w' again to change hardware clock, then disable fscking on reboot by editing '/etc/fstab' as root and changing the last number on the line /dev/md0 to 0 (instead of 1), then rebooting the pcfske. Now ERC and fs have the correct time. First scan back is 326-0852, probably safe to assume majority of data between scan 326-0622 and this scan is bad. (Tiege)
Yarragadee 12m
Disk VSN: USN-0182
Data volume at beginning: 0.192 GB
- 1730UT: Antenna stuck, turned drives on and off twice then switched to operate and it worked. (Patrick)
- 1830UT: Experiment started OK (Patrick)
R1819
Katherine 12m
Disk VSN: UAO-0031
Data volume at beginning: 0.737 GB
- 0600UT - “reading SystemClock1” error, displaying “Error 10054” in the 'WRITE' box of the COMMS STATUS on timeke. Fixed by resetting drives, antenna=open and operate etc. (Tiege)
- 1500UT - Same issue as earlier except now antenna=operate gives “Power on timed-out” error, original fix has not worked, working on a solution (Tiege)
- 1526UT - No solution found yet, this issue only appears to have occurred twice, once with an undocumented solution, and the other was due to the emergency stop being bumped by kangaroos. None of the resets appear to be working, antenna remains stuck. I have contacted Warren who could not think of a fix. I am going to try and make cotnact with Mick so he can go take a look in the morning. (Tiege)
- 1532UT - Just noticed when comparing to the Yg HMI, the 'E STOP' button is red for Ke (as opposed to green at Yg) so it looks like that is indeed the issue. Have messaged Mick requesting that he go out and take a look as soon as he can. In theory, telescope should be ready to go as soon as this is done. (Tiege)
- 1558UT - Mick is heading out now to take a look (Tiege)
- 1630UT - Drives are back up and running, waiting for information about what was done by Mick (Tiege)
- 1635UT - 'E STOP' was not pressed, however, Mick went inside and saw that a yellow light was flashing, so he cycled the power and when everything came back up, the light was not flashing anymore and the telescope was no longer stuck. His comment is as follows “Turned the main switch off for 20 secs then back on. The emergency reset light was blinking and after the turn off/on the light stopped blinking.” He mentioned there were some power surges earlier on in the night, and suggested that the power may have gone off and on multiple times during the evening. (Tiege)
- 1700UT - Experiment started OK (Tiege)
- UT 08:27 ALARM: error st -998 reading systemclock1, ALARM: error st -999 tcp/ip connection error. Antenna communication software (antcn) problem. Fixed with commands “antenna=operate” and “antenna=open” (Jonny). Scan 325-0825 missed.
Yarragadee 12m
Disk VSN: USN-0172
Data volume at beginning: 0.737 GB
- 1700UT - Experiment started OK (Tiege).
- 2050UT - Yg network has died, attempting to bring it back up, have noticed an inconsistency between the IP address given for the router PC on the wiki, and the one in /etc/hosts. Cant VNC into either IP though, however can ping the one given on the wiki (Tiege)
- 2115UT - network keeps coming in and out of existence, pings are varying between 200 ms and 16000+ ms, unable to get eremote control connected yet (Tiege)
- 2122UT - Network decided it was time to behave now, eremote control is back working. Network is still slower than usual though. (Tiege)
- 2133UT - Eremote control has lost connection again, however the network is good enough to stream the log, so log monitor is now monitoring the streamed log (“/tmp/yg.log”). ERC is going in and out of being connected as the network fluctuates. (Tiege)
- 1446UT - error m5 -104 mk5cn: time-out, connection closed. antenna=operate and antenna=open fixed it. (Patrick)
