====== A1520 ======

**Hobart**

Module: HOB+130, Start disk pos: 3039.91 GB

     * Experiment started ok. (JS)
     * 04:24 UT - disk_pos has been drifting. As of now ~80 GB deficit. (vk)
     * 06:14 UT - mk5 crash. Missed scans: 162-0614 - 162-0631 corresponding to 58 GB deficit. (vk)
     * 11:14 UT - Log monitor reported the antenna stuck but everything looked completely fine (everything was green). I checked onsource and it reported that it was tracking so I'm not sure what happened. Scan 1114a may be affected. [As a side note, I noticed that this scan was meant to start at 11:14:13 but in fact didn't start till 11:14:21! And since the total scan length was less than a minute, this is a terrible percentage lost! (Ellen)
     * 11:43 UT - Disc pos ~ 200 GB behind! (Ellen)

**Katherine**

Module: HOB+0125, Start disk pos: 16809.96 GB

     * Experiment started ok. (JS)
     * 22:52 UT - Halted schedule to restart DBBC because of clock drift. Restarted at 23:03. Missed scans 161-2252 to 161-2300 corresponding to a 27 GB deficit (js/vk)
     * 23:41 UT - Restarted fs after discovering that it had crashed since 23:01 UT. Missed scans 161-2303 to 161-2342 corresponding to a 122 GB deficit (vk)
     * 00:08 UT - Maser power highlighted blue at 23.8 - it should be 24. Brett has been informed. (vk)
     * 00:40 UT - Restarting DBBC --- again! (vk)
     * 01:01 UT - Schedule starting. Missed scans 162-0040 - 162-0058 corresponding to a deficit of 54 GB (vk)
     * 01:10 UT - Halting schedule to restart DBBC. Resuming at 01:19 UT. Missed scans 162-0110b to 162-0118 (vk)
     * 08:06 UT - pps_delay has jumped from 61950 to 61949. Seems stable for now (vk)
     * 11:25 UT - pps_delay slowly started drifting again. At 11:31 I gave up hope that it would stop and so halted the schedule to restart the DBBC. Schedule resumed at 11:35. Scans missed:  162-1132 and  162-1133. Scans 162-1135b and 162-1136a only started recording halfway through so is going to be bad. This corresponds to ~20 GB missing. (Ellen)
     * 11:47 UT - ~170 GB lost due to missing scans but disc pos is about 20 GB AHEAD?! (Ellen)

**Yarragadee**

Module: HOB+0129, Start disk pos: 17125.73 GB

     * Experiment started ok. (JS)


{{tag>}}


~~DISCUSSION~~