1700UT Experiment started with rfpcn time-out error, have tried restarting Rxmon and Monica numerous times and error is still persisting. Also getting some clock drift. Experiment halted until things are fixed (Tiege)
1730UT Have tried any solutions mentioned on the wiki, usually after 2-3 Rxmon restarts this problem comes right, however, this time it is lingering along with other issues cropping up. The following error “WARNING: 0 : 0x03040003 : 1028 : interrupts error from mark-5b dim or dom ;” has also displayed. I am going to restart Dimino (again) and make sure there are no other funky processes running on mk5hb. (Tiege)
1758UT Experiment has started, however, rfpcn time-out is still being displayed at the start of every scan, I am hesitant to miss any more scans as the rfpcn time-out may be related to the other monica issues people have been reporting. In total I tried restarting Rxmon and monica 6 or so times each, ended dimino process and setup the experiment again, reconfigured dbbc, restarted dbbc, restarted/reconfigured dbbc and mk5 together. (Tiege)
1805UT Seeing the clock drift again (in addition to rfpcn issues) has drifted from 0.260 us to 3.09 us over past 15 mins. going to attempt to fix this now. Experiment being halted again. (Tiege)
1811UT Cycling power to mk5hb and dbbchb (Tiege)
1817UT DBBC came back fine, though mk5hb has not come back from ipswitch power cycle. (Tiege)
1830UT After multiple power cycles, mk5hb is accepting connection now, I have terminated the ds and re setup the entire experiment. First scan will be 135-1841 (Tiege)
1841UT First scan and rfpcn time-out error has still occurred, completely out of ideas now and can not make contact with Jamie. Will monitor to see if clock drift continues to occur, otherwise I am going to leave rfpcn issue as is for now. (Tiege)
0110UT Jamie has had a look at the rfpcn issue, he comments are that he believes the PIC in the pedestal is no longer answering queries, he thinks it may need to be replaced by Eric. He has disabled the rfpic command in the midob procedure (for this experiment) so the rfpcn errors will not occur. (Tiege)
0552UT mk5hb crashed, I loaded a module into the non-active bank while it was recording data to the active bank, restarted dimino and got it going by 0607UT. Comments.py will pick this up automatically (hopefully). Scans affected 136-0552 (inclusive) to 136-0612 (not inclusive).(Arwin)