User Tools

Site Tools


operations:documentation:yg_manual_weather

This wiki is not maintained! Do not use this when setting up AuScope experiments!

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
operations:documentation:yg_manual_weather [2016/11/19 02:26]
Ross Turner [Using a script]
operations:documentation:yg_manual_weather [2016/11/23 21:31] (current)
Bryn Emptage
Line 1: Line 1:
 ====== Manual extraction and logging of Yarragadee weather data ====== ====== Manual extraction and logging of Yarragadee weather data ======
 We usually have a weather station connected to pcfsyg. However, if it is unavailable or broken, there is another weather sensor (used for the SLR) and it is possible to extract the data and merge it with the PCFS logs before they are submitted. Below is the procedure for doing this (a detailed description as well as a summary). Note that the external logs are updated every 30 minutes, so the Yg logs can only be processed 30 mins or more after the experiment finishes. We usually have a weather station connected to pcfsyg. However, if it is unavailable or broken, there is another weather sensor (used for the SLR) and it is possible to extract the data and merge it with the PCFS logs before they are submitted. Below is the procedure for doing this (a detailed description as well as a summary). Note that the external logs are updated every 30 minutes, so the Yg logs can only be processed 30 mins or more after the experiment finishes.
 +
 +===== Using a script =====
 +On ops2 in ''/​home/​observer/​ask/​yglogs''​ lives a script called ''​yg_wx_logs.py''​ which can be used to merge the logs with the weather data. To run the script type in 
 +<​code>​ python yg_wx_logs.py </​code>​
 +
 +The script will prompt the user for
 +  * Experiment name,
 +  * Date of the experiment,
 +  * Start time,
 +  * End time.
 +
 +With the given information,​ the script will
 +
 +  * Download the required mets files containing the weather data using sftp,
 +  * Download the log file from pcfyg,
 +  * Merge the log from pcfs with the downloaded weather data,
 +  * Backup the original log on pcfsyg with a ''​_original2.log'',​
 +  * Copy the modified log back to the pcfsyg.
 +
 +Once all that is done you can run the flogit script to transfer that log to the IVS servers. As usual please eyeball the log to make sure the script has done the right thing.
  
  
Line 52: Line 72:
 sort -s -m -k 1,1.20 -o r4750yg.log r4750yg_no_wx.log wx_r4750yg.log</​code>​ sort -s -m -k 1,1.20 -o r4750yg.log r4750yg_no_wx.log wx_r4750yg.log</​code>​
   - Make a few spot checks of the final log by eye   - Make a few spot checks of the final log by eye
-  - You can now go back to ops2 and [[operations:​documentation.ivs.logs|process the log file and submit a end email as usual]]. Please add a note to the email to say that weather data were merged into the log after the experiment+  - You can now go back to ops2 and [[operations:​documentation.ivs.logs|process the log file and submit a end email as usual]]. Please add a note to the email to say that weather data were merged into the log after the experiment. ​
- +
-===== Using a script ===== +
-On ops2 in ''/​home/​observer/​ask/​yglogs''​ lives a script called ''​yg_wx_logs.py''​ which can be used to merge the logs with the weather data. To run the script type in  +
-<​code>​ python yg_wx_logs.py </​code>​ +
- +
-The script will prompt the user for +
-  * Experiment name, +
-  * Date of the experiment,​ +
-  * Start time, +
-  * End time. +
- +
-With the given information,​ the script will +
- +
-  * Download the required mets files containing the weather data using sftp, +
-  * Download the log file from pcfyg, +
-  * Merge the log from pcfs with the downloaded weather data, +
-  * Backup the original log on pcfsyg with a ''​_original2.log'',​ +
-  * Copy the modified log back to the pcfsyg. +
- +
-Once all that is done you can run the flogit script to transfer that log to the IVS servers. As usual please eyeball the log to make sure the script has done the right thing+
/home/www/auscope/opswiki/data/attic/operations/documentation/yg_manual_weather.1479522361.txt.gz · Last modified: 2016/11/19 02:26 by Ross Turner