MACCS Iridium Data Processing At Augsburg
Crontab Scripts & Programs
Listing of maccs user crontab:
0,15,30,45 * * * * /Volumes/physics_data/Code/MACCS_Code/ftpsri.sh
35 19 * * * /Volumes/physics_data/Code/MACCS_Code/checkMACCSir.sh
This program runs at :00, :15, :30, :45 of every hour of every day. It downloads the latest MACCS iridium raw data files from SRI's ftp site and files them into the MACCS_DATA/Raw/ folder. Then it makes ASCII files and line plots of the data it downloaded. It calls the following idl programs (from the /Volumes/physics_data/Code/MACCS_Code/ directory) to process the data: IridiumMaccs2.pro to make Augsburg Format ASCII files which are used by linex7.pro, IridiumMaccs3.pro to make IAGA2000 Format ASCII files which are made available on the MACCS iridium website, and linex7.pro to make line plots of the data which are made available on the MACCS iridium website. It finishes by running the todaysdata.sh shell script which make copies of the line plots for the Today's Real-Time Data Plots web page.
This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It creates IAGA2000 format ASCII files from the raw iridium data.
This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It makes Augsburg format ASCII files from the raw iridium data.
This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It run on the Augsburg format ASCII files created by IridiumMaccs2.pro. It creates line graphs of the iridium data.
This script is run by ftpsri.sh at :00, :15, :30, :45 past every hour of every day. It copies the current day's line plot files to the web server and renames them. These files are made available on the Today's Real-Time Data Plots web page.
This script runs at 19:35. It emails the newest MACCS Iridium data line plot files to the listed users. If there is no new data it sends an email to report the missing data.
Non-Crontab Scripts
This script should be run on days when there is a problem with the Cape Dorset data. It moves the current day's raw and processed CD files to the Problem_Data/ folders. It can also be used to move other day's files to the Problem_Data/ folders. If the new data has just gone bad, uncomment the last section of the script to add a warning to the Today's Real-Time Data Plots web page.
This script should be run the UTC day after the problem with the Cape Dorset data has been fixed. It removes the warning from the Today's Real-Time Data Plots web page.
This script should be run on days when there is a problem with the Nain data. It moves the current day's raw and processed NA files to the Problem_Data/ folders. It can also be used to move other day's files to the Problem_Data/ folders. If the new data has just gone bad, uncomment the last section of the script to add a warning to the Today's Real-Time Data Plots web page.
This script should be run the UTC day after the problem with the Nain data has been fixed. It removes the warning from the Today's Real-Time Data Plots web page.
Convert the CD and NA iridium data into ASCII files and line plots a year at a time.
This script can be used to process a single raw Cape Dorset data file. The defult day is the current UTC day.
This script can be used to process a single raw Nain data file. The defult day is the current UTC day.
Augsburg WebServer Date Request Application
![[WWW]](http://wikispot.org/wiki/eggheadbeta/img/sycamore-www.png){kind=small}
http://space/space/index.htmlThis is the web page for the space/space MACCS data interactive request form. This site can be used to obtain binary data, IAGA ASCII data, png plots, or postscript plots of this data. The Data Request Application is created by the perl script datareq which calls the idl program datareq.pro upon form submission. Location: /Library/WebServer/Documents/space/.
This is the perl script that generates the Data Request Application web page. It calls datareq.pro upon sumbission of the form. Location: /Library/WebServer/CGI-Executables/maccs/
This program is called by datareq to display the requested data or graphs on the website. Location: /Library/WebServer/CGI-Executables/maccs/
2004 Boston University MACCS Data Processing
-
The IDL programs used in the clean step
-
The IDL programs used in the despike step
-
The IDL programs used in the manual step of removing spikes
-
The IDL programs used in the 1/2 sec to 5 sec avg step
-
The IDL programs used in the 5sec to 1 min avg step
-
The IDL programs used to merge all 1 min files in 1 big file
-
The IDL programs used in the 1 min merged files to 1 hour avg step
-
The IDL programs used in prepare the baselines for rotation
-
The IDL programs used in the rotate step
strip.pro (called by cleaner.pro)
read_maccs.pro (called by igllolik_despike.pro)
write_maccs.pro (called by igllolik_despike.pro)
five_sec_avg_fast_avg.pro (called by five_sec_avg.pro)
read_maccs.pro (called by five_sec_avg.pro)
write_maccs.pro (called by five_sec_avg.pro)
read_maccs.pro (called by sec_to_min.pro)
write_maccs.pro (called by sec_to_min.pro)
Nb. Requires an extra file "
missing.1m", to substitute
missing days
?
