Recent Changes - MACCS Magnetometer Array

People

eriksteinmetz — 2007-09-19 17:41:10

Differences for People

Deletions are marked with - .	Additions are marked with +.
Line 5:	Line 5:
	+ + Erik Steinmetz + Research Scientist + Computer Science Department + Augsburg College + steinmee@augsburg.edu + (612) 330-1062

Users/maccs

PhilipNeustrom — 2007-09-11 20:13:24

note to you about style

Differences for Users/maccs

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ [[Comments]] + + Hey there, I just wanted to let you know that you can surround code in braces, like this: + + {{{ + #Get the current year, julian day and previous 6 days in UTC + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + #NDAY=`echo $DAY + 1 \| bc` + PDAY=`echo $DAY - 1 \| bc` + P2DAY=`echo $DAY - 2 \| bc` + P3DAY=`echo $DAY - 3 \| bc` + P4DAY=`echo $DAY - 4 \| bc` + P5DAY=`echo $DAY - 5 \| bc` + P6DAY=`echo $DAY - 6 \| bc` + }}} + + To have it display nicer. It will remove all of the extra formatting for you. You can also upload source code as files to a page (Edit -> Upload Files) and then use the {{{[[File(name)]]}}} macro to refer to the file on the page. + + Best, ["Users/PhilipNeustrom"]

linex7.pro

maccs — 2007-09-04 19:40:04

Differences for linex7.pro

Deletions are marked with - .	Additions are marked with +.
Line 704:	Line 704:
- set_plot, 'ps' - device, filename=fnameseq,/landscape - !p.multi=[0,1,3] - - !x.style=1 - !x.margin=[10,10] - !x.style=1 - !y.margin=[2,2] - - - plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ - xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Mag H',$ - xtickformat='xticks', ystyle=18 - ;!Y.TITLE = STRMID(LAB,63,4) - plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ - xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='Mag z',$ - xtickformat='xticks', ystyle=18 - ;!Y.TITLE = STRMID(LAB,67,4) - plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ - xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Mag H',$ - xtickformat='xticks', ystyle=18 - device, /close_file	+ ; set_plot, 'ps' + ; device, filename=fnameseq,/landscape + ; !p.multi=[0,1,3] + + ; !x.style=1 + ; !x.margin=[10,10] + ; !x.style=1 + ; !y.margin=[2,2] + + + ;plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Mag H',$ + ;xtickformat='xticks', ystyle=18 + ;;!Y.TITLE = STRMID(LAB,63,4) + ;plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='Mag z',$ + ;xtickformat='xticks', ystyle=18 + ;;!Y.TITLE = STRMID(LAB,67,4) + ;plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + ;xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Mag H',$ + ;xtickformat='xticks', ystyle=18 + ; device, /close_file
Line 736:	Line 736:
- ;set_plot, 'ps' - ;device, filename=fnamelp,/landscape - ;!p.multi=[0,1,3] - - ;!x.style=1 - ;!x.margin=[10,10] - ;!x.style=1 - ;!y.margin=[2,2] - ;;**********UThis is the spot that controls titles for the postscript plots********************** - - ;plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ - ;xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$ - ;xtickformat='xticks', xminor=5,ystyle=18 - ;;!Y.TITLE = STRMID(LAB,63,4) - ;plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ - ;xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$ - ;xtickformat='xticks',xminor=5, ystyle=18 - ;;!Y.TITLE = STRMID(LAB,67,4) - ;plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ - ;xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$ - ;xtickformat='xticks',xminor=5, ystyle=18 - ;device, /close_file - - ;Use Z-buffer	+ set_plot, 'ps' + device, filename=fnamelp,/landscape + !p.multi=[0,1,3] + + !x.style=1 + !x.margin=[10,10] + !x.style=1 + !y.margin=[2,2] + ;**********UThis is the spot that controls titles for the postscript plots********************** + + plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$ + xtickformat='xticks', xminor=5,ystyle=18 + ;!Y.TITLE = STRMID(LAB,63,4) + plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$ + xtickformat='xticks',xminor=5, ystyle=18 + ;!Y.TITLE = STRMID(LAB,67,4) + plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$ + xtickformat='xticks',xminor=5, ystyle=18 + device, /close_file + + ;Use Z-buffer to make .png plot

datareq.pro

maccs — 2007-09-04 16:54:43

Differences for datareq.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ;***************************************************************************** + function header + + html = '<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"' $ + + string(10B) + '"http://www.w3.org/TR/html4/loose.dtd">' $ + + string(10B) + '<HTML LANG="en-US">' + string(10B) + + return, html + end + + ;*************************************************************************** + function start_html, title=title, bgcolor=bgcolor + + html = '<HEAD>' $ + + '<TITLE>' + title + '</TITLE>' $ + + '</HEAD>' $ + + '<BODY BGCOLOR="' + bgcolor + '">' + string(10B) + + return, html + end + + ;*************************************************************************** + function end_html + + html = '</BODY></HTML>' + string(10B) + + return, html + end + + ;*************************************************************************** + function a, href=href, content=content + + html = '<A HREF="' + href + '">' + content + '</A>' + string(10B) + + return, html + end + + ;*************************************************************************** + function br + + html = '<BR>' + string(10B) + + return, html + end + + ;*************************************************************************** + function h1, align=align, content + + if keyword_set(align) then begin + html = '<H1 ALIGN = "' + align + '">' + content + '</H1>' + string(10B) + endif else begin + html = '<H1>' + content + '</H1>' + string(10B) + endelse + + return, html + end + + ;*************************************************************************** + function h2, align=align, content + + if keyword_set(align) then begin + html = '<H2 ALIGN = "' + align + '">' + content + '</H2>' + string(10B) + endif else begin + html = '<H2>' + content + '</H2>' + string(10B) + endelse + + return, html + end + + ;*************************************************************************** + function h3, align=align, content + + if keyword_set(align) then begin + html = '<H3 ALIGN = "' + align + '">' + content + '</H3>' + string(10B) + endif else begin + html = '<H3>' + content + '</H3>' + string(10B) + endelse + + return, html + end + + ;*************************************************************************** + function h4, align=align, content + + if keyword_set(align) then begin + html = '<H4 ALIGN = "' + align + '">' + content + '</H4>' + string(10B) + endif else begin + html = '<H4>' + content + '</H4>' + string(10B) + endelse + + return, html + end + + ;*************************************************************************** + function h5, align=align, content + + if keyword_set(align) then begin + html = '<H5 ALIGN = "' + align + '">' + content + '</H5>' + string(10B) + endif else begin + html = '<H5>' + content + '</H5>' + string(10B) + endelse + + return, html + end + + ;*************************************************************************** + function table, align=align, border=border, cellpadding=cellpadding, width=width, $ + bgcolor=bgcolor, content=content + + html = '<TABLE ALIGN="' + align + '" BORDER="' + border + '" CELLPADDING="' + cellpadding + $ + '" WIDTH="' + width + '" BGCOLOR="' + bgcolor + '">' + string(10B) $ + + content + '</TABLE>' + string(10B) + + return, html + end + + ;*************************************************************************** + function tr, align=align, valign=valign, content=content + + html = '<TR ALIGN="' + align + '" VALIGN="' + valign + '">' + string(10B) $ + + content + '</TR>' + string(10B) + + return, html + end + + ;*************************************************************************** + function th, content + + html = '<TH>' + content + '</TH>' + string(10B) + + return, html + end + + ;*************************************************************************** + function img, src=src, alt=alt, content=content, border=border + + html = '<IMG SRC="' + src + '" ALT="' + alt + '" BORDER="' + border + '">' + string(10B) + + return, html + end + + + ;*************************************************************************** + pro doDataRequest, outputTypes, component, beginDateTime, endDateTime, stations, $ + inputPathPrefix, inputURLPrefix, outputPathPrefix, outputURLPrefix, $ + sessionID, htmlFilePath + + ; globals + common HtmlFileCommons, gHtmlFile, gHtmlFileLUN + common OutputsCommons, gMakeBin, gMakeIAGA, gMakePNG, gMakePS, gBx, gBy, gBz + + ; ===== CONSTANTS + + ; kMaxInputFiles = total number of binary data files for all stations; if, for + ; example, 9 stations are selected and two days of data are requested, then 18 + ; files would be needed... + kMaxInputFiles = 100 + + ; ===== STRUCTURE DEFINITIONS + + ; StationPropStruct - station properties (name, IAGA code, etc.) + stationProp = {StationPropStruct, maccsName:'', maccsCode:'', iagaName:'', iagaCode:'', latitude:0.0D, longitude:0.0D} + ; InputFileStruct - data file properties (name, path, associated station, Julian day number of file, etc) + inputFile = {InputFileStruct, exists:0, name:'', pathPrefix:'', urlPrefix:'', jdn:0.0D, stationProp:stationProp} + + ; ===== OUTPUT TYPES + + ; convert comma-delimited outputTypes list to array + outputs = str_sep(outputTypes, ', ') + + gMakeBin = 0 + gMakeIAGA = 0 + gMakePNG = 0 + gMakePS = 0 + foo = where(outputs, outputsCount) + if outputsCount ne 0 then begin + for i = 0, outputsCount - 1 do begin + case outputs[i] of + 'bin': begin + gMakeBin = 1 + end + 'iaga': begin + gMakeIAGA = 1 + end + 'png': begin + gMakePNG = 1 + end + 'ps': begin + gMakePS = 1 + end + endcase + endfor + endif + + ; ===== COMPONENT + + gBx = 0 + gBy = 0 + gBz = 0 + case component of + 'Bx': begin + gBx = 1 + end + 'By': begin + gBy = 1 + end + 'Bz': begin + gBz = 1 + end + endcase + + ; ===== STATIONS + + ; convert comma-delimited station code list to stations array + stations = str_sep(stations, ', ') + foo = where(stations, stationsCount) + if stationsCount ne 0 then begin + ;; prepare array of StationPropStruct structures + stationProps = replicate(stationProp, stationsCount) + for i = 0, stationsCount - 1 do begin + stationName = stations[i] + ;; fill in the rest of the information + case stationName of + 'Cape Dorset': begin + maccsName = stationName + maccsCode = 'CDR' + iagaName = stationName + ', Canada' + iagaCode = 'CDR' + latitude = '64.2' + longitude = '283.4' + end + 'Coral Harbour': begin + maccsName = stationName + maccsCode = 'CHB' + iagaName = stationName + ', Canada' + iagaCode = 'CHB' + latitude = '64.1' + longitude = '276.8' + end + 'Clyde River': begin + maccsName = stationName + maccsCode = 'CRV' + iagaName = stationName + ', Canada' + iagaCode = 'CRV' + latitude = '70.5' + longitude = '291.4' + end + 'Gjoa Haven': begin + maccsName = stationName + maccsCode = 'GJO' + iagaName = stationName + ', Canada' + iagaCode = 'GJO' + latitude = '68.6' + longitude = '264.1' + end + 'Igloolik': begin + maccsName = stationName + maccsCode = 'IGL' + iagaName = stationName + ', Canada' + iagaCode = 'IGL' + latitude = '69.3' + longitude = '278.2' + end + 'Nain': begin + maccsName = stationName + maccsCode = 'NAN' + iagaName = stationName + ', Canada' + iagaCode = 'NAN' + latitude = '56.4' + longitude = '298.3' + end + 'Pelly Bay': begin + maccsName = stationName + maccsCode = 'PEB' + iagaName = stationName + ', Canada' + iagaCode = 'PEB' + latitude = '68.5' + longitude = '270.3' + end + 'Pangnirtung': begin + maccsName = stationName + maccsCode = 'PGG' + iagaName = stationName + ', Canada' + iagaCode = 'PGG' + latitude = '66.1' + longitude = '294.2' + end + 'Repulse Bay': begin + maccsName = stationName + maccsCode = 'RBY' + iagaName = stationName + ', Canada' + iagaCode = 'RBY' + latitude = '66.5' + longitude = '273.8' + end + else: begin + maccsName = 'Unknown' + maccsCode = '???' + iagaName = 'Unknown' + iagaCode = '???' + latitude = '999.9' + longitude = '999.9' + end + endcase + stationProps[i].maccsName = maccsName + stationProps[i].maccsCode = maccsCode + stationProps[i].iagaName = iagaName + stationProps[i].iagaCode = iagaCode + stationProps[i].latitude = latitude + stationProps[i].longitude = longitude + endfor + endif + + ; ===== DATE-TIMES + + ; prepare begining and ending julian day numbers + beginDT = str_sep(beginDateTime, ', ') + beginJDN = julday(beginDT[1], beginDT[2], beginDT[0], beginDT[3]) + caldat, beginJDN, month, day, year, hour + + endDT = str_sep(endDateTime, ', ') + endJDN = julday(endDT[1], endDT[2], endDT[0], endDT[3]) + caldat, endJDN, month, day, year, hour + + ; ===== INPUT FILES + + ; prepare array of InputFileStruct structures + inputFilesArrayTemp = replicate(inputFile, kMaxInputFiles) + ; fill the 'inputFilesArrayTemp' array + fillInputFileArray, inputFilesArrayTemp, inputPathPrefix, inputURLPrefix, $ + stationProps, beginJDN, endJDN + ; get 'inputFilesArrayTemp' array size + inputsCount = 0 + for i = 0, kMaxInputFiles - 1 do begin + if inputFilesArrayTemp[i].stationProp.maccsCode ne '' then begin + inputsCount = inputsCount + 1 + endif + endfor + ; resize the 'inputFilesArray' array to simplify results of sort() + if inputsCount gt 0 then begin + inputFilesArray = replicate(inputFile, inputsCount) + stationFilesCount = 0 + for i = 0, inputsCount - 1 do begin + inputFilesArray[i] = inputFilesArrayTemp[i] + if inputFilesArray[i].exists then begin + stationFilesCount = stationFilesCount + 1 + endif + endfor + endif + + ; ===== HTML OUTPUT + + gHtmlFile = htmlFilePath + openw, gHtmlFileLUN, gHtmlFile, /get_lun + printf, gHtmlFileLUN, header() + printf, gHtmlFileLUN, start_html(title="MACCS Data Request Results", bgcolor="#ffffff") + printf, gHtmlFileLUN, h3("MACCS Data Request Results", align = "center") + + if stationFilesCount eq 0 then begin + printf, gHtmlFileLUN, h5('No data were found for the specified stations and times.') + endif else begin + kMaxStationFiles = 20 + if (stationFilesCount gt kMaxStationFiles) and (gMakeIAGA) then begin + stationFilesCountString = string(format='(i)', kMaxStationFiles) + stationFilesHtmlString = 'No more than ' + stationFilesCountString + ' ' $ + + 'station-days can be processed for IAGA ASCII output. Please ' $ + + 'return to the form and select fewer stations or a smaller time interval.' + printf, gHtmlFileLUN, h5(stationFilesHtmlString) + endif else begin + processInputFiles, inputFilesArray, beginJDN, endJDN, $ + outputPathPrefix, outputURLPrefix, sessionID + endelse + endelse + + printf, gHtmlFileLUN, end_html() + close, gHtmlFileLUN + + end + + ;*************************************************************************** + pro fillInputFileArray, inputFilesArray, inputPathPrefix, inputURLPrefix, $ + stationProps, beginJDN, endJDN + + ; construct data file names; here's a sample to illustrate: + ; <----------------path prefix---------------> + ; <-url prefix -> + ; /var/apache/htdocs/space/webdata/cd/92/cd92223.bin + + ; data file extension + inputFileExtension = '.bin' + + sizeArray = size(inputFilesArray) + numInputFiles = sizeArray[1] + if numInputFiles eq 0 then goto, TheEnd + sizeStationProps = size(stationProps) + numStationProps = sizeStationProps[1] + if numStationProps eq 0 then goto, TheEnd + + fileIndex = 0 + for stationIndex = 0, numStationProps - 1 do begin + caldat, beginJDN, month, day, year + theJDN = julday(month, day, year, 0, 0, 0) + ; non-inclusive of end julian day number + while theJDN lt endJDN do begin + + ;; day of year 001 to 365 or so...remembering to round down the julian day + ;; number to the nearest day + caldat, theJDN, month, day, year + + ;; for julian day numbers, 0.0 corresponds to noon; hence, we need to subtract 0.5 + dayNumber = floor(theJDN - 0.5) - floor(julday(1, 1, year, 0, 0, 0) - 0.5) + 1 + dayOfYear = string(format='(i3.3)', dayNumber) + + twoDigitYear = strmid(string(format='(i4)', year), 2, 2) + + ;; construct file name + ;; Unix + kDirDelimiter = '/' + ;; Windows + ; kDirDelimiter = '\' + maccsCode = strlowcase(stationProps[stationIndex].maccsCode) + inputPathSuffix = maccsCode + kDirDelimiter + twoDigitYear + kDirDelimiter + inputURLSuffix = maccsCode + '/' + twoDigitYear + '/' + fileName = maccsCode + twoDigitYear + dayOfYear + inputFileExtension + filePath = inputPathPrefix + inputPathSuffix + fileName + + ;; test for existence of file; use get_lun and free_lun since openr, + ;; /get_lun might not give us a valid LUN with which to use close,... + get_lun, ourLUN + openr, ourLUN, filePath, error=err + free_lun, ourLUN + if err eq 0 then begin + ;; no error occurred; assume file exists + inputFilesArray[fileIndex].exists = 1 + endif + + inputFilesArray[fileIndex].name = fileName + inputFilesArray[fileIndex].pathPrefix = inputPathPrefix + inputPathSuffix + inputFilesArray[fileIndex].urlPrefix = inputURLPrefix + inputPathSuffix + inputFilesArray[fileIndex].jdn = theJDN + inputFilesArray[fileIndex].stationProp = stationProps[stationIndex] + + fileIndex = fileIndex + 1 + + ;; make sure we have engough space to put our stations and files + if fileIndex ge numInputFiles then goto, TheEnd + + ;; increment day + theJDN = theJDN + 1 + + endwhile + endfor + + TheEnd: + + end + + ;*************************************************************************** + pro processInputFiles, inputFilesArray, beginJDN, endJDN, $ + outputPathPrefix, outputURLPrefix, sessionID + + common HtmlFileCommons + common OutputsCommons + + sizeArray = size(inputFilesArray) + numInputFiles = sizeArray[1] + + ; HTML strings for each of the table cells + dummyString = '' + kMaxStationDays = 100 + stationHtml = replicate(dummyString, kMaxStationDays) + binHtml = replicate(dummyString, kMaxStationDays) + iagaHtml = replicate(dummyString, kMaxStationDays) + + ; loop over input files; group stations together + kNumStations = 9 + requestedStations = strarr(kNumStations) + availableStations = strarr(kNumStations) + availableStationIndex = -1 + stationCode = 'InitialNonEmptyStationCode' + stationIndex = -1 + + firstFileForThisStation = 1 + lastFileForThisStation = 0 + fileNumberForThisStation = 0 + + sizeArray = size(inputFilesArray) + numInputFiles = sizeArray[1] + + firstFileIndex = 0 + lastFileIndex = numInputFiles - 1 + + for fileIndex = firstFileIndex, lastFileIndex do begin + thisFile = inputFilesArray[fileIndex] + thisMaccsCode = thisFile.stationProp.maccsCode + thisMaccsName = thisFile.stationProp.maccsName + + fileNumberForThisStation = fileNumberForThisStation + 1 + + ;; see if this file exists + if thisFile.exists then begin + thisFileExists = 1 + endif else begin + thisFileExists = 0 + endelse + + ;; see if this is the last file for this station + if fileIndex lt lastFileIndex then begin + nextFile = inputFilesArray[fileIndex + 1] + nextMaccsCode = nextFile.stationProp.maccsCode + nextMaccsName = nextFile.stationProp.maccsName + + if nextMaccsCode ne thisMaccsCode then begin + lastFileForThisStation = 1 + endif + endif else begin + lastFileForThisStation = 1 + endelse + + ;; see if this is the first file for this station + if firstFileForThisStation then begin + stationIndex = stationIndex + 1 + requestedStations[stationIndex] = thisMaccsCode + stationHtml[stationIndex] = stationHtml[stationIndex] + h5(thisMaccsName) + firstFileForThisStation = 0 + endif + + if thisFile.exists then begin + thisStationIsAvailableAndItsNotInTheListOfAvailableStations = 1 + for index = 0, kNumStations - 1 do begin + if availableStations[index] eq thisMaccsCode then begin + thisStationIsAvailableAndItsNotInTheListOfAvailableStations = 0 + endif + endfor + if thisStationIsAvailableAndItsNotInTheListOfAvailableStations then begin + availableStationIndex = availableStationIndex + 1 + availableStations[availableStationIndex] = thisMaccsCode + endif + endif + + jdn1 = thisFile.jdn + caldat, jdn1, month1, day1, year1 + jdn2 = jdn1 + 1 + caldat, jdn2, month2, day2, year2 + + ;; new file (same station or new station) + if gMakeBin then begin + fileName = thisFile.name + ;; ammend html + href = thisFile.urlPrefix + fileName + if thisFile.exists then begin + binHtml[stationIndex] = binHtml[stationIndex] + a(href=href, content=fileName) + binHtml[stationIndex] = binHtml[stationIndex] + br() + endif else begin + binHtml[stationIndex] = binHtml[stationIndex] + fileName + ' (unavailable)' + binHtml[stationIndex] = binHtml[stationIndex] + br() + endelse + endif + + if gMakeIAGA then begin + ;; build IAGA-format file name + iagaCode = thisFile.stationProp.iagaCode + iagaFileName = string(format='(i4.4,i2.2,i2.2,i2.2)', year1, month1, day1, day2) + 'SC.' + iagaCode + iagaFilePath = outputPathPrefix + iagaFileName + + ;; ammend html + href = outputURLPrefix + iagaFileName + if thisFile.exists then begin + iagaHtml[stationIndex] = iagaHtml[stationIndex] + a(href=href, content=iagaFileName) + iagaHtml[stationIndex] = iagaHtml[stationIndex] + br() + ;; process data + writeIAGAFile, iagaFilePath, thisFile + endif else begin + iagaHtml[stationIndex] = iagaHtml[stationIndex] + iagaFileName + ' (unavailable)' + iagaHtml[stationIndex] = iagaHtml[stationIndex] + br() + endelse + endif + + if lastFileForThisStation then begin + ;; ...when i get to the bottom i go back to the top of the slide... + firstFileForThisStation = 1 + lastFileForThisStation = 0 + endif + + endfor + + caldat, beginJDN, month1, day1, year1, hour1 + caldat, endJDN, month2, day2, year2, hour2 + + if gMakePNG or gMakePS then begin + ;; build a string of station names + stationString = '' + for index = 0, kNumStations - 1 do begin + if requestedStations[index] ne '' then begin + stationString = stationString + requestedStations[index] + '_' + endif + endfor + + if gBx eq 1 then begin + compName = 'Bx' + endif + if gBy eq 1 then begin + compName = 'By' + endif + if gBz eq 1 then begin + compName = 'Bz' + endif + + plotFileName = stationString $ + + string(format='(i4.4,i2.2,i2.2,i2.2)', year1, month1, day1, hour1) + '-' $ + + string(format='(i4.4,i2.2,i2.2,i2.2)', year2, month2, day2, hour2) + '_' $ + + compName + + endif + + if gMakePNG then begin + pngFileName = plotFileName + '.png' + pngFilePath = outputPathPrefix + pngFileName + pngFileURL = outputURLPrefix + pngFileName + + content = img(src=pngFileURL, alt=pngFileName, border='0') + pngHtml = '<CENTER>' + a(href=pngFileURL, content=content) + '</CENTER>' + ;; process data + writePlotFile, 'PNG', pngFilePath, inputFilesArray, beginJDN, endJDN, availableStations + endif + + if gMakePS then begin + psFileName = plotFileName + '.ps' + psFilePath = outputPathPrefix + psFileName + psFileURL = outputURLPrefix + psFileName + psHtml = a(href=psFileURL, content=psFileName) + ;; process data + writePlotFile, 'PS', psFilePath, inputFilesArray, beginJDN, endJDN, availableStations + endif + + if gMakeBin or gMakeIAGA then begin + columnHeadings = th('Station') + if gMakeBin then begin + columnHeadings = columnHeadings + th('Binary Data File') + endif + + if gMakeIAGA then begin + columnHeadings = columnHeadings + th('IAGA ASCII Data File') + endif + + tableContent = tr(align='center', valign='top', content=columnHeadings) + index = 0 + while stationHtml[index] ne '' do begin + + columnContent = th(stationHtml[index]) + if gMakeBin then begin + columnContent = columnContent + th(binHtml[index]) + endif + if gMakeIAGA then begin + columnContent = columnContent + th(iagaHtml[index]) + endif + + tableContent = tableContent + tr(align='left', valign='top', content=columnContent) + index = index + 1 + endwhile + tableHtml = table(align='center', border='1', cellpadding='10', width='768', $ + bgcolor='#ffffff', content=tableContent) + printf, gHtmlFileLUN, tableHtml + endif + + if gMakePNG then begin + printf, gHtmlFileLUN, pngHtml + endif + + if gMakePS then begin + printf, gHtmlFileLUN, psHtml + endif + + end + + ;***************************************************************************** + pro writeIAGAFile, iagaFilePath, inFileStruct + + ;; open IAGA output file + openw, iagaFileLUN, iagaFilePath, /get_lun + + stationProp = inFileStruct.stationProp + iagaName = stationProp.iagaName + iagaCode = stationProp.iagaCode + latitude = string(format='(f5.1)', stationProp.latitude) + longitude = string(format='(f5.1)', stationProp.longitude) + + ; data column headings + Hx = " " + iagaCode + "X" + Hy = " " + iagaCode + "Y" + Hz = " " + iagaCode + "Z" + + time = systime(0) + + ; pad with spaces + totalChars = 36 + padString, iagaName, totalChars + padString, iagaCode, totalChars + padString, latitude, totalChars + padString, longitude, totalChars + totalChars = 40 + padString, time, totalChars + + printf, iagaFileLUN, " Format \| IAGA2000 \|" + printf, iagaFileLUN, " Station \| " + iagaName + "\|" + printf, iagaFileLUN, " IAGA Code \| " + iagaCode + "\|" + printf, iagaFileLUN, " Geodetic Latitude \| " + latitude + "\|" + printf, iagaFileLUN, " Geodetic Longitude \| " + longitude + "\|" + printf, iagaFileLUN, " Elevation \| \|" + printf, iagaFileLUN, " Observed \| XYZ \|" + printf, iagaFileLUN, " Digital Sampling \| 0.5 seconds \|" + printf, iagaFileLUN, " Data Interval \| Average 5-second centered \|" + printf, iagaFileLUN, " Data type \| Variation \|" + printf, iagaFileLUN, " Variables \| 9 \|" + printf, iagaFileLUN, " # This file was written by the MACCS Data Request Web \|" + printf, iagaFileLUN, " # Application on " + time + "\|" + printf, iagaFileLUN, " # For more information visit http://space.augsburg.edu \|" + ; " Year\| MT\| DY\| HR\| MN\| SC\| ???X\| ???Y\| ???Z\|" + ; " 2000\| 1\| 1\| 0\| 0\| 0\| 15262.9\| 974.9\| 48404.2\|" + printf, iagaFileLUN, " Year\| MT\| DY\| HR\| MN\| SC\|" + Hx + "\|" + Hy + "\|" + Hz + "\|" + + fillMagneticFieldArrays, bx, by, bz, hour, minute, second, inFileStruct + sizeArray = size(bx) + count = sizeArray[1] + + month = indgen(count) + day = indgen(count) + year = indgen(count) + + caldat, inFileStruct.jdn, m, d, y + + month[] = m + day[] = d + year[] = y + + table = findgen(9, count) + table[0, ] = year + table[1, ] = month + table[2, ] = day + table[3, ] = hour + table[4, ] = minute + table[5, ] = second + table[6, ] = bx + table[7, ] = by + table[8, ] = bz + + printf, format='(((x, i4, "\|"), 5(x, i2, "\|"), 3(x, f9.2, "\|")))', iagaFileLUN, $ + table + + printf, iagaFileLUN, "EOF" + + free_lun, iagaFileLUN + + end + + ;******************************************************************************* + ; plotType is 'PNG' or 'PS' + ; + pro writePlotFile, plotType, plotFilePath, inputFilesArray, beginJDN, endJDN, availableStations + + common OutputsCommons + + kMissing = 32767.0 + kRecordCount = 17280 + + if plotType eq 'PNG' then begin + ;; prepare PNG + openw, pngFileLUN, plotFilePath, /get_lun + set_plot, 'z' + device, set_resolution=[700,550], set_colors=2 + !p.font=0 + !p.charsize=1 + !p.background=255 + !p.color=0 + endif + if plotType eq 'PS' then begin + ;; prepare PostScript + xs = 8.52.54 + ys = 11.02.54 + set_plot, 'ps' + device, filename=plotFilePath, /portrait, xoffset=1, yoffset=1, xsize=xs-2, ysize=ys-2, font_size=15 + !p.font=-1 + psxdpi = !d.x_size/8.5 + psydpi = !d.y_size/11.0 + endif + + caldat, beginJDN, month1, day1, year1, hour1, minute1 + caldat, endJDN, month2, day2, year2, hour2, minute2 + hours = round((endJDN - beginJDN)24.0) + + case 1 of + (hours gt 0) and (hours le 6): begin + ;; tph = ticks per hour + tph = 1.0 + majors = round(tph hours) + minors = 4 + end + (hours gt 6) and (hours le 12): begin + tph = 1.0 + majors = round(tph * hours) + minors = 4 + end + (hours gt 12) and (hours le 18): begin + tph = 1.0 + majors = round(tph * hours) + minors = 2 + end + (hours gt 18) and (hours le 24): begin + tph = 0.5 + majors = round(tph * hours) + minors = 4 + end + (hours gt 24) and (hours le 36): begin + tph = 0.5 + majors = round(tph * hours) + minors = 2 + end + (hours gt 24) and (hours le 48): begin + tph = 0.5 + majors = round(tph * hours) + minors = 2 + end + (hours gt 48) and (hours le 72): begin + tph = 0.25 + majors = round(tph * hours) + minors = 2 + end + (hours gt 72) and (hours le 96): begin + tph = 0.125 + majors = round(tph * hours) + minors = 4 + end + (hours gt 96) and (hours le 120): begin + tph = 0.1 + majors = round(tph * hours) + minors = 2 + end + else: begin + ;; ten days max + hours = 240 + tph = 0.1 + majors = round(tph * hours) + minors = 2 + end + endcase + + step = round(1/tph) + for i=0, majors do begin + hour = (hour1 + stepi) + hourmod = hour mod 24 + if hourmod eq 0 then begin + hourname = string(format='(i1)', hourmod) + jdn = beginJDN + round(hour/24) + xtickname = '!S' + ' ' + hourname + '!R!L' + string(format='(C(CMOI2.2, "/", CDI2.2))', jdn) + endif else begin + if hourmod lt 10 then begin + hourname = string(format='(i1)', hourmod) + endif else begin + hourname = string(format='(i2)', hourmod) + endelse + xtickname = hourname + endelse + !x.tickname[i] = xtickname + endfor + !x.range = [hour1, hour1 + hours] + !x.ticks=majors + !x.minor=minors + !x.style=1 + + sizeArray = size(availableStations) + numAvailableStations = sizeArray[1] + stationCount = 0 + for index = 0, (numAvailableStations - 1) do begin + if availableStations[index] ne '' then begin + stationCount = stationCount + 1 + endif + endfor + + yticks = stationCount + 1 + yticknames = strarr(yticks + 1) + yticknames[0] = ' ' + yticknames[yticks] = ' ' + orderedTicknames = ['CHB', 'CDR', 'PGG', 'RBY', 'PEB', 'GJO', 'IGL', 'CRV', 'NAN'] + yticknameIndex = 1 + for orderIndex = 0, 8 do begin + for stationIndex = 0, (numAvailableStations - 1) do begin + station = availableStations[stationIndex] + if station eq orderedTicknames[orderIndex] then begin + yticknames[yticknameIndex] = station + yticknameIndex = yticknameIndex + 1 + endif + endfor + endfor + + yscale = 200 ; todo calculate yscale? + yrange = yscaleyticks + !y.ticks=yticks + !y.tickname=yticknames + !y.range=[0, yrange] + !y.minor=-1 + !y.style=1 + + plotInitialized = 0 + firstFileForThisStation = 1 + lastFileForThisStation = 0 + fileNumberForThisStation = 0 + + sizeArray = size(inputFilesArray) + numInputFiles = sizeArray[1] + + firstFileIndex = 0 + lastFileIndex = numInputFiles - 1 + + for fileIndex = firstFileIndex, lastFileIndex do begin + thisFile = inputFilesArray[fileIndex] + thisMaccsCode = thisFile.stationProp.maccsCode + + fileNumberForThisStation = fileNumberForThisStation + 1 + + ;; see if this file exists + if thisFile.exists then begin + thisFileExists = 1 + endif else begin + thisFileExists = 0 + endelse + + ;; see if this is the last file for this station + if fileIndex lt lastFileIndex then begin + nextFile = inputFilesArray[fileIndex + 1] + nextMaccsCode = nextFile.stationProp.maccsCode + if nextMaccsCode ne thisMaccsCode then begin + lastFileForThisStation = 1 + endif + endif else begin + lastFileForThisStation = 1 + endelse + + + if thisFileExists then begin + + ;; get data + fillMagneticFieldArrays, bx, by, bz, hour, minute, second, thisFile + + if gBx eq 1 then begin + b = bx + endif + if gBy eq 1 then begin + b = by + endif + if gBz eq 1 then begin + b = bz + endif + + sizeArray = size(b) + bCount = sizeArray[1] + x = findgen(bCount) + day = fileNumberForThisStation - 1 + x = day24.0 + hour + minute/(60.0) + second/(60.0 60.0) + + endif else begin + b = findgen(kRecordCount) + b[] = kMissing + x = findgen(kRecordCount) + day = fileNumberForThisStation - 1 + x = day24.0 + x24.0/kRecordCount + endelse + + ;; figure out which tick mark this data corresponds to + ytick = 1 + for i=1, yticks - 1 do begin + if yticknames[i] eq thisMaccsCode then begin + ytick = i + endif + endfor + + if firstFileForThisStation then begin + ;; assuming b and x arrays have same size + samplingRate = 1.0/5.0 + lag = beginJDN - thisFile.jdn + firstIndex = round(lag 24.0 * 60.0 * 60.0 * samplingRate) + + bAll = b[firstIndex:] + xAll = x[firstIndex:] + firstFileForThisStation = 0 + endif else begin + bAll = [bAll, b] + xAll = [xAll, x] + endelse + + if lastFileForThisStation then begin + + bGood = where(bAll ne kMissing, bGoodCount) + if (bGoodCount ne 0) then begin + bAvg = total(bAll(bGood))/bGoodCount + endif else begin + bAvg = !values.d_nan + endelse + + ;; filter out missing data by assigning NaN + bBad = where(bAll eq kMissing, bBadCount) + if (bBadCount ne 0) then begin + bAll(bBad) = !values.d_nan + endif + + kMaxVal = 10000.0 + kMinVal = -10000.0 + if plotInitialized then begin + oplot, xAll, (bAll - bAvg + ytickyscale), max_value=kMaxVal, min_value=kMinVal + endif else begin + if plotType eq 'PS' then begin + ;; We need to specify 6.5" time axis width, but there's no + ;; apparently easy way to do this. The 'xmargin' keyword of + ;; the 'axis' procedure allows the width to be specified in + ;; character units only. The 'position' keyword in 'plot' + ;; procedure doesn't specify actual axis length since it + ;; includes the label areas. We'll just have to fudge. + ;; Using a ruler, the label area was measured to be 5/8 of + ;; an inch. We'll just excise it from the right margin... + fudge = 5.0/8.0 + pos = [1.0psxdpi, 1.0psydpi, (7.5 + fudge)psxdpi, 10.0psydpi] + plot, xAll, (bAll - bAvg + ytickyscale), position=pos, /device, max_value=kMaxVal, min_value=kMinVal + endif else begin + plot, xAll, (bAll - bAvg + ytickyscale), max_value=kMaxVal, min_value=kMinVal + endelse + plotInitialized = 1 + endelse + + endif ;;lastFileForThisStation + + if lastFileForThisStation then begin + ;; ...when i get to the bottom i go back to the top of the slide... + firstFileForThisStation = 1 + lastFileForThisStation = 0 + fileNumberForThisStation = 0 + endif + + endfor + + TheEnd: + + if gBx eq 1 then begin + compName = 'Bx' + endif + if gBy eq 1 then begin + compName = 'By' + endif + if gBz eq 1 then begin + compName = 'Bz' + endif + + title = 'MACCS ' + compName + ' ' $ + + string(format='(C(CYI4.4, "/", CMOI2.2, "/", CDI2.2, X, CHI2.2))', beginJDN) $ + + ' to ' $ + + string(format='(C(CYI4.4, "/", CMOI2.2, "/", CDI2.2, X, CHI2.2))', endJDN) + xyouts, 0.50, 0.98, '!N!3'+title, align=0.5, /normal + xyouts, 0.06, 0.50, '!N!3' + 'Station Code', orientation=90, align=0.5, size=1.0, /normal + xyouts, 0.50, 0.02, '!N!3' + 'UT', align=0.5, size=1.0, /normal + xyouts, 0.04, 0.00, '!N!3'+'SCALE: '+strcompress(string(yscale))+'nT/TickMark', align=0.0, size=0.8, /normal + xyouts, 0.98, 0.02, '!N!3BOSTON UNIVERSITY', align=1.0, size=0.8, /normal + xyouts, 0.98, 0.00, '!N!3AUGSBURG COLLEGE', align=1.0, size=0.8, /normal + + if plotType eq 'PNG' then begin + ;; toggle top-to-bottom transfer order + ; !order = not !order ; bug fixed in IDL 5.4 + theImage=tvrd() + ;; retore top-to-bottom transfer order + ; !order = not !order ; bug fixed in IDL 5.4 + write_png, plotFilePath, theImage + + free_lun, pngFileLUN + device, /close + endif + if plotType eq 'PS' then begin + device, /close_file + endif + + + end + + ;****************************************************************************** + ; returns bx, by, and bz arrays for the specified input file + pro fillMagneticFieldArrays, bx, by, bz, hour, minute, second, inFileStruct + + kRecordSize=15 + kRecordCount=17280 + ; to speed up for testing... + ; kRecordCount=kRecordCount/12 + + inFileName = inFileStruct.pathPrefix + inFileStruct.name + openr, inFileLUN, inFileName, /get_lun + data = bytarr(kRecordSize, kRecordCount) + readu, inFileLUN, data + free_lun, inFileLUN + + ; extract time value arrays from the file data array + hour = data(0,) + minute = data(1,) + second = data(2,) + ; extract field value arrays from the file data array + bx = long(data( 3: 6, ), 0, 1, kRecordCount) + by = long(data( 7:10, ), 0, 1, kRecordCount) + bz = long(data(11:14, ), 0, 1, kRecordCount) + ; swap bytes if big-endian (necessary for solaris on sparc since data is little + ; + ; non-student version + ; + byteorder, bx, /lswap, /swap_if_big_endian + byteorder, by, /lswap, /swap_if_big_endian + byteorder, bz, /lswap, /swap_if_big_endian + ; divide field values by 1000. to get nanotesla + bx = bx/1000. + by = by/1000. + bz = bz/1000. + + ; flatten arrays into one dimension + hour = reform(hour, kRecordCount, /overwrite) + minute = reform(minute, kRecordCount, /overwrite) + second = reform(second, kRecordCount, /overwrite) + bx = reform(bx, kRecordCount, /overwrite) + by = reform(by, kRecordCount, /overwrite) + bz = reform(bz, kRecordCount, /overwrite) + + end + + ;******************************************************************************* + ; pads the specified string with spaces + pro padString, str, chars + + if strlen(str) gt chars then begin + ;; truncate + str = strmid(str, 0, chars) + goto, TheEnd + endif else begin + ;; pad + while strlen(str) lt chars do begin + str = str + ' ' + endwhile + endelse + + TheEnd: + theString = str + + end

datareq

maccs — 2007-09-04 16:53:48

Differences for datareq

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ #!/usr/bin/perl + # modified to fix directories with new rsi application + # NJP 11-12-04 + #!C:/perl/bin/perl + + # could possibly be loosened + require 5.004; + # these are a good idea + use strict; + use English; + use CGI qw( :standard ); + # CGI::Pretty is the same as CGI.pm but makes html human-readable + # 2000-11-20 CGI::Pretty is now broken (tables are missing parameters) + #use CGI::Pretty qw( :standard ); + + # our entry point + &::main; + + ################################################################################ + sub main + { + &::Initialize; + + if (!CGI::ReadParse()) { + &::PrintForm; + } + else { + &::ProcessForm; + } + } + + ################################################################################ + sub Initialize + { + + # CGI.pm initializaton + # $CGI::Pretty::INDENT = " "; + + # paths to IDL, temporary directory, etc. + + ##### Unix + + $::idlExecutable = '/Applications/rsi/idl/bin/idl'; + $::cgiTmpDir = '/Library/WebServer/CGI-Executables/maccs/tmp/'; + $::cgiTmpURL = '/Library/WebServer/CGI-Executables/maccs/tmp/'; + $::htmlTmpDir = '/Library/WebServer/Documents/maccs/tmp/'; + $::htmlTmpURL = '/maccs/tmp/'; + $::htmlDataDir = '/Library/WebServer/Documents/maccs/Webdata/'; + $::htmlDataURL = '/maccs/Webdata/'; + + ##### Windows + + # $::idlExecutable = 'C:\\RSI\\idl50sv\\idlde.exe'; + # $::cgiTmpDir = 'C:\\WWW\\cgi-bin\\maccs\\tmp\\'; + # $::cgiTmpURL = '/cgi-bin/maccs/tmp/'; + # $::htmlTmpDir = 'C:\\WWW\\htdocs\\maccs\\tmp\\'; + # $::htmlTmpURL = '/htdocs/tmp/'; + # $::htmlDataDir = 'C:\\WWW\\htdocs\\space\\webdata\\'; + # $::htmlDataURL = '/space/webdata/'; + + # cgi parameter names passed upon html form submission + $::stationParam = 'stn'; + $::beginParam = 'beg'; + $::endParam = 'end'; + $::outputTypeParam = 'output'; + $::componentParam = 'comp'; + # $::binParam = 'bin'; + # $::iagaParam = 'iaga'; + # $::pngParam = 'png'; + # $::psParam = 'ps'; + + # station names + @::stationNames = ( + 'Cape Dorset', + 'Coral Harbour', + 'Clyde River', + 'Gjoa Haven', + 'Igloolik', + 'Nain', + 'Pelly Bay', + 'Pangnirtung', + 'Repulse Bay'); + + $::binName = 'Binary Data'; + $::iagaName = 'IAGA ASCII Data'; + $::pngName = 'PNG Plot'; + $::psName = 'PostScript Plot'; + + $::bxName = 'Bx'; + $::byName = 'By'; + $::bzName = 'Bz'; + + # @::yearNames = qw( 1992 1993 1994 1995 1996 1997 1998 Other ); + + # @::monthNames = qw( January February March April May June July August + # September October November December ); + + # @::dayNames = qw( 1 2 3 4 5 6 7 + # 8 9 10 11 12 13 14 + # 15 16 17 18 19 20 21 + # 22 23 24 25 26 27 28 + # 29 30 31); + + $::formName = 'dataRequestForm'; + + # JavaScript test + $::javaScript=<<END; + function selectAllStations(bSelect) + { + var frm = document.$::formName; + for (i=0;i<9; i++) + { + frm.elements[i].checked = bSelect; + } + } + END + + } + + ################################################################################ + sub PrintForm + { + print + &header, + &start_html({-title=>'MACCS Data Request Application', + -bgcolor=>'#ffffff', + -link=>"#000099", + -vlink=>"#336600", + -alink=>"#993300", + -script=>$::javaScript}); + + print <<END; + <center> + <table width="100%" border="0"> + <tr> + <td height="50" bgcolor="#140766"><font size="+3" color="#FFFFFF" face="Arial, Helvetica, sans-serif">Data Request Application</font></td> + </tr> + </table> + + </center> + + <table bgcolor="#ffffff" border="0" align="center" cellpadding="10" width="768" height="73"> + <tr> + <td> <font face="Arial, Helvetica, sans-serif">Use the following form to determine + data availability and download binary files; generate and download IAGA + 2000 ASCII-formatted data files; and generate, view and download plots in + PNG or PostScript format. For more information, see the <a href="http://space.augsburg.edu/space/map.html">Data + Availability Page</a> and the <a + + href="http://space.augsburg.edu/space/read_data.html"> Read Me Page</a>.</font> + </tr> + + </table> + END + + print + &startform({-name=>$::formName, -method=>'get'}); + my $scrollLines = 12; + + # TODO - figure out how to get hashes working in checkbox_group + my $stationCell = &h4('Station') + .&checkbox_group({-name=>$::stationParam, + -values=>\@::stationNames, + -linebreak=>'true'}) + .&br + .&button({-name=>'selectAllStationsButton', + -value=>'Select All', + -onClick=>"selectAllStations(true)"}) + .'    ' + .&button({-name=>'clearStationsButton', + -value=>'Clear', + -onClick=>"selectAllStations(false)"}); + # .&scrolling_list({-name=>$::stationParam, + # -values =>\@::stationNames, + # -size=>$scrollLines}); # single selection + # -size=>$scrollLines, + # -multiple=>'true'}); # multiple selection + + my $beginEndCell = &h4('Beginning and Ending Times') + .&h5('Beginning Time') + .&code('(YYYY/MM/DD HH)').&br + .&textfield({-name=>$::beginParam, + -default=>'1995/01/01 00', + -maxlength=>13}).&br.&br + .&h5('Ending Time') + .&code('(YYYY/MM/DD HH)').&br + .&textfield(-name=>$::endParam, + -default=>'1995/01/02 00', + -maxlength=>13); + + # my $outputTypeCell = &h4('Output Type') + # .&font({-color=>'#ff0000', -size=>'-1'}, 'PNG and PostScript <br> are under construction.') + # .&radio_group({-name=>$::outputTypeParam, + my $outputTypeCell = &h4('Output Type') + .&radio_group({-name=>$::outputTypeParam, + -values=>[$::binName, $::iagaName, $::pngName, $::psName], + -default=>$::binName, + -columns=>1}); + + my $componentCell = &h4('Plot Component') + .&radio_group({-name=>$::componentParam, + -values=>[$::bxName, $::byName, $::bzName], + -default=>$::bxName, + -columns=>1}) + .&font({-size=>'-1'}, '<br> Bx = geographic north <br> By = geographic east <br> Bz = vertical down <br>'); + + # print + # &table({-bgcolor=>'#ffffff', -border=>'1', -width=>600, -align=>'center', -cellpadding=>10}, + # &TR({-align=>'left', -valign=>'top'}, + # [&th({-align=>'left', -valign=>'top'}, [$stationCell, $beginEndCell, $outputTypeCell])]) ); + print + &table({-bgcolor=>'#ffffff', + -border=>'1', + -width=>768, + -align=>'center', + -cellpadding=>10}, + &TR({-align=>'left', -valign=>'top'}, + [&th({-align=>'left', -valign=>'top'}, + [$stationCell, $beginEndCell, $outputTypeCell, $componentCell])]) ); + + print + &br, + '<CENTER>', + &submit({-name=>'Submit'}), + '    ', + &reset({-name=>'Reset'}), + # '    ', + # &button({-name=>'jsbutton', + # -value=>'JavaScript Button', + # -onClick=>"showAlert()"}), + '</CENTER>', + &endform(); + + print <<END; + + <ul> + <li> + <div align="left"> <font face="Arial, Helvetica, sans-serif"><u><a href="http://space.augsburg.edu/space/dataavail.htm">Data + availability</a></u> list of days available from each station</font></div> + </li> + </ul> + + END + + print + &end_html; + + } + + ################################################################################ + sub ProcessForm + { + # get CGI form data parameters + + my @stations = &param($::stationParam); + my $beginTime = &param($::beginParam); + my $endTime = &param($::endParam); + my $outputType = &param($::outputTypeParam); + my $binData = $outputType eq $::binName; + my $iagaData = $outputType eq $::iagaName; + my $pngPlot = $outputType eq $::pngName; + my $psPlot = $outputType eq $::psName; + my $component = &param($::componentParam); + + # &::PrintDiagnosticMessage("stations: @stations, beginTime: $beginTime, endTime: $endTime, " + # ."binData: $binData, iagaData: $iagaData, " + # ."pngPlot: $pngPlot, psPlot: $psPlot"); + + # boolean values to determine if form is complete + + my $hasStation = 1; + my $hasBeginTime = 1; + my $hasEndTime = 1; + my $hasOutput = 1; + + if (!$stations[0]) { + $hasStation = 0; + } + + if (!$beginTime) { + $hasBeginTime = 0; + } + + if (!$endTime) { + $hasEndTime = 0; + } + + if (!$binData && !$iagaData && !$pngPlot && !$psPlot) { + $hasOutput = 0; + } + + # &::PrintDiagnosticMessage("hasBeginTime: $hasBeginTime"); + + # inform user if form is incomplete + + if (!$hasStation \|\| !$hasBeginTime \|\| !$hasEndTime \|\| !$hasOutput) { + &::PrintErrorMessage('Please return to the form and make sure station, ' + .'beginning time, ending time, and output type have been specified.'); + } + + my $beginYear; + my $beginMonth; + my $beginDay; + my $beginHour; + my $beginMinute; + my $beginSecond; + + my $endYear; + my $endMonth; + my $endDay; + my $endHour; + my $endMinute; + my $endSecond; + + # use pattern matching to find the year, month, etc. allowing for user input errors + # '\d' is any numeric character; '\D' is any non-numeric character; '+' is one or more + + # ($beginYear, $beginMonth, $beginDay, $beginHour, $beginMinute, $beginSecond) + # = ($beginTime =~ /(\d+)\D+(\d+)\D+(\d+)\D+(\d+)\D+(\d+)\D+(\d+)/); + # ($endYear, $endMonth, $endDay, $endHour, $endMinute, $endSecond) + # = ($endTime =~ /(\d+)\D+(\d+)\D+(\d+)\D+(\d+)\D+(\d+)\D+(\d+)/); + + # my $isValidBeginTime = &::IsValidDateTime($beginSecond, $beginMinute, $beginHour, + # $beginDay, $beginMonth, $beginYear); + # my $isValidEndTime = &::IsValidDateTime($endSecond, $endMinute, $endHour, + # $endDay, $endMonth, $endYear); + + ($beginYear, $beginMonth, $beginDay, $beginHour) + = ($beginTime =~ /(\d+)\D+(\d+)\D+(\d+)\D+(\d+)/); + ($endYear, $endMonth, $endDay, $endHour) + = ($endTime =~ /(\d+)\D+(\d+)\D+(\d+)\D+(\d+)/); + + # &::PrintDiagnosticMessage("Begin YMDH: $beginYear, $beginMonth, $beginDay, $beginHour, " + # ."End YMDH: $endYear, $endMonth, $endDay, $endHour"); + + my $isValidBeginTime = &::IsValidDateTime($beginHour, $beginDay, $beginMonth, $beginYear); + my $isValidEndTime = &::IsValidDateTime($endHour, $endDay, $endMonth, $endYear); + + if (!$isValidBeginTime \|\| !$isValidEndTime) { + &::PrintErrorMessage('Please return to the form and make sure ' + .'the entered dates and times are valid.'); + } + + # prepare to create the IDL batch file... + + # specify filename bases (prefixes) and extensions (suffixes) + my $batchBase = 'idl'; + my $batchExt = '.pro'; + my $outBase = 'idl'; + my $outExt = '.out'; + my $htmlBase = ''; + my $htmlExt = '.html'; + + # get time for making filename time stamp + + my ($sec, $min, $hour, $mday, $foo) = localtime; + my $timestamp = sprintf("%02d%02d%02d", $hour, $min, $sec); + # remove the following comment if we need day number as well... + # my $timestamp = sprintf("%02d%02d%02d%02d", $mday, $hour, $min, $sec); + # test the version letter algorithm by setting timestamp to nearest minute + # my $timestamp = sprintf("%02d%02d", $hour, $min); + + # chances are this time stamp will give us a unique filename, but just in case + # more than one IDL batch file is created in a given second, we append a + # version letter ('a' to 'z') to our time stamp, incrementing it if the file + # already exists... + my $fileID = ""; + my $file = ""; + my $version = ""; + # my $count = 0; + my $count = ord('a'); + do { + # $version = sprintf("%02d", $count); + $version = chr($count); + $fileID = $timestamp.$version; + # use batch file for existence (-e $file) test below + $file = $::cgiTmpDir.$batchBase.$fileID.$batchExt; + $count++; + if ($count > (ord('z') + 1)) { + &::PrintErrorMessage('Please re-submit the form.'); + } + } while (-e $file); + + my $batchFile = $::cgiTmpDir.$batchBase.$fileID.$batchExt; + my $outFile = $::cgiTmpDir.$outBase.$fileID.$outExt; + + # open batch file; inform user if batch file couldn't be opened + # ">" means "open for output and truncate if necessary" + + # system("whoami"); + if (!open(IDLBATCHFILE, "> $batchFile")) { + # &::PrintErrorMessage("Unable to create IDL batch file."); + &::PrintErrorMessage("Unable to create $batchFile."); + } + + # my @beginDateTime = ($beginYear, $beginMonth, $beginDay, + # $beginHour, $beginMinute, $beginSecond); + + # my @endDateTime = ($endYear, $endMonth, $endDay, + # $endHour, $endMinute, $endSecond); + + my @beginDateTime = ($beginYear, $beginMonth, $beginDay, $beginHour); + my @endDateTime = ($endYear, $endMonth, $endDay, $endHour); + + my @outputTypes; + + if ($binData) { + @outputTypes = (@outputTypes, 'bin'); + } + + if ($iagaData) { + @outputTypes = (@outputTypes, 'iaga'); + } + + if ($pngPlot) { + @outputTypes = (@outputTypes, 'png'); + } + + if ($psPlot) { + @outputTypes = (@outputTypes, 'ps'); + } + + my $htmlFilePath = $::htmlTmpDir.$htmlBase.$fileID.$htmlExt; + + # IDL student version under Windows doesn't allow creation of .sav files + # Our workaround is to just compile datareq.pro every time--which is actually + # convenient for testing. This might impact performance, but it might not. + # print IDLBATCHFILE "restore, 'datareq.sav'\n"; + print IDLBATCHFILE ".compile datareq.pro\n"; + + # separator for interpolation-printed arrays (e.g., "@foobar") + $LIST_SEPARATOR = ', '; + + print IDLBATCHFILE "doDataRequest, "; + print IDLBATCHFILE "\'@outputTypes\', "; + print IDLBATCHFILE "\'$component\', "; + print IDLBATCHFILE "\'@beginDateTime\', "; + print IDLBATCHFILE "\'@endDateTime\', "; + print IDLBATCHFILE "\'@stations\', "; + print IDLBATCHFILE "\'$::htmlDataDir\', "; + print IDLBATCHFILE "\'$::htmlDataURL\', "; + print IDLBATCHFILE "\'$::htmlTmpDir\', "; + print IDLBATCHFILE "\'$::htmlTmpURL\', "; + print IDLBATCHFILE "\'$fileID\', "; + print IDLBATCHFILE "\'$htmlFilePath\'"; + print IDLBATCHFILE "\n"; + + print IDLBATCHFILE "exit"; + print IDLBATCHFILE "\n"; + + close(IDLBATCHFILE); + + ##### Unix + # execute idl procedure; ">" means "redirect standard output to file" + # "2>&1" means "redirect standard error to file also" + + # redirecting 'standard out' and 'standard error' doesn't seem to work since upgrading + # to IDL 5.4; this could be due to changes in IDL or the license manager or something else + # system("$::idlExecutable $batchFile > $outFile 2>&1"); + + # it would be nice to have the errors issued somewhere so we can debug; at + # this point, we'll jst let it all hang out... + # system("$::idlExecutable $batchFile > /dev/null 2>&1"); + system("$::idlExecutable $batchFile > output.txt"); + + ##### Windows + # my $process = "$::idlExecutable"; + # my $command = " "."\@"."$batchFile"; + # my $pid = 0; + # &Win32::Spawn($process, $command, $pid); + + # HTML output + print &redirect(-location=>$::htmlTmpURL.$htmlBase.$fileID.$htmlExt); + + # keep size of temporary file directories at the specified size in megs: + &PruneDirectory("$::htmlTmpDir", 200); + &PruneDirectory("$::cgiTmpDir", 10); + + } + + ################################################################################ + # returns false if any of the values in the specified date is not in the allowed + # range; parameter order follows that of localtime(), timelocal(), etc. + sub IsValidDateTime + { + # my $second = $_[0]; + # my $minute = $_[1]; + # my $hour = $_[2]; + # my $day = $_[3]; + # my $month = $_[4]; + # my $year = $_[5]; + + my $hour = $_[0]; + my $day = $_[1]; + my $month = $_[2]; + my $year = $_[3]; + + # if ($second < 0 \|\| $second > 59) { + # return 0; + # } + # if ($minute < 0 \|\| $minute > 59) { + # return 0; + # } + + if ($hour < 0 \|\| $hour > 23) { + return 0; + } + if ($day < 1 \|\| $day > 31) { + return 0; + } + if ($month < 1 \|\| $month > 12) { + return 0; + } + if ($year < 1970 \|\| $year > 2050) { + return 0; + } + + return 1; + } + + ################################################################################ + sub PrintDiagnosticMessage + { + + my $theMessage = $_[0]; + + # prevent the CGI.pm functions called herein from losing their minds; they seem + # to rely on the @_ array ($_[0], $_[1], etc.; maybe there's a better way to do + # this? + local @_; + + print &header; + print &start_html(-title=>'Diagnostic', -bgcolor=>'#ffffcc'); + print &h3('Diagnostic'); + print &h5("$theMessage"); + print &end_html; + + # print '<HTML>'; + # print '<HEAD>'; + # print ' <TITLE>Test</TITLE>'; + # print '</HEAD>'; + # print '<BODY bgcolor=white link="#000080">'; + # print '</BODY>'; + # print '</HTML>'; + + exit(0); + } + + ################################################################################ + sub PrintErrorMessage + { + + my $theMessage = $_[0]; + + # prevent the CGI.pm functions called herein from losing their minds; they seem + # to rely on the @_ array ($_[0], $_[1], etc.; maybe there's a better way to do + # this? + local @_; + + print &header; + print &start_html(-title=>'Error', -bgcolor=>'#ffffff'); + print &h3('Error'); + print &h5("$theMessage"); + print &end_html; + + # print '<HTML>'; + # print '<HEAD>'; + # print ' <TITLE>Test</TITLE>'; + # print '</HEAD>'; + # print '<BODY bgcolor=white link="#000080">'; + # print '</BODY>'; + # print '</HTML>'; + + exit(0); + } + + + ################################################################################ + # removes files from the specified directory making the total size of the + # directory equal to or less than the specified size in megabytes + sub PruneDirectory + { + + my $dirName = $_[0]; + my $maxMegabytes = $_[1]; + + my $maxBytes = $maxMegabytes * 1048576; + + my $fileName; + my $filePath; + my @status; + my $accessTime; + my $bytes; + my $oldestTime; + my $totalBytes; + + do { + + # determine access time of oldest file + opendir(DIR, $dirName) or die "Unable to open $dirName. ($!)\n"; + $oldestTime = time(); + $totalBytes = 0; + while (defined($fileName = readdir(DIR))) { + next if $fileName =~ /^\.\.?$/; # skip '.' and '..' + $filePath = $dirName.$fileName; + @status = stat($filePath); + $accessTime = $status[8]; + $bytes = $status[7]; + $totalBytes += $bytes; + + if ($accessTime < $oldestTime) { + $oldestTime = $accessTime; + } + } + closedir DIR; + + if ($totalBytes > $maxBytes) { + + # my $theLocalTime = localtime($oldestTime); + # print "OLDEST FILE: $theLocalTime \| TOTAL BYTES: $totalBytes bytes\n"; + + # repeat; delete files with access time equal to that of oldest file + opendir(DIR, $dirName) or die "Unable to open $dirName. ($!)\n"; + $totalBytes = 0; + while (defined($fileName = readdir(DIR))) { + next if $fileName =~ /^\.\.?$/; # skip '.' and '..' + $filePath = $dirName.'/'.$fileName; + @status = stat($filePath); + $accessTime = $status[8]; + $bytes = $status[7]; + $totalBytes += $bytes; + if ($accessTime <= $oldestTime) { + # my $theAccessTime = localtime($accessTime); + # print " DELETING '$filePath'\n $theAccessTime\n"; + unlink($filePath) or die "Unable to delete $filePath. ($!)\n"; + } + } + + } + closedir DIR; + # ++$oldestTime; + } while ($totalBytes > $maxBytes) + + }

Processing Software

maccs — 2007-09-04 16:51:06

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 53:	Line 53:
- [http://space/space/index.html index.html]	+ [http://space/space/index.html]

Processing Software

maccs — 2007-09-04 16:50:38

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 53:	Line 53:
- ["index.html"]	+ [http://space/space/index.html index.html]

Processing Software

maccs — 2007-09-04 16:47:33

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 51:	Line 51:
- =Augsburg WebServer Programs=	+ =Augsburg WebServer Date Request Application=
Line 54:	Line 54:
- This is the webpage for the space/space MACCS data interactive request form. This site can be used to obtain binary data, IAGA ASCII data, png plots, or postscript plots of this data. The Data Request Application is created by the perl script datareq which calls the idl program datareq.pro upon form submission. Location: /Library/WebServer/Documents/space/.	+ This is the web page for the space/space MACCS data interactive request form. This site can be used to obtain binary data, IAGA ASCII data, png plots, or postscript plots of this data. The Data Request Application is created by the perl script datareq which calls the idl program datareq.pro upon form submission. Location: /Library/WebServer/Documents/space/.

Processing Software

maccs — 2007-09-04 16:45:07

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 51:	Line 51:
	+ =Augsburg WebServer Programs= + + ["index.html"] + This is the webpage for the space/space MACCS data interactive request form. This site can be used to obtain binary data, IAGA ASCII data, png plots, or postscript plots of this data. The Data Request Application is created by the perl script datareq which calls the idl program datareq.pro upon form submission. Location: /Library/WebServer/Documents/space/. + + ["datareq"] + This is the perl script that generates the Data Request Application web page. It calls datareq.pro upon sumbission of the form. Location: /Library/WebServer/CGI-Executables/maccs/ + + ["datareq.pro"] + This program is called by datareq to display the requested data or graphs on the website. Location: /Library/WebServer/CGI-Executables/maccs/ +

processNA.sh

maccs — 2007-09-04 16:39:03

Differences for processNA.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Shell Script: processNA.sh + # Created by Erik Johnson July 2007 + # Last Modified 9/4/07 by Erik Johnson + # This script can be used to process a raw Nain data file. + # The default day is the current UTC day. + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + + # If the day you want to process is not the current day, remove the comments from this section and change YEAR and DAY to the day you want to process. + # YEAR=2007 + # DAY=230 + + NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/' + NAAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/' + + cd $NAdir + if [ -f "NA${YY}${DAY}.dat" ]; then + echo "Processing NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi

processCD.sh

maccs — 2007-09-04 16:37:04

Differences for processCD.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Shell Script: processCD.sh + # Created by Erik Johnson July 2007 + # Last Modified 9/4/07 by Erik Johnson + # This script can be used to process a raw Cape Dorset data file. + # The default day is the current UTC day. + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + + # If the day you want to process is not the current day, remove the comments from this section and change YEAR and DAY to the day you want to process. + # YEAR=2007 + # DAY=242 + + + CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/' + CDAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/' + + cd $CDdir + if [ -f "CD${YY}${DAY}.dat" ]; then + echo "Processing CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi

maccsprocessing.sh

maccs — 2007-09-04 16:36:29

Differences for maccsprocessing.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Shell Script : maccsprocessing.sh + # Execute : ./maccsprocessing.sh + # Name : Erik Johnson & Jesse Docken + # Created : 08/17/2007 + # Last Modified : 08/31/2007 + # Purpose : Convert the CD and NA iridium data into ASCII files + # and line plots a year at a time. + + YEAR=`date -u +%Y` + #YEAR=2005 + + #for j in 2007 + #do + #YEAR=$j + + CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/' + NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/' + CDAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/' + NAAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/' + + #if [ 0 -eq 1 ]; then + + cd $CDdir + for i in * + do + echo "$i" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "$i" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "$i" + exit + END_SCRIPT + done + + if [ -d "$NAdir" ]; then + cd $NAdir + for i in * + do + echo "$i" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "$i" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "$i" + exit + END_SCRIPT + done + fi + + + + cd ${CDAdir} + for i in * + do + echo "$CDAdir$i" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"$i",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + done + + #fi + + if [ -d "$NAAdir" ]; then + echo nain + cd $NAAdir + for i in * + do + echo "$NAAdir$i" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"$i",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + done + fi + + done

goodNAtoday.sh

maccs — 2007-09-04 16:33:37

Differences for goodNAtoday.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # This script removes the warning from the Today's Plots webpage that there is a problem with the data. + # Written By Erik Johnson 8/30/2007 + # Last Modified 8/30/07 + + # Change the iridium today website to the version without a warning + cd /Library/WebServer/Documents/space/ + mv iridiumtoday.html iridiumtoday.html.badNA + mv iridiumtoday.html.good iridiumtoday.html

badNA.sh

maccs — 2007-09-04 16:31:50

Differences for badNA.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # badNA.sh + # This script moves the current day's raw and processed NA files to the Problem_Data/ folders. + # It also adds a warning to iridiumtoday.html that there is a problem with the NA data. + # It can also be used to move other day's files to the Problem_Data/ folders. + # Written By Erik Johnson 8/29/2007 + # Last Modified 9/4/07 + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + DAY=189 + + NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/' + NAAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/' + NAIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/NA/'${YEAR}'ir/' + NALdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/NA/'${YEAR}'ir/' + NAL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/' + + NAPdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/Problem_Data/' + NAAPdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/Problem_Data/' + NAIPdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/NA/'${YEAR}'ir/Problem_Data/' + NALPdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/NA/'${YEAR}'ir/Problem_Data/' + NAL2Pdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/Problem_Data/' + + # Move DAY's NA files to Problem_Data folders + mv ${NAdir}NA${YY}${DAY}.dat ${NAPdir}NA${YY}${DAY}.dat + mv ${NAAdir}NA${YY}${DAY}.dat ${NAAPdir}NA${YY}${DAY}.dat + mv ${NAIdir}NA${YY}${DAY}.dat ${NAIPdir}NA${YY}${DAY}.dat + mv ${NALdir}na${YY}${DAY}.ps ${NALPdir}na${YY}${DAY}.ps + mv ${NAL2dir}na${YY}${DAY}.png ${NAL2Pdir}na${YY}${DAY}.png + + # Changes the iridium today website to the version with the NA warning + # Remove the comment symbols from this section if the new data is bad and the warning has not been added to the website + # Add the comment symbols back after running + # To remove the warning, run goodNAtoday.sh + + # cd /Library/WebServer/Documents/space/ + # mv iridiumtoday.html iridiumtoday.html.good + # mv iridiumtoday.html.badNA iridiumtoday.html

goodCDtoday.sh

maccs — 2007-09-04 16:31:04

Differences for goodCDtoday.sh

Deletions are marked with - .	Additions are marked with +.
Line 5:	Line 5:
- # Change the iridium today website to the version with the no warning	+ # Change the iridium today website to the version with no warning

goodCDtoday.sh

maccs — 2007-09-04 16:30:45

Differences for goodCDtoday.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # This script removes the warning from the Today's Plots webpage that there is a problem with the data. + # Written By Erik Johnson 8/30/2007 + # Last Modified 8/30/07 + + # Change the iridium today website to the version with the no warning + cd /Library/WebServer/Documents/space/ + mv iridiumtoday.html iridiumtoday.html.badCD + mv iridiumtoday.html.good iridiumtoday.html

badCD.sh

maccs — 2007-09-04 16:30:03

Differences for badCD.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # badCD.sh + # This script moves the current day's raw and processed CD files to the Problem_Data/ folders. It also adds a warning to the Today's Plots webpage that there is a problem with the data. + # It can also be used to move other day's files to the Problem_Data/ folders. + # Written By Erik Johnson 8/27/2007 + # Last Modified 9/4/07 + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + #DAY=241 + + CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/' + CDAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/' + CDIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/CD/'${YEAR}'ir/' + CDLdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/CD/'${YEAR}'ir/' + CDL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/' + + CDPdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/Problem_Data/' + CDAPdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/Problem_Data/' + CDIPdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/CD/'${YEAR}'ir/Problem_Data/' + CDLPdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/CD/'${YEAR}'ir/Problem_Data/' + CDL2Pdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/Problem_Data/' + # Move DAY's CD files to Problem_Data folders + mv ${CDdir}CD${YY}${DAY}.dat ${CDPdir}CD${YY}${DAY}.dat + mv ${CDAdir}CD${YY}${DAY}.dat ${CDAPdir}CD${YY}${DAY}.dat + mv ${CDIdir}CD${YY}${DAY}.dat ${CDIPdir}CD${YY}${DAY}.dat + mv ${CDLdir}cd${YY}${DAY}.ps ${CDLPdir}cd${YY}${DAY}.ps + mv ${CDL2dir}cd${YY}${DAY}.png ${CDL2Pdir}cd${YY}${DAY}.png + + # Changes the iridium today website to the version with the CD warning + # Remove the comment symbols from this section if the new data is bad and the warning has not been added to the website + # Add the comment symbols back after running + # To remove the warning, run goodCDtoday.sh + + # cd /Library/WebServer/Documents/space/ + # mv iridiumtoday.html iridiumtoday.html.good + # mv iridiumtoday.html.badCD iridiumtoday.html

NoNA.txt

maccs — 2007-09-04 16:28:50

Differences for NoNA.txt

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ There is no Nain data from the previous 24 hours.

BadNA.txt

maccs — 2007-09-04 16:28:08

Differences for BadNA.txt

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ There is a problem with the Nain data from the last 24 hour period.

NoCD.txt

maccs — 2007-09-04 16:27:25

Differences for NoCD.txt

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ There is no Cape Dorset data from the previous 24 hours.

BadCD.txt

maccs — 2007-09-04 16:26:15

Differences for BadCD.txt

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ There is a problem with the Cape Dorset data from the last 24 hour period.

checkMACCSir.sh

maccs — 2007-09-04 16:25:29

Differences for checkMACCSir.sh

Deletions are marked with - .	Additions are marked with +.
Line 31:	Line 31:
- (cat BadCD.txt; uuencode ${CDL2Pdir}cd${YY}${PDAY}.png cd${YY}${PDAY}.png) \| mailx -s "Problem With Latest Cape Dorset Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu	+ (cat ["BadCD.txt"]; uuencode ${CDL2Pdir}cd${YY}${PDAY}.png cd${YY}${PDAY}.png) \| mailx -s "Problem With Latest Cape Dorset Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu
Line 34:	Line 34:
- cat NoCD.txt \| mailx -s "No Cape Dorset Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu	+ cat ["NoCD.txt"] \| mailx -s "No Cape Dorset Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu
Line 42:	Line 42:
- (cat BadNA.txt; uuencode ${NAL2Pdir}na${YY}${PDAY}.png na${YY}${PDAY}.png) \| mailx -s "Problem With Latest Nain Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu	+ (cat ["BadNA.txt"]; uuencode ${NAL2Pdir}na${YY}${PDAY}.png na${YY}${PDAY}.png) \| mailx -s "Problem With Latest Nain Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu
Line 45:	Line 45:
- cat NoNA.txt \| mailx -s "No Nain Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu	+ cat ["NoNA.txt"] \| mailx -s "No Nain Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu

checkMACCSir.sh

maccs — 2007-09-04 16:23:21

Differences for checkMACCSir.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # This script is run at 19:35 by the maccs user crontab. + # It emails the newest MACCS Iridium data line plot files to the listed users. + # If there is no new data it sends an email to report the missing data. + # Written By Erik Johnson 8/23/07 + # Last Modified 8/29/07 + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + PDAY=`echo $DAY - 1 \| bc` + #PDAY=233 + + # Insert the necessary leading zeros for PDAY + if [ $PDAY -lt 10 ]; then + PDAY=00$PDAY + elif [ $PDAY -lt 100 ]; then + PDAY=0$PDAY + fi + + CDL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/' + NAL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/' + CDL2Pdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/Problem_Data/' + NAL2Pdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/Problem_Data/' + SOURCEdir='/Volumes/physics_data/Code/MACCS_Code/' + + cd $CDL2dir + if [ -f "${CDL2dir}cd${YY}${PDAY}.png" ]; then + uuencode cd${YY}${PDAY}.png cd${YY}${PDAY}.png \| mailx -s "Latest Cape Dorset Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + elif [ -f "${CDL2Pdir}cd${YY}${PDAY}.png" ]; then + cd $SOURCEdir + (cat BadCD.txt; uuencode ${CDL2Pdir}cd${YY}${PDAY}.png cd${YY}${PDAY}.png) \| mailx -s "Problem With Latest Cape Dorset Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + else + cd $SOURCEdir + cat NoCD.txt \| mailx -s "No Cape Dorset Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + fi + + cd $NAL2dir + if [ -f "${NAL2dir}na${YY}${PDAY}.png" ]; then + uuencode na${YY}${PDAY}.png na${YY}${PDAY}.png \| mailx -s "Latest Nain Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + elif [ -f "${NAL2Pdir}na${YY}${PDAY}.png" ]; then + cd $SOURCEdir + (cat BadNA.txt; uuencode ${NAL2Pdir}na${YY}${PDAY}.png na${YY}${PDAY}.png) \| mailx -s "Problem With Latest Nain Plot" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + else + cd $SOURCEdir + cat NoNA.txt \| mailx -s "No Nain Data For Today" teakjohnson@embarqmail.com,engebret@augsburg.edu,steinmee@augsburg.edu,dockenj@augsburg.edu,petit@augsburg.edu + fi

todaysdata.sh

maccs — 2007-09-04 16:22:32

Differences for todaysdata.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # This script is run by ftpsri.sh at :00, :15, :30, :45 past every hour of every day + # It copies the current day's line plot files to the web server and renames them. + # These files are made available on the MACCS Iridium Today's Data Plots webpage + # Written By Erik Johnson 8/21/2007 + # Last Modified 8/30/07 + + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + + CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/' + NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/' + CDAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/' + NAAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/' + CDIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/CD/'${YEAR}'ir/' + NAIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/NA/'${YEAR}'ir/' + CDLdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/CD/'${YEAR}'ir/' + NALdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/NA/'${YEAR}'ir/' + CDL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/' + NAL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/' + TODAYdir='/Library/WebServer/Documents/space/' + + # Update Cape Dorset data for the Today's Data webpage + #cp ${CDdir}CD${YY}${DAY}.dat ${TODAYdir}CDRawToday.dat + #cp ${CDAdir}CD${YY}${DAY}.dat ${TODAYdir}CDAugASCIIToday.dat + #cp ${CDIdir}CD${YY}${DAY}.dat ${TODAYdir}CDIAGA2000Today.dat + + if [ -f "${CDLdir}cd${YY}${DAY}.ps" ]; then + cp ${CDLdir}cd${YY}${DAY}.ps ${TODAYdir}CDPSToday.ps + elif [ -f "${CDLdir}/Problem_Data/cd${YY}${DAY}.ps" ]; then + cp ${CDLdir}/Problem_Data/cd${YY}${DAY}.ps ${TODAYdir}CDPSToday.ps + fi + + if [ -f "${CDL2dir}cd${YY}${DAY}.png" ]; then + cp ${CDL2dir}cd${YY}${DAY}.png ${TODAYdir}CDPNGToday.png + elif [ -f "${CDL2dir}/Problem_Data/cd${YY}${DAY}.png" ]; then + cp ${CDL2dir}/Problem_Data/cd${YY}${DAY}.png ${TODAYdir}CDPNGToday.png + fi + + # Update Nain data for the Today's Data webpage + #cp ${NAdir}NA${YY}${DAY}.dat ${TODAYdir}NARawToday.dat + #cp ${NAAdir}NA${YY}${DAY}.dat ${TODAYdir}NAAugASCIIToday.dat + #cp ${NAIdir}NA${YY}${DAY}.dat ${TODAYdir}NAIAGA2000Today.dat + if [ -f "${NALdir}na${YY}${DAY}.ps" ]; then + cp ${NALdir}na${YY}${DAY}.ps ${TODAYdir}NAPSToday.ps + elif [ -f "${NALdir}/Problem_Data/na${YY}${DAY}.ps" ]; then + cp ${NALdir}na${YY}${DAY}.ps ${TODAYdir}NAPSToday.ps + fi + + if [ -f "${NAL2dir}na${YY}${DAY}.png" ]; then + cp ${NAL2dir}na${YY}${DAY}.png ${TODAYdir}NAPNGToday.png + elif [ -f "${NAL2dir}/Problem_Data/na${YY}${DAY}.png" ]; then + cp ${NAL2dir}na${YY}${DAY}.png ${TODAYdir}NAPNGToday.ps + fi

linex7.pro

maccs — 2007-09-04 16:21:30

Differences for linex7.pro

Deletions are marked with - .	Additions are marked with +.
Line 11:	Line 11:
	+ ; MODIFIED BY Erik Johnson August 31, 2007 to output .png line plot files

linex7.pro

maccs — 2007-09-04 16:15:36

Differences for linex7.pro

Deletions are marked with - .	Additions are marked with +.
Line 618:	Line 618:
- fnamelp= '/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/'+strupcase(site)+'/200'+yrday+'ir/'+site+syrday+'.ps'	+ fnamelp= '/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/'+strupcase(site)+'/200'+yrday+'ir/'+site+syrday+'.ps'
Line 702:	Line 702:
- fnameseq='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/'+site+'/200'+IYR+'ir/'+site+syrday + strcompress(seqnum,/remove_all) +'.ps'	+ fnameseq='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/'+site+'/200'+IYR+'ir/'+site+syrday + strcompress(seqnum,/remove_all) +'.ps'
Line 735:	Line 735:
- set_plot, 'ps' - device, filename=fnamelp,/landscape	+ ;set_plot, 'ps' + ;device, filename=fnamelp,/landscape + ;!p.multi=[0,1,3] + + ;!x.style=1 + ;!x.margin=[10,10] + ;!x.style=1 + ;!y.margin=[2,2] + ;;**********UThis is the spot that controls titles for the postscript plots********************** + + ;plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$ + ;xtickformat='xticks', xminor=5,ystyle=18 + ;;!Y.TITLE = STRMID(LAB,63,4) + ;plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$ + ;xtickformat='xticks',xminor=5, ystyle=18 + ;;!Y.TITLE = STRMID(LAB,67,4) + ;plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + ;xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$ + ;xtickformat='xticks',xminor=5, ystyle=18 + ;device, /close_file + + ;Use Z-buffer + set_plot, 'Z' + ;device, filename=fnamelp2 + !p.background=255 + !p.color=0
Line 738:	Line 764:
-
Line 740:	Line 765:
- !x.margin=[10,10]	+ !x.margin=[14,5]
Line 746:	Line 771:
- xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$	+ xticks=6,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$
Line 750:	Line 775:
- xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$	+ xticks=6,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$
Line 754:	Line 779:
- xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$	+ xticks=6, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$
Line 756:	Line 781:
- device, /close_file	+ image = tvrd() + write_png, '/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/'+strupcase(site)+'/200'+yrday+'ir/'+site+syrday+'.png', image + +

ftpsri.sh

maccs — 2007-09-04 16:11:53

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Shell Script: ftpsri.sh + # Execute: ./ftpsri.sh
Line 6:	Line 8:
- # It runs todaysdata.sh which copies today's data files to the web server for the Today's Real-Time Data page	+ # It runs ["todaysdata.sh"] which copies today's line plot files to the web server for the Today's Real-Time Data Plots web page
Line 8:	Line 10:
- # IridiumMaccs2.pro to make Augsburg Format ASCII files which are used by linex7.pro - # IridiumMaccs3.pro to make IAGA2000 Format ASCII files which are made available on the MACCS iridium website - # linex7.pro to make line plots of the data which are made available on the MACCS iridium website	+ # ["IridiumMaccs2.pro"] to make Augsburg Format ASCII files which are used by ["linex7.pro"] + # ["IridiumMaccs3.pro"] to make IAGA2000 Format ASCII files which are made available on the MACCS iridium website + # ["linex7.pro"] to make line plots of the data which are made available on the MACCS iridium website

ftpsri.sh

maccs — 2007-09-04 16:08:43

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- {{{
Line 3:	Line 2:
- # Last Modified 8/21/07 by Erik Johnson	+ # Last Modified 8/23/07 by Erik Johnson
Line 7:	Line 6:
	+ # It runs todaysdata.sh which copies today's data files to the web server for the Today's Real-Time Data page
Line 24:	Line 24:
	+ SOURCEdir='/Volumes/physics_data/Code/MACCS_Code/'
Line 25:	Line 26:
- NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/'${YEAR}'ir/'	+ NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/Iridium/'${YEAR}'ir/'
Line 30:	Line 31:
- CDLdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/CD/'${YEAR}'ir/' - NALdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/NA/'${YEAR}'ir/'	+ CDLdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/CD/'${YEAR}'ir/' + NALdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PostScript/NA/'${YEAR}'ir/' + CDL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/CD/'${YEAR}'ir/' + NAL2dir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/PNG/NA/'${YEAR}'ir/'
Line 82:	Line 85:
	+ #If the data has been moved into the Problem_Data folder, set PROB=1 else set PROB=0
Line 91:	Line 95:
	+ P6DAYPROB=0
Line 102:	Line 107:
	+ P5DAYPROB=0
Line 113:	Line 119:
	+ P4DAYPROB=0
Line 124:	Line 131:
	+ P3DAYPROB=0
Line 135:	Line 143:
	+ P2DAYPROB=0
Line 146:	Line 155:
	+ PDAYPROB=0
Line 147:	Line 157:
	+ fi + cd $CDdir + if [ -f "Problem_Data/CD${YY}${DAY}.dat" ]; then + CDDAYPROB=1 + else + CDDAYPROB=0 + fi + cd $NAdir + if [ -f "Problem_Data/NA${YY}${DAY}.dat" ]; then + NADAYPROB=1 + else + NADAYPROB=0
Line 186:	Line 208:
	+ cd $CDL2dir + mv cd${YY}${P6DAY}.png Proble_Data/
Line 227:	Line 251:
	+ cd $CDL2dir + mv cd${YY}${P5DAY}.png Problem_Data/
Line 268:	Line 294:
	+ cd $CDL2dir + mv cd${YY}${P4DAY}.png Problem_Data/
Line 309:	Line 337:
	+ cd $CDL2dir + mv cd${YY}${P3DAY}.png Problem_Data/
Line 350:	Line 380:
	+ cd $CDL2dir + mv cd${YY}${P2DAY}.png Problem_Data/
Line 391:	Line 423:
	+ cd $CDL2dir + mv cd${YY}${PDAY}.png Problem_Data/
Line 397:	Line 431:
- ftp -n << END_SCRIPT - open 128.18.144.24 - user anonymous teakjohnson@embarqmail.com - epsv4 - cd pub/maccs/CD/magnetometer/ - get CD${YY}${DAY}.dat - lcd $CDdir - cd ../../NA/magnetometer/ - get NA${YY}${DAY}.dat - bye - END_SCRIPT	+ if [ "$CDDAYPROB" = 1 ]; then + cd Problem_Data/ + fi + if [ "$NADAYPROB" = 0 ]; then + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${DAY}.dat + lcd $NAdir + cd ../../NA/magnetometer/ + get NA${YY}${DAY}.dat + bye + END_SCRIPT + else + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${DAY}.dat + bye + END_SCRIPT + cd ${NAdir}Problem_Data/ + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${DAY}.dat + bye + END_SCRIPT + fi
Line 426:	Line 483:
	+ elif [ "$CDDAYPROB" = 1 ]; then + cd Problem_Data/ + echo "Processing CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + cd $CDAdir + mv CD${YY}${DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${DAY}.ps Problem_Data/ + cd $CDL2dir + mv cd${YY}${DAY}.png Problem_Data/
Line 445:	Line 527:
	+ elif [ "$NADAYPROB" = 1 ]; then + cd Problem_Data/ + echo "Processing NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + cd $NAAdir + mv NA${YY}${DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${DAY}.ps Problem_Data/ + cd $NAL2dir + mv na${YY}${DAY}.png Problem_Data/
Line 457:	Line 564:
	+ P6DAYPROB=0
Line 468:	Line 576:
	+ P5DAYPROB=0
Line 479:	Line 588:
	+ P4DAYPROB=0
Line 490:	Line 600:
	+ P3DAYPROB=0
Line 501:	Line 612:
	+ P2DAYPROB=0
Line 512:	Line 624:
	+ PDAYPROB=0
Line 553:	Line 666:
	+ cd $NAL2dir + mv na${YY}${P6DAY}.png Problem_Data/
Line 594:	Line 709:
	+ cd $NAL2dir + mv na${YY}${P5DAY}.png Problem_Data/
Line 635:	Line 752:
	+ cd $NAL2dir + mv na${YY}${P4DAY}.png Problem_Data/
Line 676:	Line 795:
	+ cd $NAL2dir + mv na${YY}${P3DAY}.png Problem_Data/
Line 717:	Line 838:
	+ cd $NAL2dir + mv na${YY}${P2DAY}.png Problem_Data/
Line 758:	Line 881:
- fi - fi - fi}}}	+ cd $NAL2dir + mv na${YY}${PDAY}.png Problem_Data/ + fi + fi + fi + + cd $SOURCEdir + ./todaysdata.sh

Processing Software

maccs — 2007-09-04 16:04:26

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- Describe Processing Software here.	+ =MACCS Iridium Data Processing At Augsburg=
Line 3:	Line 3:
- MACCS Iridium Data Processing At Augsburg	+ ==Crontab Scripts & Programs==
Line 5:	Line 5:
- The shell script used to download and process the raw data files - ["ftpsri.sh"] - The idl program used to make Augsburg format ASCII files - ["IridiumMaccs2.pro"] - The idl program used to make IAGA2000 format ASCII files - ["IridiumMaccs3.pro"] - The idl program used to make line plots - ["linex7.pro"]	+ Listing of maccs user crontab:
Line 14:	Line 7:
- 2004 Boston University MACCS Data Processing	+ 0,15,30,45 * * * * /Volumes/physics_data/Code/MACCS_Code/ftpsri.sh + 35 19 * * * /Volumes/physics_data/Code/MACCS_Code/checkMACCSir.sh + + ["ftpsri.sh"] + This program runs at :00, :15, :30, :45 of every hour of every day. It downloads the latest MACCS iridium raw data files from SRI's ftp site and files them into the MACCS_DATA/Raw/ folder. Then it makes ASCII files and line plots of the data it downloaded. It calls the following idl programs (from the /Volumes/physics_data/Code/MACCS_Code/ directory) to process the data: IridiumMaccs2.pro to make Augsburg Format ASCII files which are used by linex7.pro, IridiumMaccs3.pro to make IAGA2000 Format ASCII files which are made available on the MACCS iridium website, and linex7.pro to make line plots of the data which are made available on the MACCS iridium website. It finishes by running the todaysdata.sh shell script which make copies of the line plots for the Today's Real-Time Data Plots web page. + + ["IridiumMaccs3.pro"] + This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It creates IAGA2000 format ASCII files from the raw iridium data. + + ["IridiumMaccs2.pro"] + This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It makes Augsburg format ASCII files from the raw iridium data. + + ["linex7.pro"] + This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. It run on the Augsburg format ASCII files created by IridiumMaccs2.pro. It creates line graphs of the iridium data. + + ["todaysdata.sh"] + This script is run by ftpsri.sh at :00, :15, :30, :45 past every hour of every day. It copies the current day's line plot files to the web server and renames them. These files are made available on the Today's Real-Time Data Plots web page. + + ["checkMACCSir.sh"] + This script runs at 19:35. It emails the newest MACCS Iridium data line plot files to the listed users. If there is no new data it sends an email to report the missing data. + + ==Non-Crontab Scripts== + + ["badCD.sh"] + This script should be run on days when there is a problem with the Cape Dorset data. It moves the current day's raw and processed CD files to the Problem_Data/ folders. It can also be used to move other day's files to the Problem_Data/ folders. If the new data has just gone bad, uncomment the last section of the script to add a warning to the Today's Real-Time Data Plots web page. + + ["goodCDtoday.sh"] + This script should be run the UTC day after the problem with the Cape Dorset data has been fixed. It removes the warning from the Today's Real-Time Data Plots web page. + + ["badNA.sh"] + This script should be run on days when there is a problem with the Nain data. It moves the current day's raw and processed NA files to the Problem_Data/ folders. It can also be used to move other day's files to the Problem_Data/ folders. If the new data has just gone bad, uncomment the last section of the script to add a warning to the Today's Real-Time Data Plots web page. + + ["goodNAtoday.sh"] + This script should be run the UTC day after the problem with the Nain data has been fixed. It removes the warning from the Today's Real-Time Data Plots web page. + + ["maccsprocessing.sh"] + Convert the CD and NA iridium data into ASCII files and line plots a year at a time. + + ["processCD.sh"] + This script can be used to process a single raw Cape Dorset data file. The defult day is the current UTC day. + + ["processNA.sh"] + This script can be used to process a single raw Nain data file. The defult day is the current UTC day. + + + =2004 Boston University MACCS Data Processing=

Front Page

maccs — 2007-09-04 15:03:58

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 3:	Line 3:
	+

Front Page

maccs — 2007-09-04 15:03:31

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- =Learn About= - * ["Processing Software"] - * ["Data Collection"]	+ =Learn About MACCS= + [[Image(pang1.jpg, left, thumbnail)]] + ["Processing Software"] + + ["Data Collection"]
Line 10:	Line 12:
- [[Image(pang1.jpg)]]	+

Front Page

maccs — 2007-09-04 14:38:34

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 10:	Line 10:
-
Line 12:	Line 11:
-

Front Page

maccs — 2007-09-04 14:30:07

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 8:	Line 8:
	+ + [http://space.augsburg.edu/space/index.html Visit The Augsburg MACCS Website]

Front Page

maccs — 2007-08-24 20:29:13

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- =Learn More About=	+ =Learn About=

Front Page

maccs — 2007-08-24 20:28:42

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- [[Image(pang1.jpg)]] - - Learn More About	+ =Learn More About=
Line 10:	Line 8:
	+ + [[Image(pang1.jpg)]]

Front Page

maccs — 2007-08-24 20:26:39

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- Welcome to your new wiki! This is your wiki's Front Page. So what do you do now?	+ [[Image(pang1.jpg)]]
Line 3:	Line 3:
- [[Image(pang1.jpg)]]	+ Learn More About + * ["Processing Software"] + * ["Data Collection"] + + ["Realtime Plots" View A Realtime Plot] + + ["People" Get Contact Information]

ftpsri.sh

PhilipNeustrom — 2007-08-22 03:00:32

example of braces - you can put code in braces or upload the file 4 better look

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ {{{
Line 759:	Line 760:
- fi	+ fi}}}

ftpsri.sh

maccs — 2007-08-21 17:12:39

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 23:	Line 23:
- SOURCE='/Volumes/physics_data/Ftp/MACCS_DATA/Raw' - CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/'${YEAR}'ir/'	+ CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/Iridium/'${YEAR}'ir/'
Line 396:	Line 395:
- cd $SOURCE/CD/${YEAR}ir/	+ cd $CDdir
Line 403:	Line 402:
- lcd $SOURCE/NA/${YEAR}ir/	+ lcd $CDdir

Processing Software

maccs — 2007-08-21 15:47:26

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 14:	Line 14:
- Boston University MACCS Data Processing	+ 2004 Boston University MACCS Data Processing

ftpsri.sh

maccs — 2007-08-21 15:03:50

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 2:	Line 2:
- # Last Modified 8/20/07 by Erik Johnson	+ # Last Modified 8/21/07 by Erik Johnson
Line 28:	Line 28:
	+ CDIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/CD/'${YEAR}'ir/' + NAIdir='/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/NA/'${YEAR}'ir/' + CDLdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/CD/'${YEAR}'ir/' + NALdir='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/NA/'${YEAR}'ir/'
Line 77:	Line 81:
- cd $SOURCE/CD/${YEAR}ir/ -
Line 80:	Line 82:
	+ cd $CDdir
Line 82:	Line 85:
	+ P6DAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${P6DAY}.dat" ]; then + cd Problem_Data/ + P6DAYPROB=1 + P6DAYSIZE=`stat -f "%z" CD${YY}${P6DAY}.dat`
Line 85:	Line 93:
	+ cd $CDdir
Line 87:	Line 96:
	+ P5DAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${P5DAY}.dat" ]; then + cd Problem_Data/ + P5DAYPROB=1 + P5DAYSIZE=`stat -f "%z" CD${YY}${P5DAY}.dat`
Line 90:	Line 104:
	+ cd $CDdir
Line 92:	Line 107:
	+ P4DAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${P4DAY}.dat" ]; then + cd Problem_Data/ + P4DAYPROB=1 + P4DAYSIZE=`stat -f "%z" CD${YY}${P4DAY}.dat`
Line 95:	Line 115:
	+ cd $CDdir
Line 97:	Line 118:
	+ P3DAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${P3DAY}.dat" ]; then + cd Problem_Data/ + P3DAYPROB=1 + P3DAYSIZE=`stat -f "%z" CD${YY}${P3DAY}.dat`
Line 100:	Line 126:
	+ cd $CDdir
Line 102:	Line 129:
	+ P2DAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${P2DAY}.dat" ]; then + cd Problem_Data/ + P2DAYPROB=1 + P2DAYSIZE=`stat -f "%z" CD${YY}${P2DAY}.dat`
Line 105:	Line 137:
	+ cd $CDdir
Line 107:	Line 140:
	+ PDAYPROB=0 + elif [ -f "Problem_Data/CD${YY}${PDAY}.dat" ]; then + cd Problem_Data/ + PDAYPROB=1 + PDAYSIZE=`stat -f "%z" CD${YY}${PDAY}.dat`
Line 112:	Line 150:
	+ cd $CDdir + if [ "$P6DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 121:	Line 163:
- cd $CDdir
Line 138:	Line 179:
	+ if [ "$P6DAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${P6DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${P6DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${P6DAY}.ps Problem_Data/ + fi
Line 142:	Line 191:
	+ cd $CDdir + if [ "$P5DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 151:	Line 204:
- cd $CDdir
Line 168:	Line 220:
	+ if [ "$P5DAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${P5DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${P5DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${P5DAY}.ps Problem_Data/ + fi
Line 172:	Line 232:
	+ cd $CDdir + if [ "$P4DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 181:	Line 245:
- cd $CDdir
Line 198:	Line 261:
	+ if [ "$P4DAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${P4DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${P4DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${P4DAY}.ps Problem_Data/ + fi
Line 202:	Line 273:
	+ cd $CDdir + if [ "$P3DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 211:	Line 286:
- cd $CDdir
Line 228:	Line 302:
	+ if [ "$P3DAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${P3DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${P3DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${P3DAY}.ps Problem_Data/ + fi
Line 232:	Line 314:
	+ cd $CDdir + if [ "$P2DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 241:	Line 327:
- cd $CDdir
Line 258:	Line 343:
	+ if [ "$P2DAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${P2DAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${P2DAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${P2DAY}.ps Problem_Data/ + fi
Line 262:	Line 355:
	+ cd $CDdir + if [ "$PDAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 271:	Line 368:
- cd $CDdir
Line 288:	Line 384:
	+ if [ "$PDAYPROB" = 1 ]; then + cd $CDAdir + mv CD${YY}${PDAY}.dat Problem_Data/ + cd $CDIdir + mv CD${YY}${PDAY}.dat Problem_Data/ + cd $CDLdir + mv cd${YY}${PDAY}.ps Problem_Data/ + fi
Line 297:	Line 401:
-
Line 300:	Line 403:
- #get CD${YY}${NDAY}.dat -
Line 305:	Line 406:
- #get NA${YY}${NDAY}.dat -
Line 348:	Line 447:
- cd $SOURCE/NA/${YEAR}ir/ - - #Get the sizes of our NA files if they exits	+ #Get the sizes of our NA files if they exits and test if the data is in the Problem_Data folder + cd $NAdir
Line 353:	Line 451:
	+ P6DAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${P6DAY}.dat" ]; then + cd Problem_Data/ + P6DAYPROB=1 + P6DAYSIZE=`stat -f "%z" NA${YY}${P6DAY}.dat`
Line 356:	Line 459:
	+ cd $NAdir
Line 358:	Line 462:
	+ P5DAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${P5DAY}.dat" ]; then + cd Problem_Data/ + P5DAYPROB=1 + P5DAYSIZE=`stat -f "%z" NA${YY}${P5DAY}.dat`
Line 361:	Line 470:
	+ cd $NAdir
Line 363:	Line 473:
	+ P4DAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${P4DAY}.dat" ]; then + cd Problem_Data/ + P4DAYPROB=1 + P4DAYSIZE=`stat -f "%z" NA${YY}${P4DAY}.dat`
Line 366:	Line 481:
	+ cd $NAdir
Line 368:	Line 484:
	+ P3DAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${P3DAY}.dat" ]; then + cd Problem_Data/ + P3DAYPROB=1 + P3DAYSIZE=`stat -f "%z" NA${YY}${P3DAY}.dat`
Line 371:	Line 492:
	+ cd $NAdir
Line 373:	Line 495:
	+ P2DAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${P2DAY}.dat" ]; then + cd Problem_Data/ + P2DAYPROB=1 + P2DAYSIZE=`stat -f "%z" NA${YY}${P2DAY}.dat`
Line 376:	Line 503:
	+ cd $NAdir
Line 378:	Line 506:
	+ PDAYPROB=0 + elif [ -f "Problem_Data/NA${YY}${PDAY}.dat" ]; then + cd Problem_Data/ + PDAYPROB=1 + PDAYSIZE=`stat -f "%z" NA${YY}${PDAY}.dat`
Line 383:	Line 516:
-
Line 385:	Line 517:
	+ cd $NAdir + if [ "$P6DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 410:	Line 546:
	+ if [ "$P6DAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${P6DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${P6DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${P6DAY}.ps Problem_Data/ + fi
Line 414:	Line 558:
	+ cd $NAdir + if [ "$P5DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 439:	Line 587:
	+ if [ "$P5DAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${P5DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${P5DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${P5DAY}.ps Problem_Data/ + fi
Line 443:	Line 599:
	+ cd $NAdir + if [ "$P4DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 468:	Line 628:
	+ if [ "$P4DAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${P4DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${P4DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${P4DAY}.ps Problem_Data/ + fi
Line 472:	Line 640:
	+ cd $NAdir + if [ "$P3DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 497:	Line 669:
	+ if [ "$P3DAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${P3DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${P3DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${P3DAY}.ps Problem_Data/ + fi
Line 501:	Line 681:
	+ cd $NAdir + if [ "$P2DAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 526:	Line 710:
	+ if [ "$P2DAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${P2DAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${P2DAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${P2DAY}.ps Problem_Data/ + fi
Line 530:	Line 722:
	+ cd $NAdir + if [ "$PDAYPROB" = 1 ]; then + cd Problem_Data/ + fi
Line 555:	Line 751:
- fi - fi	+ if [ "$PDAYPROB" = 1 ]; then + cd $NAAdir + mv NA${YY}${PDAY}.dat Problem_Data/ + cd $NAIdir + mv NA${YY}${PDAY}.dat Problem_Data/ + cd $NALdir + mv na${YY}${PDAY}.ps Problem_Data/ + fi + fi + fi

Processing Software

maccs — 2007-08-20 19:28:10

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 2:	Line 2:
	+ + MACCS Iridium Data Processing At Augsburg + + The shell script used to download and process the raw data files + ["ftpsri.sh"] + The idl program used to make Augsburg format ASCII files + ["IridiumMaccs2.pro"] + The idl program used to make IAGA2000 format ASCII files + ["IridiumMaccs3.pro"] + The idl program used to make line plots + ["linex7.pro"] + + Boston University MACCS Data Processing

linex7.pro

maccs — 2007-08-20 19:16:06

Differences for linex7.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ PRO linex7,inFil,startHou,startMinut,startSecon,endHou,endMinut,endSecon,sit,forma,sequentia,postscrip,bxmi,bxma,bymi,byma,bzmi,bzma,tic,intervalHou,intervalMinut,intervalSecon + + ;This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. + ;It inputs Augsburg format ASCII files and creates line plots of the raw MACCS Iridium data. + + ;This program modified by Jake Kern and Ryan Cobian 6/2/99 + ; MODIFIED BY Mark Engebretson July 14, 2004 for Y2K and huge data files. + ; MODIFIED BY Michael Murphy August 1, 2007 to include Nain and Cape Dorset accomidations + ; MODIFIED BY Jesse Docken August 16, 2007 to make it command-line friendly + ; MODIFIED BY Erik Johnson August 17, 2007 to fix some minor bugs + + common aa, idoc,lenh,issec,dtime,x,y,z + common bb,MINVALx,MINVALy,MINVALz,MAXVALx,MAXVALy,MAXVALz + common cc,esca + common dd,inFile,startHour,startMinute,startSecond,endHour,endMinute,endSecond,site,format,sequential,postscript,bxmin,bxmax,bymin,bymax,bzmin,bzmax,tick,intervalHour,intervalMinute,intervalSecond + inFile = inFil + startHour = startHou + startMinute = startMinut + startSecond = startSecon + endHour = endHou + endMinute = endMinut + endSecond = endSecon + site = sit + format = forma + sequential = sequentia + postscript = postscrip + bxmin = bxmi + bxmax = bxma + bymin = bymi + bymax = byma + bzmin = bzmi + bzmax = bzma + tick = tic + intervalHour = intervalHou + intervalMinute = intervalMinut + intervalSecond = intervalSecon + IDOC = LONARR(24) + + SETUP,IDATUNIT,lab + + END + + + PRO SETUP,IDATUNIT,lab + common aa;, idoc,lenh,issec,dtime,x,y,z + common bb;,MINVALx,MINVALy,MINVALz,MAXVALx,MAXVALy,MAXVALz,tick + common cc;,esca + common dd;,inFile,startHour,startMinute,startSecond,endHour,endMinute,endSecond,site,format,sequential,postscript,bxmin,bxmax,bymin,bymax,bzmin,bzmax,tick,intervalHour,intervalMinute,intervalSecond + + ;IDATFILNM = '' + + + ;This first widget allows user to specify time range of plot + ;and it contains an option for sequential plotting and an option + ;an option for postcripts. + PRINT,' Lineplot Input Routine' + PRINT,' ' + + ;desc = [ $ + ; '0, Label, Lineplot Routine, center', $ + + ; '1, Base,, Row', $ + ; '0, integer,0, Label_left = Start Hour:, width=3, tag=hour', $ + ; '2, integer,0, Label_left = Start Minute:, width=3, tag=iminute', $ + ; '1, Base,, Row', $ + ; '0, integer,24, Label_left = End Hour:, width=3, tag=endhour', $ + ; '2, integer,0, Label_left = End Minute:, width=3,column, tag=endminute', $ + ; '1, Base,, Row', $ + ; '0, bUTTON, Asci\|Raw Binary\|Clean Binary, Frame, Label_Top=File Type,exclusive,set_value=0, tag=bin', $ + ; '2, button, Single File\|Multiple Files, Label_Top=Files, exclusive, set_value=0, frame, tag=filnum',$ + ; '1, Base,, Row', $ + ; '0, button, No\|Yes,Frame,Label_Top=Sequential Plots, exclusive, set_value=0,tag=seq',$ + ; '1, Base,,Row',$ + ; '0, button, No\|Yes,Frame,Label_Top=Postscripts, exclusive, set_value=1, tag=pst',$ + ; '1, Base,, Row', $ + ; '0, Button, OK, Quit , tag = ok', $ + + ; '2, Button, Cancel, quit, tag=endsetup'] + ;atitle='Lineplot INPUT' + + ; a=cw_form(desc, /column,title= atitle) + ; if (a.endsetup eq 1) then begin + ; goto, endsetup + ; endif + + esca=1 + ; bin=format + ; seq=sequential + ; pst=postscript + ; ihour=startHour + ; imin=startMinute + issec= 0.0 + ISSEC = ((startHour3600) + (startMinute60)) + + endhour=endHour + endminute=endMinute + lenh=0.0 + lenh=(endhour +(endminute/60.)) - (issec/3600.) + + tick = 12 ;First plot always contains 12 ticks + minvalx ='' + minvaly ='' ;x,y,and z min and max values are null to start(they are autoscaled). + minvalz ='' + maxvalx ='' + maxvaly ='' + maxvalz ='' + + ;idatfil= findfile('/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/2007ir/.') + endi=size(idatfil) + if 1 eq 1 then begin + ; idatfilnm=dialog_pickfile (path='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/2007ir/') + + + OPENR,IDATUNIT,inFile,/GET_LUN + DATREAD,IDATUNIT,PREV,lab + free_lun,IDATUNIT + + esc = 1 + + IF sequential eq 0 then begin + + WHILE esc ge 1 DO BEGIN + DPLOT,PWR,TIMER,LAB + free_lun,IDATUNIT + ;This widget appears if user does not select sequential + ;plotting. x,y,and z min and max values as well as the + ;time range and number of ticks can be set manually. + ;desc = [ $ + ; '0, Label, Lineplot Routine, center', $ + + ; '1, Base,, Row', $ + ; '0, float,0, Label_left = Start Hour:, width=3, tag=hour', $ + ; '2, integer,0, Label_left = Start Minute:, width=3, tag=iminute', $ + ; '1, Base,, Row', $ + ; '0, float,24, Label_left = End Hour:, width=3, tag=endhour', $ + ; '2, integer,10, Label_left = End Minute:, width=3,column, tag=endminute', $ + ; '1, Base,, Row', $ + ; '0, text,, Label_left = BXmin:, width=4,tag=bxmin',$ + ; '2, text,, Label_left = BXmax:, width=4, tag=bxmax',$ + ; '1, Base,,Row',$ + ; '0, text,,Label_left = BYmin:, width=4, tag=bymin',$ + ; '2, text,, Label_left = BYmax:, width=4, tag=bymax',$ + ; '1, Base,,Row',$ + ; '0, text,,Label_left = BZmin:, width=4, tag=bzmin',$ + ; '2, text,, Label_left = BZmax:, width=4, tag=bzmax',$ + ; '1, Base,,Row',$ + ; '0, integer,5, Label_left = Xticks:, width=4, tag=tick',$ + ; '1, Base,,Row',$ + + + ; '0, Button, OK, Quit , tag = ok', $ + + ; '2, Button, Quit, quit, tag=endsetup'] + + + + ;atitle='Lineplot INPUT' + + ; a=cw_form(desc, /column,title= atitle) + ; if (a.endsetup eq 1) then begin + ; goto, endsetup + ; endif + + esca=1 + ; intvlhr=0 + ; intervalMinute=0 + ; intvlsec=0 + esc=1 + + ; ihour=startHour + ; imin=startMinute + issec= 0.0 + ISSEC = ((startHour3600) + (startMinute60)) + + endhour=endHour + endminute=endMinute + lenh=0.0 + lenh=(endhour +(endminute/60.)) - (issec/3600.) + MINVALx = bxmin + MAXVALx = bxmax + MINVALy = bymin ;Here x,y,z min and max values can be set manually in widget. + MAXVALy = bymax + MINVALz = bzmin + MAXVALz = bzmax + tick = tick + ENDWHILE + + endif else begin + ;This widget appears if the user chooses sequential + ;plotting. A start and end time is chosen and an interval + ;is selected(interval can be as small as one second). + free_lun,IDATUNIT + + ;desc = [ $ + ; '0, Label, Lineplot Routine, center', $ + + ; '1, Base,, Row', $ + ; '0, float,0, Label_left = Start Hour:, width=3, tag=hour', $ + ; '2, integer,0, Label_left = Start Minute:, width=3, tag=iminute', $ + ; '4, integer,0, Label_left = Start Second:, width=3, tag=isecond', $ + ; '1, Base,, Row', $ + ; '0, float,24, Label_left = End Hour:, width=3, tag=endhour', $ + ; '2, integer,0, Label_left = End Minute:, width=3, tag=endminute', $ + ; '4, integer,0, Label_left = End Second:, width=3, tag=endsecond', $ + ; '1, Base,, Row', $ + ; '0, text,, Label_left = BXmin:, width=4,tag=bxmin',$ + ; '2, text,, Label_left = BXmax:, width=4, tag=bxmax',$ + ; '1, Base,,Row',$ + ; '0, text,,Label_left = BYmin:, width=4, tag=bymin',$ + ; '2, text,, Label_left = BYmax:, width=4, tag=bymax',$ + ; '1, Base,,Row',$ + ; '0, text,,Label_left = BZmin:, width=4, tag=bzmin',$ + ; '2, text,, Label_left = BZmax:, width=4, tag=bzmax',$ + ; '1, Base,,Row',$ + ; '0, integer,8, Label_left = Xticks:, width=3, tag=tick',$ + ; '1, Base,,Row',$ + ; '0, integer,0, Label_left = Interval(mins), width=3, tag=intvlmin', $ + ; '2, integer,0, Label_left = Interval(secs), width=3,tag=intvlsec',$ + ; '4, integer,0, Label_left = Interval(hours), width=3, tag=intvlhr',$ + ; '1, Base,, Row', $ + ; '0, Button, OK\|Quit, Frame, Label_Top=Graph,exclusive,set_value=1, tag=esca', $ + ; '1, Base,,Row',$ + ; '0, Button, OK, Quit , tag = ok'] + + + + + ;atitle='Lineplot INPUT' + + ; a=cw_form(desc, /column,title= atitle) + ;esca=0 + ;intvlhr=0 + ;intvlmin=0 + ;intvlsec=0 + ;esca=a.esca + ;intvlhr=a.intvlhr + ;intvlmin=a.intvlmin + ;intvlsec=a.intvlsec + ;isecond=a.isecond + ;endsecond=a.endsecond + ;ihour=startHour + ;imin=startMinute + issec= 0.0 + ISSEC = ((startHour3600) + (startMinute60))+startSecond + + ; endhour=endHour + ; endminute=endMinute + lenh=0.0 + lenh=(endhour +(endminute/60.)+(endSecond/3600.)) - (issec/3600.) + MINVALx = BXmin + MAXVALx = BXmax + MINVALy = BYmin ;Here x,y,z min and max values can be set manually in widget. + MAXVALy = BYmax + MINVALz = BZmin + MAXVALz = BZmax + ; tick = tick + + DPLOT,PWR,TIMER,LAB + endelse + + endif else begin + for i=2, endi(3)-1 do begin + + inFile=idatfil(i) + + OPENR,IDATUNIT,inFile,/GET_LUN + DATREAD,IDATUNIT,PREV,lab + free_lun,IDATUNIT + DPLOT,PWR,TIMER,LAB + free_lun,IDATUNIT + + endfor + endelse + endsetup: + END + + + + PRO DATREAD,IDATUNIT,PREV,lab + common aa;, idoc,lenh,issec,dtime,x,y,z + common bb;,MINVALx,MINVALy,MINVALz,MAXVALx,MAXVALy,MAXVALz,tick + common cc;,esca + common dd;,inFile,startHour,startMinute,startSecond,endHour,endMinute,endSecond,site,format,sequential,postscript,bxmin,bxmax,bymin,bymax,bzmin,bzmax,tick,intervalHour,intervalMinute,intervalSecond + if format ne 0 then begin + + ; set the keyword raw to 1 for raw maccs and to 2 for raw gsc + + ; x and y are the byte dimensions of the file. The order for the different + + ; types is raw maccs, raw gsc, cleaned maccs, cleaned gsc, 5 sec, and 1 min + ; (the raw files do not have fixed length) + + x = [35, 21, 28, 15, 15, 14] + y = [00, 00, 86400L, 86400L, 17280L, 1440L] + sizes = [00, 00, 2419200L, 1296000L, 259200L, 20160L] + if format eq 1 then raw=1 else raw = 0 + ; Open file and get file size + + ;This section determines file name and year/day from the binary file's name + dottest= ' ' + dotcount=0 + While dottest ne "." do begin + dottest= strmid(inFile, dotcount,1) + dotcount=dotcount+1 + + endwhile + if raw eq 1 then begin + print,"It's raw, I'm going in..." + ;statcode= strmid(inFile, dotcount-5, 2) + statcode = strmid(strlowcase(inFile), 0, 2) + print,format="(%'I\'ve found a statcode, it appears to be... %s.')", statcode + ;year= strmid(inFile, dotcount-3, 2) + year = strmid(inFile, 2, 2) + print,format="(%'Got a year here, looks like %s.')",year + ;day= strmid(inFile, dotcount, 3) + day = strmid(inFile, 4, 3) + print,format="(%'Found a day, it\'s %s.')",day + idoc(4)= 0L + iyr=0L + idy=0L + ;print, statcode, 'STAT', year, 'year', day, 'day' + iyr=float(year) + idy=float(day) + idoc(4)= (iyr1000+idy) + endif else begin + statcode=strmid(inFile, dotcount-8, 2) + idoc(4)=float(strmid(inFile, dotcount-6, 5)) + endelse + ;print, idoc(4), 'idoc4' + CASE statcode of + 'na': idoc(3)=[122] + 'pg': idoc(3)=[111] + 'cy': idoc(3)=[112] + 'iq': idoc(3)=[117] + 'cd': idoc(3)=[104] + 'ig': idoc(3)=[109] + 'ch': idoc(3)=[103] + 'rb': idoc(3)=[118] + 'pb': idoc(3)=[116] + 'gh': idoc(3)=[110] + 're': idoc(3)=[119] + 'cb': idoc(3)=[120] + 'bl': idoc(3)=[121] + 'ca': idoc(3)=[301] + + + + ELSE : begin ;unknown station + print,'Unacceptable Station Code' + + ENDELSE + endcase + + + unit=idatunit + + file_info = fstat(unit) + file_size = file_info.size + + print,file_size + + if keyword_set(raw) then begin + type = raw - 1 + if raw eq 1 then y(0) = file_size / x(0) + if raw eq 2 then y(1) = file_size / x(1) + endif else begin + type = where(file_size eq sizes, count) + ;print,type + if count eq 0 then begin + ;print,'Error in file size.' + stop + endif else type = type(0) + endelse + + + print,'Now processing ';,filename + data_array = bytarr(x(type),y(type)) + readu,unit,data_array + + + offset = [3, 2, 1, 0, 0, 0] + + hh = data_array(offset(type) + 0,) + mm = data_array(offset(type) + 1,) + offset(5) = -1 + bx1 = long(data_array(offset(type) + 3:offset(type) + 6,),0,1,y(type))/1000. + by1 = long(data_array(offset(type) + 7:offset(type) + 10,),0,1,y(type))/1000. + bz1 = long(data_array(offset(type) + 11:offset(type) + 14,),0,1,y(type))/1000. + + case type of + 5: ss = 0 + 4: ss = data_array(2,) ; 5 sec + 3: ss = data_array(2,) ; gsc clean + 2: begin ; maccs clean + tf1 = data_array(0,) + ss = data_array(3,) + bx1 = long(data_array(04:07,),0,1,y(type))/1000. + bx2 = long(data_array(08:11,),0,1,y(type))/1000. + by1 = long(data_array(12:15,),0,1,y(type))/1000. + by2 = long(data_array(16:19,),0,1,y(type))/1000. + bz1 = long(data_array(20:23,),0,1,y(type))/1000. + bz2 = long(data_array(24:27,),0,1,y(type))/1000. + end + 1: begin ; gsc raw + dd = fix (data_array( 0: 1,),0,1,y(type)) + ss = data_array(4,) + end + 0: begin ; maccs raw + header= data_array( 0,) + dd = fix (data_array( 1: 2,),0,1,y(type)) + ss = data_array(5,) + bx2 = long(data_array(18:21,),0,1,y(type))/1000. + by2 = long(data_array(22:25,),0,1,y(type))/1000. + bz2 = long(data_array(26:29,),0,1,y(type))/1000. + tf1 = data_array(30,) + tf2 = data_array(31,) + block = data_array(32,) + status= data_array(33,) + house = data_array(34,) + end + endcase + + + bx1=extrac(bx1,0,1,1,86400) + bx2=extrac(bx2,0,1,1,86400) + + by1=extrac(by1,0,1,1,86400) + by2=extrac(by2,0,1,1,86400) + + bz1=extrac(bz1,0,1,1,86400) + bz2=extrac(bz2,0,1,1,86400) + + n=findgen(file_size/x(type)) + nstep=n + n=n2 + x=fltarr(172800L) + y=x + z=x + + x[n]=Bx1[nstep+50] + x[n+1]= bx2[nstep+50] + + y[n]=By1[nstep+50] + y[n+1]=By2[nstep+50] + + z[n]=Bz1[nstep+50] + z[n+1]=Bz2[nstep+50] + + timeX = hh3600. + mm60. + ss + timex=extrac(timex,0,1,1,86400) + Dtime=dblarr(172800) + Dtime[n]=timex[nstep+50]- 0.75 + Dtime[n+1]= timex[nstep+50]- 0.250 + + endif + + if format eq 0 then begin + + BAD = 32767 + TIME = FINDGEN(50) + + LABEL = '' + + + READF,idatunit, format = '(12(i8),/,12(i8))', IDOC + READF,IDATUNIT,format = '(a)', LABEL + PRINT, 'LABEL = ', LABEL + lab=label + + DTIME = fltARR(900000) + dtime2=dtime + X = FLTARR(900000) + Y = X + Z = X + I=0L + WHILE (NOT EOF (IDATUNIT)) DO BEGIN + ;readf,IDATUNIT,format='(f15, 3(f12))' ,FTIME,FX,FY,FZ ;formats A80 Fluxgate + ;readf,IDATUNIT,format='(g15, 3(g12))' ,FTIME,FX,FY,FZ ;formats Sondy search coil + readf,IDATUNIT ,FTIME,FX,FY,FZ + + DTIME(I)= FTIME + X(I)= FX + Y(I) = FY + Z(I) = FZ + + ;print, 'ftime, fx, fy, fz = ', ftime, fx, fy, fz + + I=I+1 + + ENDWHILE + ;DTIME=FLTARR(I) + ;X=DTIME + ;Y=DTIME + ;Z=DTIME + + ;DTIME=EXTRAC(DDTIME,0,I) + ;X=EXTRAC(XX,0,I) + ;Y=EXTRAC(YY,0,I) + ;Z=EXTRAC(ZZ,0,I) + + + + endif + + end + + + PRO DPLOT,PWR,TIMER,LAB + common aa;, idoc,lenh,issec,dtime,x,y,z + common bb;,MINVALx,MINVALy,MINVALz,MAXVALx,MAXVALy,MAXVALz,tick + common cc;,esca + common dd;,inFile,startHour,startMinute,startSecond,endHour,endMinute,endSecond,site,format,sequential,postscript,bxmin,bxmax,bymin,bymax,bzmin,bzmax,tick,intervalHour,intervalMinute,intervalSecond + + ; MENU = ['',''] + TLAB = '' + + CASE idoc(3) OF + 0: sitename='IRM Data' + 101: sitename='PANGNIRTUNG' + 112: sitename='CLYDE RIVER' + 117: sitename='IQALUIT' + 104: sitename='CAPE DORSET' + 109: sitename='IGLOOLIK' + 103: sitename='CORAL HARBOUR' + 118: sitename='REPULSE BAY' + + 116: sitename='PELLY BAY' + 110: sitename='GJOA HAVEN' + 119: sitename='RESOLUTE BAY' + 120: sitename='CAMBRIDGE BAY' + 121: sitename='BAKER LAKE' + 122: sitename='NAIN' + + 201: sitename='AGO P1' + 202: sitename='AGO P2' + 203: sitename='AGO P3' + 204: sitename='AGO P4' + 205: sitename='AGO P5' + 206: sitename='AGO P6' + 15: sitename='Sondrestromfjord' + 16: sitename='South Pole' + + 277: sitename='AGO A77' + 276: sitename='Halley' + 280: sitename='AGO A80' + 281: sitename='AGO A81' + 284: sitename='AGO A84' + 301: sitename='Cambridge' + + + 1: sitename='Air Force Academy' + 3: sitename='Jicamarca' + 4: sitename='Los Alamos ' + 5: sitename='San Gabriel ' + + 300: sitename='Korea' + + 700: sitename='Kotelnyy' + 701: sitename='Tixie' + 702: sitename='Chokurdakh' + 703: sitename='Zyryanka' + 704: sitename='Chichijima' + 705: sitename='Ewa Beach' + 706: sitename='St. Patatunka' + 707: sitename='Lunping' + 708: sitename='Muntinlupa' + 709: sitename='Onagawa' + 710: sitename='Popov Island' + 711: sitename='Moshiri' + + 600: sitename='Fort Churchill' + 601: sitename='Contwoyto Lake' + 602: sitename='Dawson' + 603: sitename='Eskimo Point' + 604: sitename='Gillam' + 605: sitename='Island Lake' + 606: sitename='Fort McMurray' + 607: sitename='Pinawa' + 608: sitename='Rabbit Lake' + 609: sitename='Rankin Inlet' + 610: sitename='Fort Simpson' + 611: sitename='Fort Smith' + 612: sitename='Taloyoak' + + + + ELSE : begin ;unknown station + PRINT,'Unknown Station. Enter the name of the station.' + mentemp=' ' + READ, mentemp + sitename= mentemp + + ENDELSE + endcase + + YRDAY = IDOC(4) + + + ; COMPOSE TITLE FOR PLOT + print,YRDAY + MMDD, YRDAY, MON, DAY, IYR + + YRDIVTH = YRDAY/1000 + + IF YRDIVTH LE 80 THEN BEGIN + IHEAD = STRING(FORMAT="(5X,'YEARDAY = ',I5,13X,A3,' ',I2,', 200',I1,' ')", $ + YRDAY,MON,DAY,IYR) + ENDIF ELSE BEGIN + IHEAD = STRING(FORMAT="(5X,'YEARDAY = ',I5,13X,A3,' ',I2,', 19',I2,' ')", $ + YRDAY,MON,DAY,IYR) + ENDELSE + IHEAD = sitename + IHEAD + length=lenh + T1 = issec / 3600. + T2 = T1 + LENH + syrday = STRING(FORMAT="(I05)", YRDAY) + yrday = strmid(IYR,7,1) + fnamelp= '/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/'+strupcase(site)+'/200'+yrday+'ir/'+site+syrday+'.ps' + ;fnamelp= '~/'+site+syrday+'lp'+'.ps' + set_plot, 'x' + ; window,0,xpos=0,ypos=0,xsize=800,ysize=500 + !p.multi=[0,1,3] + !x.style=1 + !x.margin=[10,10] + !x.style=1 + !y.margin=[2,2] + + IF esca ne 0 then Begin + + ;plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Mag H',$ + ;xtickformat='xticks', ystyle=18 + ;!Y.TITLE = STRMID(LAB,63,4) + ;plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + ;xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='Mag H',$ + ;xtickformat='xticks', ystyle=18 + ;!Y.TITLE = STRMID(LAB,67,4) + ;plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + ;xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Mag H',$ + ;xtickformat='xticks', ystyle=18 + + endif else begin ;This is the beginning of the sequential plotting loop. + increment = intervalHour + (intervalMinute/60.) + (intervalSecond/3600.) + testend = (t2-t1)/increment + auto=0 + if minvalx eq '' then auto=1 + for test=0,testend-1 do begin + + t2= t1 + increment + + set_plot, 'win' + window,0,xpos=0,ypos=0,xsize=800,ysize=500 + !p.multi=[0,1,3] + !x.style=1 + !x.margin=[10,10] + !x.style=1 + !y.margin=[2,2] + timestep=dtime(1)-dtime(0) + te1=t13600/timestep + te2=t23600/timestep + if auto eq 1 then begin + minvalx=min(x(te1:te2)) ;This aids in autoscaling. + maxvalx=max(x(te1:te2)) + minvaly=min(y(te1:te2)) + maxvaly=max(y(te1:te2)) + minvalz=min(z(te1:te2)) + maxvalz=max(z(te1:te2)) + endif + plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$ + xtickformat='xticks', ystyle=18 + + plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$ + xtickformat='xticks', ystyle=18 + + plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$ + xtickformat='xticks', ystyle=18 + + + ;desc = [ $ + ; '0, Label, Lineplot Routine, center', $ + ; '1, Base,, Row', $ + ; '0, Button, NEXT, Quit , tag = ok', $ + + ; '2, Button, QUIT, quit, tag=endprog'] + ;atitle='Lineplot INPUT' + + ; a=cw_form(desc, /column,title= atitle) + + ; if (a.endprog eq 1) then begin + ; goto, endloop + ; endif + + + + + if (postscript eq 1) then begin + seqnum= STRING(FORMAT="(I03)", test+1) + + fnameseq='/Volumes/physics_data/Ftp/MACCS_DATA/LinePlots/'+site+'/200'+IYR+'ir/'+site+syrday + strcompress(seqnum,/remove_all) +'.ps' + set_plot, 'ps' + device, filename=fnameseq,/landscape + !p.multi=[0,1,3] + + !x.style=1 + !x.margin=[10,10] + !x.style=1 + !y.margin=[2,2] + + + plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Mag H',$ + xtickformat='xticks', ystyle=18 + ;!Y.TITLE = STRMID(LAB,63,4) + plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='Mag z',$ + xtickformat='xticks', ystyle=18 + ;!Y.TITLE = STRMID(LAB,67,4) + plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Mag H',$ + xtickformat='xticks', ystyle=18 + device, /close_file + endif + + t1 = t1 + increment + endfor + endelse + if (postscript eq 0) then begin + goto, endprogram + endif + + + set_plot, 'ps' + device, filename=fnamelp,/landscape + !p.multi=[0,1,3] + + !x.style=1 + !x.margin=[10,10] + !x.style=1 + !y.margin=[2,2] + ;**********UThis is the spot that controls titles for the postscript plots********************** + + plot,Dtime(where ((fix(x) ne 32767) and (x ne 0.0)))/3600,x(where((fix(x) ne 32767)and (x ne 0.0))),$ + xticks=tick,xrange = [t1,t2], yrange=[MINVALx,MAXVALx],title = ihead,charsize=2.0,ytitle='Bx',$ + xtickformat='xticks', xminor=5,ystyle=18 + ;!Y.TITLE = STRMID(LAB,63,4) + plot,Dtime(where ((fix(y) ne 32767) and (y ne 0.0)))/3600,y(where((fix(y) ne 32767)and (y ne 0.0))),$ + xticks=tick,xrange = [t1,t2], charsize=2.0,yrange=[minvaly, maxvaly],ytitle='By',$ + xtickformat='xticks',xminor=5, ystyle=18 + ;!Y.TITLE = STRMID(LAB,67,4) + plot,Dtime(where ((fix(z) ne 32767) and (z ne 0.0)))/3600,z(where((fix(z) ne 32767)and (z ne 0.0))),$ + xticks=tick, xrange = [t1,t2], charsize=2.0,yrange=[minvalz, maxvalz],ytitle='Bz',$ + xtickformat='xticks',xminor=5, ystyle=18 + device, /close_file + endloop: + endprogram: + END + + + + + PRO MMDD,YRDAY,MONTH,MNTHDA,IYR + + ; 11 NOV 85 S FAVIN + ; GIVEN YRDAY LIKE 85199 + ; RETURNS WITH CHARACTER MONTH AND DAY NUMBER IN MONTH + + LEAPYR = [0,0,31,60,91,121,152,182,213,244,274,305,335,366] + NOLEAP = [0,0,31,59,90,120,151,181,212,243,273,304,334,365] + CHARM = ['','JAN','FEB','MAR','APR','MAY','JUN', $ + 'JUL','AUG','SEP','OCT','NOV','DEC'] + MONTH = '' + + IYEAR = FIX(YRDAY/1000) + IDAY = FIX(YRDAY - IYEAR1000) + MON= FIX(IDAY/30+1) + IF((IYEAR MOD 100) EQ 0) THEN GOTO, A366 + IF((IYEAR MOD 4) EQ 0) THEN GOTO, A366 + IF((IDAY-NOLEAP(MON)) LE 0) THEN MON = MON -1 + MNTHDA=IDAY-NOLEAP(MON) + A365: MONTH = CHARM(MON) + IYR=IYEAR + RETURN + A366: IF((IDAY-LEAPYR(MON)) LE 0) THEN MON = MON - 1 + MNTHDA=IDAY-LEAPYR(MON) + GOTO, A365 + END + + function xticks, axis, index, value + on_error,1 + + if keyword_set(help) then begin + helpdir = 'c:\rsi\idl40\help\user' + helpfile = helpdir + '\xticks.txt' + xdisplayfile, helpfile + return, 0 + endif + + ;hour = fix(value+.5) + hour = fix(value) + if hour gt 23 then hour = hour -24 + min = fix(value60. mod 60.) + sec = fix(value3600. mod 60. + .5) + + if sec eq 60 then begin + sec = 0 + min = min + 1 + if min eq 60 then begin + min = 0 + hour = hour+1 + endif + endif + if sec eq 0 then begin ;Seconds are not shown on time scale if they are zero. + return, string(format = '(i2.2,":",i2.2)',hour,min) + endif + + ;min = fix(value60. mod 60. + .5) + ;if min eq 60 then begin + ; min = 0 + ; hour = hour+1 + ;endif + ;sec = fix(value*3600. mod 60. + .5) + ;if sec eq 60 then sec = 0 + return, string(format = '(i2.2,":",i2.2,":",i2.2)', hour, min, sec) + end

ftpsri.sh

maccs — 2007-08-20 19:15:28

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- {{{ - # Written by Erik Johnson July 2007 - # Last Modified 8/13/07 - # This program is run at :00, :15, :30, :45 of every hour of every day.	+ # Created by Erik Johnson July 2007 + # Last Modified 8/20/07 by Erik Johnson + # This program is run at :00, :15, :30, :45 of every hour of every day by the maccs user crontab.
Line 6:	Line 5:
- - SOURCE='/Volumes/physics_data/Ftp/MACCS_DATA/Raw' - YEAR=`date +%Y` - YY=`date +%y` - DAY=`date +%j` - NDAY=`echo $DAY + 1 \| bc`	+ # Then it makes ASCII files and line plots of the data it downloaded. + # It calls the following idl programs (from the /Volumes/physics_data/Code/MACCS_Code/ directory) to process the data: + # IridiumMaccs2.pro to make Augsburg Format ASCII files which are used by linex7.pro + # IridiumMaccs3.pro to make IAGA2000 Format ASCII files which are made available on the MACCS iridium website + # linex7.pro to make line plots of the data which are made available on the MACCS iridium website + + #Get the current year, julian day and previous 6 days in UTC + YEAR=`date -u +%Y` + YY=`date -u +%y` + DAY=`date -u +%j` + #NDAY=`echo $DAY + 1 \| bc`
Line 19:	Line 23:
	+ SOURCE='/Volumes/physics_data/Ftp/MACCS_DATA/Raw' + CDdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/'${YEAR}'ir/' + NAdir='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/NA/'${YEAR}'ir/' + CDAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/CD/'${YEAR}'ir/' + NAAdir='/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/NA/'${YEAR}'ir/' +
Line 26:	Line 36:
- if [ $NDAY -lt 10 ]; then - NDAY=00$NDAY - elif [ $NDAY -lt 100 ]; then - NDAY=0$NDAY - fi	+ #if [ $NDAY -lt 10 ]; then + # NDAY=00$NDAY + #elif [ $NDAY -lt 100 ]; then + # NDAY=0$NDAY + #fi
Line 63:	Line 73:
- #get the files from SRI if they are different in file size from the ones we have	+ #Get the maccs iridium raw data files from SRI if they are different in file size from the ones we have. + #If a new file was downloaded, make an Augsburg format ASCII file, a IAGA2000 format ASCII file, + #and a line plot of the data.
Line 109:	Line 121:
	+ cd $CDdir + if [ -f "CD${YY}${P6DAY}.dat" ]; then + echo "Processing $CD${YY}${P6DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${P6DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${P6DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${P6DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${P6DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 121:	Line 151:
	+ cd $CDdir + if [ -f "CD${YY}${P5DAY}.dat" ]; then + echo "Processing CD${YY}${P5DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${P5DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${P5DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${P5DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${P5DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 133:	Line 181:
	+ cd $CDdir + if [ -f "CD${YY}${P4DAY}.dat" ]; then + echo "Processing CD${YY}${P4DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${P4DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${P4DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${P4DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${P4DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 145:	Line 211:
	+ cd $CDdir + if [ -f "CD${YY}${P3DAY}.dat" ]; then + echo "Processing CD${YY}${P3DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${P3DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${P3DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${P3DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${P3DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 157:	Line 241:
	+ cd $CDdir + if [ -f "CD${YY}${P2DAY}.dat" ]; then + echo "Processing CD${YY}${P2DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${P2DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${P2DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${P2DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${P2DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 169:	Line 271:
	+ cd $CDdir + if [ -f "CD${YY}${PDAY}.dat" ]; then + echo "Processing CD${YY}${PDAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${PDAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${PDAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${PDAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${PDAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 172:	Line 292:
- - ftp -n << END_SCRIPT - open 128.18.144.24 - user anonymous teakjohnson@embarqmail.com - - epsv4 - cd pub/maccs/CD/magnetometer/ -	+ cd $SOURCE/CD/${YEAR}ir/ + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + + cd pub/maccs/CD/magnetometer/
Line 181:	Line 300:
- get CD${YY}${NDAY}.dat	+ #get CD${YY}${NDAY}.dat
Line 186:	Line 305:
- get NA${YY}${NDAY}.dat - - bye - END_SCRIPT	+ #get NA${YY}${NDAY}.dat + + bye + END_SCRIPT + + cd $CDdir + if [ -f "CD${YY}${DAY}.dat" ]; then + echo "Processing CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "CD${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "CD${YY}${DAY}.dat" + exit + END_SCRIPT + cd $CDAdir + echo "Plotting ${CDAdir}CD${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"CD${YY}${DAY}.dat",0,0,0,0,0,0,"cd",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi + + cd $NAdir + if [ -f "NA${YY}${DAY}.dat" ]; then + echo "Processing NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 226:	Line 383:
	+
Line 236:	Line 394:
	+ if [ -f "NA${YY}${P6DAY}.dat" ]; then + echo "Processing NA${YY}${P6DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${P6DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${P6DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${P6DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${P6DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 248:	Line 423:
	+ if [ -f "NA${YY}${P5DAY}.dat" ]; then + echo "Processing NA${YY}${P5DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${P5DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${P5DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${P5DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${P5DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 260:	Line 452:
	+ if [ -f "NA${YY}${P4DAY}.dat" ]; then + echo "Processing NA${YY}${P4DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${P4DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${P4DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${P4DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${P4DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 272:	Line 481:
	+ if [ -f "NA${YY}${P3DAY}.dat" ]; then + echo "Processing NA${YY}${P3DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${P3DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${P3DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${P3DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${P3DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 284:	Line 510:
	+ if [ -f "NA${YY}${P2DAY}.dat" ]; then + echo "Processing NA${YY}${P2DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${P2DAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${P2DAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${P2DAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${P2DAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi
Line 296:	Line 539:
- fi - }}}	+ if [ -f "NA${YY}${PDAY}.dat" ]; then + echo "Processing NA${YY}${PDAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs2.pro + IridiumMaccs2, "NA${YY}${PDAY}.dat" + .compile /Volumes/physics_data/Code/MACCS_Code/IridiumMaccs3.pro + IridiumMaccs3, "NA${YY}${PDAY}.dat" + exit + END_SCRIPT + cd $NAAdir + echo "Plotting ${NAAdir}NA${YY}${PDAY}.dat" + idl << END_SCRIPT + .compile /Volumes/physics_data/Code/MACCS_Code/linex7.pro + linex7,"NA${YY}${PDAY}.dat",0,0,0,0,0,0,"na",0,1,1,"","","","","","",5,2,0,0 + exit + END_SCRIPT + fi + fi

IridiumMaccs3.pro

maccs — 2007-08-20 19:13:30

Differences for IridiumMaccs3.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ PRO IridiumMACCS3,filename + + + + ;This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. + + ;It creates IAGA2000 format ASCII files from the raw MACCS Iridium data. + + + + ;Overhaul Modifications by Michael Murphy Augsut 1, 2007 to begin working for 2 Maccs station + + ;Modifications by Erik Johnson August 15, 2007 to run on yspace from a script (maccsprocessing.sh) + + ;Modifications by Erik Johnson August 16, 2007 to comply with the IAGA2000 Data Exchange Format + + + + close, /all + + ;filename='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/.dat' + + ;print, filename + + openr,unit,filename,error=err,/get_lun + + test_array = bytarr(11) + + readu,unit,test_array + + reclen=test_array(10)+9 + + free_lun,unit + + + + openr,unit,filename,error=err,/get_lun + + file_info = fstat(unit) + + file_size = file_info.size/reclen + + data_array = bytarr(reclen,file_size) + + if (err eq 0) then begin + + print,'Now processing ',filename + + readu,unit,data_array + + free_lun,unit + + endif else begin + + print,'An error has occurred while trying to read ',filename + + stop + + endelse + + + + numsamples=(test_array(10)-9)/3/3 + + + + xvalue=fltarr(numsamples,file_size) + + yvalue=fltarr(numsamples,file_size) + + zvalue=fltarr(numsamples,file_size) + + timevalue=data_array(4,)3600.0+data_array(5,)60.0+data_array(6,) + + FOR i=0,numsamples-1 DO BEGIN + + xvalue(i,)=(data_array(18+(i9),)65536l+data_array(19+(i9),)256l+data_array(20+(i9),))0.025 + + yvalue(i,)=(data_array(21+(i9),)65536l+data_array(22+(i9),)256l+data_array(23+(i9),))0.025 + + zvalue(i,)=(data_array(24+(i9),)65536l+data_array(25+(i9),)256l+data_array(26+(i9),))0.025 + + ENDFOR + + + + + + n=findgen(file_size) + + nstep=n + + n=n2 + + + + bx=fltarr(file_size2l) + + by=bx + + bz=bx + + + + bx[n]=xvalue[0,nstep] + + bx[n+1]= xvalue[1,nstep] + + + + by[n]=yvalue[0,nstep] + + by[n+1]= yvalue[1,nstep] + + + + bz[n]=zvalue[0,nstep] + + bz[n+1]= zvalue[1,nstep] + + + + Dtime=dblarr(file_size2l) + + Dtime[n]=timevalue[0,nstep]+ 0.25 + + Dtime[n+1]= timevalue[0,nstep]+ 0.75 + + + + ;Section for writing data + + lab = '' + + label=strmid(filename,0,2) + + labelx=strmid(filename,2,5) + + yrday=fix(labelx) + + MMDD, YRDAY, MON, DAY + + year=strmid(labelx,0,2) + + year1=fix(year) + + if year1 ge 92 then begin + + year=string('19',year) + + endif else begin + + year=string('20',year) + + endelse + + + + ;Create The 11 mandatory file header records + + + + line1=' Format \| IAGA2000 \|' + + + + if label eq 'NA' then begin + + line2=' Station \| Nain, Canada \|' + + line3=' IAGA Code \| NAN \|' + + line4=' Geodetic Latitude \| 56.4 \|' + + line5=' Geodetic Longitude \| 298.3 \|' + + line6=' Elevation \| 7 \|' + + endif + + + + if label eq 'CD' then begin + + line2=' Station \| Cape Dorset, Canada \|' + + line3=' IAGA Code \| CDR \|' + + line4=' Geodetic Latitude \| 64.2 \|' + + line5=' Geodetic Longitude \| 283.4 \|' + + line6=' Elevation \| 50 \|' + + endif + + + + line7=' Observed \| XYZ \|' + + line8=' Digital Sampling \| 0.5 seconds \|' + + line9=' Data Interval \| 0.5 seconds \|' + + line10=' Data type \| Variation \|' + + line11=' Variables \| 9 \|' + + line12=' # For more information visit http://space.augsburg.edu \|' + + line13=' Year\| MT\| DY\| HR\| MN\| SC\| CDRX\| CDRY\| CDRZ\|' + + length=size(bx,/n_elements) + + newarray = fltarr(4,length) + + stringarr = strarr(1,length) + + ;newarray[0,]= ' ' + + newarray[0,]= Dtime + + newarray[1,] = bx + + newarray[2,] = by + + newarray[3,] = bz + + + + for i=1l, length, 1 do begin + + totals = newarray[0,i-1] + + hour = fix(totals/3600) + + totals = totals - (hour3600l) + + min = fix(totals/60) + + sec = fix(totals - (min60)) + + data = string(year, mon, day, hour, min, sec, newarray[1,i-1],newarray[2,i-1],newarray[3,i-1], $ + + format='(" ", a4, "\| ", i2, "\| ", i2, "\| ", i2, "\| ", i2, "\| ", i2, "\|", f10.2, "\|", f10.2, "\|", f10.2, "\|")') + + stringarr[0,i-1] = data + + endfor + + + + openw, 2,'/Volumes/physics_data/Ftp/MACCS_DATA/IAGA2000/'+label+'/'+year+'ir/'+label+labelx+'.dat',width=107 + + printf,2,line1 + + printf,2,line2 + + printf,2,line3 + + printf,2,line4 + + printf,2,line5 + + printf,2,line6 + + printf,2,line7 + + printf,2,line8 + + printf,2,line9 + + printf,2,line10 + + printf,2,line11 + + printf,2,line12 + + printf,2,line13 + + printf,2,stringarr + + ;printf,2,newarray,format='(f8.2,3f15.3)' + + close, 2 + + + + print, 'program finished' + + END + + + + PRO MMDD,YRDAY,MONTH,MNTHDA,IYR + + + + + + + + ; 11 NOV 85 S FAVIN + + + + ; GIVEN YRDAY LIKE 85199 + + + + ; RETURNS WITH CHARACTER MONTH AND DAY NUMBER IN MONTH + + + + + + + + LEAPYR = [0,0,31,60,91,121,152,182,213,244,274,305,335,366] + + + + NOLEAP = [0,0,31,59,90,120,151,181,212,243,273,304,334,365] + + + + CHARM = ['','1','2','3','4','5','6', $ + + + + '7','8','9','10','11','12'] + + + + MONTH = '' + + + + + + + + IYEAR = FIX(YRDAY/1000) + + + + IDAY = FIX(YRDAY - IYEAR1000) + + + + MON= FIX(IDAY/30+1) + + + + IF((IYEAR MOD 100) EQ 0) THEN GOTO, A366 + + + + IF((IYEAR MOD 4) EQ 0) THEN GOTO, A366 + + + + IF((IDAY-NOLEAP(MON)) LE 0) THEN MON = MON -1 + + + + MNTHDA=IDAY-NOLEAP(MON) + + + + A365: MONTH = CHARM(MON) + + + + IYR=IYEAR + + + + RETURN + + + + A366: IF((IDAY-LEAPYR(MON)) LE 0) THEN MON = MON - 1 + + + + MNTHDA=IDAY-LEAPYR(MON) + + + + GOTO, A365 + + + + END + + + + + + + + function xticks, axis, index, value + + + + on_error,1 + + + + + + + + if keyword_set(help) then begin + + + + helpdir = 'c:\rsi\idl40\help\user' + + + + helpfile = helpdir + '\xticks.txt' + + + + xdisplayfile, helpfile + + + + return, 0 + + + + endif + + + + + + + + ;hour = fix(value+.5) + + + + hour = fix(value) + + + + if hour gt 23 then hour = hour -24 + + + + min = fix(value60. mod 60.) + + + + sec = fix(value3600. mod 60. + .5) + + + + + + + + if sec eq 60 then begin + + + + sec = 0 + + + + min = min + 1 + + + + if min eq 60 then begin + + + + min = 0 + + + + hour = hour+1 + + + + endif + + + + endif + + + + if sec eq 0 then begin ;Seconds are not shown on time scale if they are zero. + + + + return, string(format = '(i2.2,":",i2.2)',hour,min) + + + + endif + + + + + + + + ;min = fix(value60. mod 60. + .5) + + + + ;if min eq 60 then begin + + + + ; min = 0 + + + + ; hour = hour+1 + + + + ;endif + + + + ;sec = fix(value*3600. mod 60. + .5) + + + + ;if sec eq 60 then sec = 0 + + + + return, string(format = '(i2.2,":",i2.2,":",i2.2)', hour, min, sec) + + + + end

IridiumMaccs2.pro

maccs — 2007-08-20 19:13:00

Differences for IridiumMaccs2.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ PRO IridiumMACCS2,filename + + + + ;This program is run by ftpsri.sh at :00, :15, :30, and :45 past every hour of every day. + + ;It creates Augsburg format ASCII files from the raw MACCS Iridium data. + + ;The ASCII files it creates can be used to produce line plots (with linex7.pro) as well as spectrograms + + + + ;Overhaul Modifications by Michael Murphy Augsut 1, 2007 to begin working for 2 Maccs station + + ;Modifications by Erik Johnson August 15, 2007 to run on yspace from the maccsprocessing.sh shell script + + + + close, /all + + ;filename='/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/.dat' + + ;filename=dialog_pickfile (path='C:\Documents and Settings\murphy\Research\Rawdata\.dat') + + print, filename + + openr,unit,filename,error=err,/get_lun + + test_array = bytarr(11) + + readu,unit,test_array + + reclen=test_array(10)+9 + + free_lun,unit + + + + openr,unit,filename,error=err,/get_lun + + file_info = fstat(unit) + + file_size = file_info.size/reclen + + data_array = bytarr(reclen,file_size) + + if (err eq 0) then begin + + print,'Now processing ',filename + + readu,unit,data_array + + free_lun,unit + + endif else begin + + print,'An error has occurred while trying to read ',filename + + stop + + endelse + + + + numsamples=(test_array(10)-9)/3/3 + + + + xvalue=fltarr(numsamples,file_size) + + yvalue=fltarr(numsamples,file_size) + + zvalue=fltarr(numsamples,file_size) + + timevalue=data_array(4,)3600.0+data_array(5,)60.0+data_array(6,) + + FOR i=0,numsamples-1 DO BEGIN + + xvalue(i,)=(data_array(18+(i9),)65536l+data_array(19+(i9),)256l+data_array(20+(i9),))0.025 + + yvalue(i,)=(data_array(21+(i9),)65536l+data_array(22+(i9),)256l+data_array(23+(i9),))0.025 + + zvalue(i,)=(data_array(24+(i9),)65536l+data_array(25+(i9),)256l+data_array(26+(i9),))0.025 + + ENDFOR + + + + + + n=findgen(file_size) + + nstep=n + + n=n2 + + + + bx=fltarr(file_size2l) + + by=bx + + bz=bx + + + + bx[n]=xvalue[0,nstep] + + bx[n+1]= xvalue[1,nstep] + + + + by[n]=yvalue[0,nstep] + + by[n+1]= yvalue[1,nstep] + + + + bz[n]=zvalue[0,nstep] + + bz[n+1]= zvalue[1,nstep] + + + + Dtime=dblarr(file_size2l) + + Dtime[n]=timevalue[0,nstep]+ 0.25 + + Dtime[n+1]= timevalue[0,nstep]+ 0.75 + + + + ;Section for writing data + + lab = '' + + idoc = LONARR(24) + + label=strmid(filename,0,2) + + labelx=strmid(filename,2,5) + + year=strmid(labelx,0,2) + + ;label2=fix(strmid(filename,2,5)) + + ;label3=strmid(filename,37,3) + + ;'C:\Documents and Settings\murphy\NA07159.dat' + + idoc(0)=1 + + idoc(2)=n_elements(Dtime) + + + + print, label + + + + if label eq 'NA' then begin + + idoc(3)=122 + + line3='Nain Iridium Data' + + endif + + + + if label eq 'CD' then begin + + idoc(3)=104 + + line3='Cape Dorset Iridium Data' + + endif + + + + idoc(4)=labelx + + + + newarray = fltarr(4,size(bx,/n_elements)) + + newarray[0,]= Dtime + + newarray[1,]= bx + + newarray[2,]= by + + newarray[3,]= bz + + + + + + ;yyddd + + ;print, label + + ;print, label2 + + ;print, idoc + + ;print, bx + + ;print, dtime + + ;label3=string(label2) + + ;label3=strmid(label3,3,5) + + ;print, label2 + + ;print, label3 + + openw, 2,'/Volumes/physics_data/Ftp/MACCS_DATA/AugASCII/'+label+'/20'+year+'ir/'+label+labelx+'.dat',width=107 + + printf,2,idoc, format = '(12(i8),/,12(i8))' + + printf,2,line3 + + printf,2,newarray,format='(f8.2,3f15.3)' + + close, 2 + + + + print, 'program finished' + + END

Data Collection

maccs — 2007-08-20 19:09:24

Differences for Data Collection

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at :00, :15, :30, :45 of every hour of every day when the maccs user crontab on the yspace server runs the script ["ftpsri.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory. You can view Augsburg's MACCS data from the ftp site ftp://space.augsburg.edu/MACCS_DATA/.	+ At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at :00, :15, :30, :45 of every hour of every day when the maccs user crontab on the yspace server runs the script ["ftpsri.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory. You can view Augsburg's MACCS data from the ftp site ftp://space.augsburg.edu/MACCS_DATA/. After downloading the data, the ["ftpsri.sh"] script creates two formats of ASCII files with the ["IridiumMaccs2.pro"] and ["IridiumMaccs3.pro"] idl programs and it creates line plots of the data with the ["linex7.pro"] idl program.

ftpsri.sh

PhilipNeustrom — 2007-08-15 03:18:03

example of braces - you can put code in braces or upload the file 4 better look

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ {{{
Line 296:	Line 297:
	+ }}}

strip.pro

ArlenAbraham — 2007-08-14 17:24:01

you can put code in these nifty little braces, or you can upload the file

Differences for strip.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ {{{
Line 18:	Line 19:
	+ }}}

ftpsri.sh

maccs — 2007-08-13 21:28:35

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 2:	Line 2:
	+ # Last Modified 8/13/07

ftpsri.sh

maccs — 2007-08-13 21:27:16

Differences for ftpsri.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Written by Erik Johnson July 2007 + # This program is run at :00, :15, :30, :45 of every hour of every day. + # It downloads the latest MACCS raw data files from SRI's ftp site and files them into the MACCS_DATA/Raw/ folder. + + SOURCE='/Volumes/physics_data/Ftp/MACCS_DATA/Raw' + YEAR=`date +%Y` + YY=`date +%y` + DAY=`date +%j` + NDAY=`echo $DAY + 1 \| bc` + PDAY=`echo $DAY - 1 \| bc` + P2DAY=`echo $DAY - 2 \| bc` + P3DAY=`echo $DAY - 3 \| bc` + P4DAY=`echo $DAY - 4 \| bc` + P5DAY=`echo $DAY - 5 \| bc` + P6DAY=`echo $DAY - 6 \| bc` + + #insert the necessary leading zeros for DAY + #if [ $DAY -lt 10 ]; then + # DAY=00$DAY + #elif [ $DAY -lt 100 ]; then + # DAY=0$DAY + #fi + + if [ $NDAY -lt 10 ]; then + NDAY=00$NDAY + elif [ $NDAY -lt 100 ]; then + NDAY=0$NDAY + fi + if [ $PDAY -lt 10 ]; then + PDAY=00$PDAY + elif [ $PDAY -lt 100 ]; then + PDAY=0$PDAY + fi + if [ $P2DAY -lt 10 ]; then + P2DAY=00$P2DAY + elif [ $P2DAY -lt 100 ]; then + P2DAY=0$P2DAY + fi + if [ $P3DAY -lt 10 ]; then + P3DAY=00$P3DAY + elif [ $P3DAY -lt 100 ]; then + P3DAY=0$P3DAY + fi + if [ $P4DAY -lt 10 ]; then + P4DAY=00$P4DAY + elif [ $P4DAY -lt 100 ]; then + P4DAY=0$P4DAY + fi + if [ $P5DAY -lt 10 ]; then + P5DAY=00$P5DAY + elif [ $P5DAY -lt 100 ]; then + P5DAY=0$P5DAY + fi + if [ $P6DAY -lt 10 ]; then + P6DAY=00$P6DAY + elif [ $P6DAY -lt 100 ]; then + P6DAY=0$P6DAY + fi + + ########################################################## + #get the files from SRI if they are different in file size from the ones we have + + cd $SOURCE/CD/${YEAR}ir/ + + #Get the sizes of our files if they exits + if [ -f "CD${YY}${P6DAY}.dat" ]; then + P6DAYSIZE=`stat -f "%z" CD${YY}${P6DAY}.dat` + else + P6DAYSIZE=0 + fi + if [ -f "CD${YY}${P5DAY}.dat" ]; then + P5DAYSIZE=`stat -f "%z" CD${YY}${P5DAY}.dat` + else + P5DAYSIZE=0 + fi + if [ -f "CD${YY}${P4DAY}.dat" ]; then + P4DAYSIZE=`stat -f "%z" CD${YY}${P4DAY}.dat` + else + P4DAYSIZE=0 + fi + if [ -f "CD${YY}${P3DAY}.dat" ]; then + P3DAYSIZE=`stat -f "%z" CD${YY}${P3DAY}.dat` + else + P3DAYSIZE=0 + fi + if [ -f "CD${YY}${P2DAY}.dat" ]; then + P2DAYSIZE=`stat -f "%z" CD${YY}${P2DAY}.dat` + else + P2DAYSIZE=0 + fi + if [ -f "CD${YY}${PDAY}.dat" ]; then + PDAYSIZE=`stat -f "%z" CD${YY}${PDAY}.dat` + else + PDAYSIZE=0 + fi + + if [ "$P6DAYSIZE" != 3283200 ]; then + echo CD P6DAY file is incomplete or missing, downloading P6DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P6DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P5DAYSIZE" != 3283200 ]; then + echo CD P5DAY file is incomplete or missing, downloading P5DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P5DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P4DAYSIZE" != 3283200 ]; then + echo CD P4DAY file is incomplete or missing, downloading P4DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P4DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P3DAYSIZE" != 3283200 ]; then + echo CD P3DAY file is incomplete or missing, downloading P3DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P3DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P2DAYSIZE" != 3283200 ]; then + echo CD P2DAY file is incomplete or missing, downloading P2DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P2DAY}.dat + bye + END_SCRIPT + fi + + if [ "$PDAYSIZE" != 3283200 ]; then + echo CD PDAY file is incomplete or missing, downloading PDAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${PDAY}.dat + bye + END_SCRIPT + fi + + echo Downloading data files from today + + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + + epsv4 + cd pub/maccs/CD/magnetometer/ + + get CD${YY}${DAY}.dat + get CD${YY}${NDAY}.dat + + lcd $SOURCE/NA/${YEAR}ir/ + cd ../../NA/magnetometer/ + get NA${YY}${DAY}.dat + get NA${YY}${NDAY}.dat + + bye + END_SCRIPT + + cd $SOURCE/NA/${YEAR}ir/ + + #Get the sizes of our NA files if they exits + if [ -f "NA${YY}${P6DAY}.dat" ]; then + P6DAYSIZE=`stat -f "%z" NA${YY}${P6DAY}.dat` + else + P6DAYSIZE=0 + fi + if [ -f "NA${YY}${P5DAY}.dat" ]; then + P5DAYSIZE=`stat -f "%z" NA${YY}${P5DAY}.dat` + else + P5DAYSIZE=0 + fi + if [ -f "NA${YY}${P4DAY}.dat" ]; then + P4DAYSIZE=`stat -f "%z" NA${YY}${P4DAY}.dat` + else + P4DAYSIZE=0 + fi + if [ -f "NA${YY}${P3DAY}.dat" ]; then + P3DAYSIZE=`stat -f "%z" NA${YY}${P3DAY}.dat` + else + P3DAYSIZE=0 + fi + if [ -f "NA${YY}${P2DAY}.dat" ]; then + P2DAYSIZE=`stat -f "%z" NA${YY}${P2DAY}.dat` + else + P2DAYSIZE=0 + fi + if [ -f "NA${YY}${PDAY}.dat" ]; then + PDAYSIZE=`stat -f "%z" NA${YY}${PDAY}.dat` + else + PDAYSIZE=0 + fi + + #Download data from each of the previous 6 days if our data for that day is incomplete or missing + if [ "$P6DAYSIZE" != 3283200 ]; then + echo NA P6DAY file is incomplete or missing, downloading P6DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${P6DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P5DAYSIZE" != 3283200 ]; then + echo NA P5DAY file is incomplete or missing, downloading P5DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${P5DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P4DAYSIZE" != 3283200 ]; then + echo NA P4DAY file is incomplete or missing, downloading P4DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${P4DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P3DAYSIZE" != 3283200 ]; then + echo NA P3DAY file is incomplete or missing, downloading P3DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${P3DAY}.dat + bye + END_SCRIPT + fi + + if [ "$P2DAYSIZE" != 3283200 ]; then + echo NA P2DAY file is incomplete or missing, downloading P2DAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${P2DAY}.dat + bye + END_SCRIPT + fi + + if [ "$PDAYSIZE" != 3283200 ]; then + echo NA PDAY file is incomplete or missing, downloading PDAY file + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + epsv4 + cd pub/maccs/NA/magnetometer/ + get NA${YY}${PDAY}.dat + bye + END_SCRIPT + fi

Data Collection

maccs — 2007-08-13 21:24:59

Differences for Data Collection

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at 19:35 CDT every day when the maccs user crontab on yspace runs the script ["sridaily.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory. You can view Augsburg's MACCS data from the ftp site ftp://space.augsburg.edu/MACCS_DATA/.	+ At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at :00, :15, :30, :45 of every hour of every day when the maccs user crontab on the yspace server runs the script ["ftpsri.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory. You can view Augsburg's MACCS data from the ftp site ftp://space.augsburg.edu/MACCS_DATA/.

Data Collection

maccs — 2007-08-06 20:49:42

Differences for Data Collection

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at 19:35 CDT every day when the maccs user crontab on yspace runs the script ["sridaily.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory.	+ At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at 19:35 CDT every day when the maccs user crontab on yspace runs the script ["sridaily.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory. You can view Augsburg's MACCS data from the ftp site ftp://space.augsburg.edu/MACCS_DATA/.

Processing Software

maccs — 2007-08-06 20:40:44

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 7:	Line 7:
- ["igloolik_despike.pro"]	+ ["igloolik despike.pro" igloolik_despike.pro]

Processing Software

maccs — 2007-08-06 20:40:17

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 9:	Line 9:
- ["write_maccs.pro"] (called by igllolik_despike.pro)	+ ["write maccs.pro" write_maccs.pro] (called by igllolik_despike.pro)
Line 11:	Line 11:
- ["step_view.pro"] - ["step_wid.pro"]	+ ["step view.pro" step_view.pro] + ["step wid.pro" step_wid.pro]
Line 15:	Line 15:
- ["five_sec_avg.pro"] - ["five_sec_avg_fast_avg.pro"] (called by five_sec_avg.pro) - ["read_maccs.pro"] (called by five_sec_avg.pro) - ["write_maccs.pro"] (called by five_sec_avg.pro)	+ ["five sec avg.pro" five_sec_avg.pro] + ["five sec avg fast avg.pro" five_sec_avg_fast_avg.pro] (called by five_sec_avg.pro) + ["read maccs.pro" read_maccs.pro] (called by five_sec_avg.pro) + ["write maccs.pro" write_maccs.pro] (called by five_sec_avg.pro)
Line 20:	Line 20:
- ["sec_to_min.pro"] - ["read_maccs.pro"] (called by sec_to_min.pro) - ["write_maccs.pro"] (called by sec_to_min.pro)	+ ["sec to min.pro" sec_to_min.pro] + ["read maccs.pro" read_maccs.pro] (called by sec_to_min.pro) + ["write maccs.pro" write_maccs.pro] (called by sec_to_min.pro)
Line 25:	Line 25:
- ["merge_files.pro"]	+ ["merge files.pro" merge_files.pro]
Line 33:	Line 33:
- ["hour_read.pro"]	+ ["hour read.pro" hour_read.pro]
Line 35:	Line 35:
- ["wid_draw.pro"]	+ ["wid draw.pro" wid_draw.pro]

Processing Software

maccs — 2007-08-06 20:37:13

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 8:	Line 8:
- ["read_maccs.pro" read maccs.pro] (called by igllolik_despike.pro)	+ ["read maccs.pro" read_maccs.pro] (called by igllolik_despike.pro)

Processing Software

maccs — 2007-08-06 20:36:50

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 8:	Line 8:
- ["read_maccs.pro"] (called by igllolik_despike.pro)	+ ["read_maccs.pro" read maccs.pro] (called by igllolik_despike.pro)

sridaily.sh

maccs — 2007-08-06 20:33:34

Differences for sridaily.sh

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ # Written by Erik Johnson July 2007 + # This program is run at 19:35 every day. + # It downloads the latest MACCS raw data files from SRI's ftp site and files them into the MACCS_DATA/Raw/ folder. + + SOURCE='/Volumes/physics_data/Ftp/MACCS_DATA/Raw' + YEAR=`date +%Y` + YY=`date +%y` + DAY=`date +%j` + NDAY=`echo $DAY + 1 \| bc` + PDAY=`echo $DAY - 1 \| bc` + P2DAY=`echo $DAY - 2 \| bc` + + #insert the necessary leading zeros for DAY + #if [ $DAY -lt 10 ]; then + # DAY=00$DAY + #elif [ $DAY -lt 100 ]; then + # DAY=0$DAY + #fi + + if [ $NDAY -lt 10 ]; then + NDAY=00$NDAY + elif [ $NDAY -lt 100 ]; then + NDAY=0$NDAY + fi + if [ $PDAY -lt 10 ]; then + PDAY=00$PDAY + elif [ $PDAY -lt 100 ]; then + PDAY=0$PDAY + fi + if [ $P2DAY -lt 10 ]; then + P2DAY=00$P2DAY + elif [ $P2DAY -lt 100 ]; then + P2DAY=0$P2DAY + fi + + ########################################################## + #get the files from SRI + cd $SOURCE/CD/${YEAR}ir/ + + ftp -n << END_SCRIPT + open 128.18.144.24 + user anonymous teakjohnson@embarqmail.com + + epsv4 + cd pub/maccs/CD/magnetometer/ + get CD${YY}${P2DAY}.dat + get CD${YY}${PDAY}.dat + get CD${YY}${DAY}.dat + get CD${YY}${NDAY}.dat + + lcd $SOURCE/NA/${YEAR}ir/ + cd ../../NA/magnetometer + get NA${YY}${P2DAY}.dat + get NA${YY}${PDAY}.dat + get NA${YY}${DAY}.dat + get NA${YY}${NDAY}.dat + + bye + END_SCRIPT

Data Collection

maccs — 2007-08-06 20:29:56

Differences for Data Collection

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ At Augsburg College the new MACCS iridium data is downloaded from SRI's ftp site at 19:35 CDT every day when the maccs user crontab on yspace runs the script ["sridaily.sh"] which is located in the /Volumes/physics_data/Code/MACCS_Code/ directory. The new data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/{site abbreviation}/{year}ir/ folders. For example, the 2007 Cape Dorest iridium data is saved in the /Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/ directory.

People

maccs — 2007-08-06 20:08:58

Differences for People

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ Erik Johnson + Student Employee at Augsburg College + teakjohnson@embarqmail.com + (763) 498-1880

Realtime Plots

maccs — 2007-07-26 20:55:30

Differences for Realtime Plots

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- [http://engineering.dartmouth.edu/~david_murr/mic/nain_current.png]	+ [http://northstar-www.dartmouth.edu/~dmurr/maccs/NA.png]

wid draw.pro

maccs — 2007-07-25 21:46:43

Differences for wid draw.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ PRO wid_draw_event, ev + + WIDGET_CONTROL, ev.top, GET_UVALUE = ev_var + + WIDGET_CONTROL, ev.id, GET_UVALUE = uval + + CASE uval OF + + 'DRAW' : begin + IF ((ev_var).mouse((ev_var).component) eq 0 AND ev.type eq 0) THEN BEGIN ;If draw lines is selected this loop begins + n = (ev_var).n + 1 ;which takes the coordinates of your mouse location and + (ev_var).n = n ;takes the coordinates of where you LAST clicked, + (ev_var).x(0) = 0 ;and draws a line connecting the two points + location = convert_coord(ev.x, ev.y, /device, /to_data) + (ev_var).x(n) = location(0) + (ev_var).y(n) = location(1) + IF ((ev_var).x(n) gt 365) THEN BEGIN + (ev_var).x(n) = 365. + (ev_var).y(n) = (ev_var).y(n-1) + ENDIF + PLOTS,[(ev_var).x(n-1),(ev_var).x(n)],[(ev_var).y(n-1), (ev_var).y(n)], COLOR = 25 + delx = (ev_var).x(n) - (ev_var).x(n-1) ;The slope and y-intercept of the drawn line is found and every day + dely = (ev_var).y(n) - (ev_var).y(n-1) ;that is in between the endpoints of the line + m = dely / delx ;is assigned the line's slope and y-intercept + b = (ev_var).y(n) - (m * (ev_var).x(n)) + FOR i = FLOOR((ev_var).x(n-1)) + 1, FLOOR((ev_var).x(n)) DO BEGIN + (ev_var).slope[i] = m + (ev_var).yintercept[i] = b + ENDFOR + print, 'Size of ' + help, (ev_var).y_val_all3 + FOR j = 1, 365 DO BEGIN ;From the slope and y-intercept of everyday + (ev_var).y_val_all3[j,(ev_var).component] = j * (ev_var).slope[j]$ ;a yvalue is found for that day and stored in + + (ev_var).yintercept[j] ;the state pointer array y_val_all3 (capable of storing + ENDFOR + PRINT, (ev_var).y_val_all3[365,0] + Print, (ev_var).y_val_all3[365,1] + Print, (ev_var).y_val_all3[365,2] ;yvalues for every day for each component of a station) + ENDIF + + IF ((ev_var).mouse((ev_var).component) eq 1) THEN BEGIN ;if fix lines is selected: when the mouse is + ;DEPRESSED, a state pointer variable called 'motion' + IF (ev.type eq 0) THEN BEGIN ;is set to 1, a counter state pointer variable, m, which counts + (ev_var).motion = 1 ;motion events is reset to zero, and two state pointer arrays which + (ev_var).m = 0 ;contain the x and y data coordinates of where the + FOR i = 0, 99 DO BEGIN ;mouse is generating motion events, are reset to zero + (ev_var).x2(i) = 0 + (ev_var).y2(i) = 0 + ENDFOR + ENDIF + + IF (ev.type eq 1) THEN (ev_var).motion = 0 ;when the mouse button is RELEASED, the state + ;pointer variable 'motion' set back to zero + IF ((ev_var).motion eq 1 AND ev.type eq 2) THEN BEGIN ;this if-loop thus implies that + m = (ev_var).m + 1 ;if the mouse button is being + (ev_var).m = m ;held down and motion is occurring + local = convert_coord(ev.x, ev.y, /device, /to_data) ;then with each different pixel + (ev_var).x2(m) = local(0) ;location the device coordinates + (ev_var).y2(m) = local(1) ;will be converted to data coordinates + IF ((ev_var).x2(m) lt 0 AND (ev_var).x2(m) gt -.5) THEN BEGIN + (ev_var).y_val_all3[0,(ev_var).component] = (ev_var).y2(m) + PLOT_IT, ev_var + ENDIF ELSE BEGIN + IF (ABS(((ev_var).x2(m) MOD 1)-((ev_var).x2(m-1) MOD 1)) ge .5) THEN BEGIN + day = FLOOR((ev_var).x2(m) + .5) ;this embedded if loop finds when an + (ev_var).y_val_all3[day,(ev_var).component] = (ev_var).y2(m) ;integer day is passed and changes the + (ev_var).y_val_all3[day,(ev_var).component] = (ev_var).y2(m) ;yvalue at that day to the converted + PLOT_IT, ev_var ;device y-coordinate of where the motion + ENDIF ;event occurred. + ENDELSE + ENDIF + ENDIF ;The data and yvalues are then replotted + end ;with this new yvalue using the procedure PLOT_IT + ;so that AS the user creates motion events with the + 'DONE' : WIDGET_CONTROL, ev.top, /DESTROY ;this button exits the program ;mouse button pressed, these new yvalues + ;are constantly integrated into the graph that the + 'FILE' : GET_THE_FILE, ev_var ;Calls procedure GET_THE_FILE which gets the file ;user is looking at + + 'REPLOT': begin + ; basex = [ 9450, 6150, 0, 6900, 4240, 6050, 4220, 3870, 0, 2850, 0, 0 ] ;The REPLOT button finds the rotation angles necessary and fixes + basex = [ 9450, 6150, 0, 6900, 4240, 7280, 4220, 3870, 0, 2850, 0, 0 ] ;The REPLOT button finds the rotation angles necessary and fixes + + index = where ((ev_var).y_val_all3(,) eq 0) ;the baseline that the user drew which is represented by the yvalues + PRINT, 'REPLOT ',index(0) + help, index + IF (index(0) eq -1) THEN BEGIN + FOR j = 0, 365 DO BEGIN + alpha = atan((ev_var).y_val_all3[j,1],(ev_var).y_val_all3[j,2]) ;these are the functions for finding + zvalp = ((ev_var).y_val_all3[j,1] (sin(alpha)) + ((ev_var).y_val_all3[j,2] cos(alpha))) ;the rotation angles + beta = FindBeta(zvalp, basex[(ev_var).basex_index], (ev_var).y_val_all3[j,0]) + s = MAX([0,j24-11]) ;the MAX and MIN functions ensure that negative + e = MIN([36524,j24+12]) ;subscripts and subscripts greater than 365 are not accessed + FOR x = 0, 2 DO (ev_var).yval_hours(x,s:e) = (ev_var).y_val_all3[j,x] + (ev_var).lalpha(s:e) = LONG(alpha * 10000.0) + (ev_var).lbeta(s:e) = LONG(beta 10000.0) + (ev_var).lx_yval(s:e) = LONG((ev_var).y_val_all3(j,0) * 10000.0) + (ev_var).ly_yval(s:e) = LONG((ev_var).y_val_all3(j,1) * 10000.0) + (ev_var).lz_yval(s:e) = LONG((ev_var).y_val_all3(j,2) * 10000.0) + index0 = where((ev_var).data(0,s:e) eq 32767) + index1 = where((ev_var).data(1,s:e) eq 32767) + index2 = where((ev_var).data(2,s:e) eq 32767) + pre_z = ((ev_var).data(2,s:e) * cos(alpha)) + ((ev_var).data(1,s:e) sin(alpha)) ;these statements assign the corrected, + (ev_var).data(1,s:e) = ((ev_var).data(1,s:e) * cos(alpha)) - ((ev_var).data(2,s:e) sin(alpha)) ;rotated yvalues to the data array, + (ev_var).data(0,s:e) = ((ev_var).data(0,s:e) * cos(beta)) + (pre_z * sin(beta)) ;replacing the actual data + (ev_var).data(2,s:e) = (pre_z cos(beta)) - ((ev_var).data(0,s:e) sin(beta)) + IF (index0(0) ne -1) THEN (ev_var).data(0,index0+s) = 32767 + IF (index1(0) ne -1) THEN (ev_var).data(1,index1+s) = 32767 + IF (index2(0) ne -1) THEN (ev_var).data(2,index2+s) = 32767 + ENDFOR + WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 0 + (ev_var).mouse() = 2 + ENDIF ELSE BEGIN + errmess = DIALOG_MESSAGE(['In order to proceed with rotation corrections, the x, y, AND z components must have baseline values.',$ + 'The year and station that you have selected do not have complete baselines for all three coordinates.'],$ + /ERROR, DIALOG_PARENT = draw) ;this error message box appears if the user tries to replot without + (ev_var).disp_err = errmess ;having created baselines for all three coordinate axis + ENDELSE + + PLOT_IT, ev_var + end + + 'PRINT': begin + Months = ['jan','feb','mar','apr','may','jun','jul','aug','sep','oct','nov','dec'] + Days_in_month = [0, 31, 28, 31, 30, 31, 30, 31, 31, 30, 31, 30, 31 ] + IF ((ev_var).year MOD 4 eq 0) THEN Days_in_month(2) = 29 + basex = [ 9450, 6150, 0, 6900, 4240, 6050, 4220, 3870, 0, 2850, 0, 0 ] + FOR month = 0, 11 DO BEGIN + s = total(Days_in_month(0:month)) * 24 + e = total(Days_in_month(0:month+1)) * 24 - 1 + ;openw, x,"/magneto3/maccs/maccsidl/sarah13/" + $ + openw, x,"/raid/2004/rotated/cor/" + $ + STRUPCASE((ev_var).station) + $ + strmid((ev_var).year,2,2) + $ + Months(month) + '.cor', /get_lun + FOR hour = s, e DO BEGIN + writeu,x,long(basex[(ev_var).basex_index]10000.), $ + long((ev_var).yval_hours(0,hour)10000.), $ + long((ev_var).yval_hours(1,hour)10000.), $ + long((ev_var).yval_hours(2,hour)10000.), $ + long((ev_var).lalpha(hour)), $ + long((ev_var).lbeta(hour)) + + ; print,hour,long(basex[(ev_var).basex_index]10000.), $ + ; long((ev_var).yval_hours(0,hour)10000.), $ + ; long((ev_var).yval_hours(1,hour)10000.), $ + ; long((ev_var).yval_hours(2,hour)10000.), $ + ; long((ev_var).lalpha(hour)), $ + ; long((ev_var).lbeta(hour)) + ENDFOR + close, x + free_lun, x + ENDFOR + + PLOT_IT, ev_var + end + + 'SLIDER1': begin + (ev_var).start_day = ev.value + PLOT_IT, ev_var + end + + 'SLIDER2': begin + (ev_var).stop_day = ev.value + PLOT_IT, ev_var + end + + 'MOUSE_SELECT': begin + print, (ev_var).mouse() + (ev_var).mouse((ev_var).component) = ev.value + print, (ev_var).mouse() + IF ((ev_var).mouse((ev_var).component) eq 1) THEN BEGIN + errmessage = DIALOG_MESSAGE('You cannot draw'$ + +'anymore lines' $ + +'once you have started fixing them!'$ + +'Are you sure you are done drawing lines?', TITLE = 'CAUTION!',$ + DIALOG_PARENT = draw, /QUESTION) + (ev_var).disp_err = errmessage + IF (errmessage eq 'No') THEN BEGIN + (ev_var).mouse((ev_var).component) = 0 + WIDGET_CONTROL, (ev_var).mouse_select_ID, SET_VALUE = 0 + ENDIF + IF (errmessage eq 'Yes') THEN BEGIN + (ev_var).mouse((ev_var).component) = 1 + PLOT_IT, ev_var + ENDIF + ENDIF + end + + 'STATION': begin + (ev_var).basex_index = ev.index + abbrev = ['pg','cy','iq','cd','ig','ch','rb','pb','bl','gh','cb','re'] + (ev_var).station = abbrev(ev.index) + end + + 'YEAR': begin + years = ['1997', '1998', '1999', '2000', '2001', '2002', '2003', '2004','2005','2006','2007'] + (ev_var).year = years(ev.index) + end + + 'COMPONENT': begin + (ev_var).component = ev.value + IF ((ev_var).y_val_all3(360,(ev_var).component) ne 0) THEN BEGIN + PLOT_IT, ev_var + IF ((ev_var).mouse((ev_var).component) eq 0) THEN WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 13, SET_VALUE = 0 + IF ((ev_var).mouse((ev_var).component) eq 1 OR (ev_var).component eq 2) THEN WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 0 + ENDIF ELSE BEGIN + (ev_var).n = 0 + FOR p = 0, 99 DO (ev_var).x(p) = 0 + FOR m = 0, 99 DO (ev_var).y(m) = 0 + FOR r = 0, 365 DO (ev_var).slope(r) = 0 + FOR l = 0, 365 DO (ev_var).yintercept(l) = 0 + PLOT_IT, ev_var + index = where((ev_var).data((ev_var).component,) ne 32767) + (ev_var).y(0) = (ev_var).data((ev_var).component,index(0)) + (ev_var).y_val_all3(0,(ev_var).component) = (ev_var).data((ev_var).component,index(0)) + WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 13, SET_VALUE = 0 + (ev_var).mouse((ev_var).component) = 0 + ENDELSE + end + + 'RANGE': begin + (ev_var).range = ev.value + t = findgen(8760) + s = (ev_var).start_day 24 + e = (ev_var).stop_day 24 - 1 + index = where ((ev_var).data((ev_var).component,s:e) ne 32767) + (ev_var).ave_val = MEDIAN((ev_var).data((ev_var).component,index+s)) + PLOT, t(s:e)/24, FLAG((ev_var).data((ev_var).component,s:e)),$ + MAX_VAL = 100000, YSTYLE = 1,$ + YRANGE = [(ev_var).ave_val-(ev_var).range, (ev_var).ave_val+(ev_var).range],$ + XRANGE = [(ev_var).start_day, (ev_var).stop_day], XSTYLE = 1 + OPLOT, findgen(366), (ev_var).y_val_all3(0:365,(ev_var).component), PSYM = -5, COLOR = 25 + end + + ENDCASE + + END + + + + PRO wid_draw + + LOADCT, 12 + + base = WIDGET_BASE(xoffset = 100) + + draw = WIDGET_DRAW(base, XOFFSET = 0, YOFFSET = 130, XSIZE = 800, YSIZE = 500,$ + UVALUE = 'DRAW', /BUTTON_EVENTS, /MOTION_EVENTS) + + button = WIDGET_BUTTON(base, value = 'Done', uvalue = 'DONE',$ + scr_xsize = 100, XOFFSET = 442, YOFFSET = 92) + + file_button = WIDGET_BUTTON(base, value = 'Get file', uvalue = 'FILE',$ + scr_xsize = 100, scr_ysize = 38, XOFFSET = 180, YOFFSET = 53) + + replot_button = WIDGET_BUTTON(base, value = 'Replot', uvalue = 'REPLOT',$ + scr_xsize = 100, XOFFSET = 442, YOFFSET = 15) + + print_button = WIDGET_BUTTON(base, value = 'Creat File', uvalue = 'PRINT',$ + scr_xsize = 100, XOFFSET = 442, YOFFSET = 53) + + slider1 = WIDGET_SLIDER(base, value = 0, title = 'Start day',$ + uvalue = 'SLIDER1', XOFFSET = 565, YOFFSET = 65, maximum = 365,$ + scr_xsize = 100) + + slider2 = WIDGET_SLIDER(base, value = 365, title = 'Stop day',$ + uvalue = 'SLIDER2', XOFFSET = 685, YOFFSET = 65, maximum = 365,$ + scr_xsize = 100) + + mouse_select_ID = CW_BGROUP(base, ['draw lines', 'fix lines'], SET_VALUE = 0,$ + XOFFSET = 45, YOFFSET = 93, UVALUE = 'MOUSE_SELECT', /ROW,$ + /EXCLUSIVE) + + station = WIDGET_DROPLIST(base, FRAME = 5, TITLE = 'MACCS Stations',$ + UVALUE = 'STATION', VALUE = ['Pangnirtung', 'Clyde River', 'Iqaluit',$ + 'Cape Dorset', 'Igloolik', 'Coral Harbour', 'Repulse Bay', 'Pelly Bay',$ + 'Baker Lake', 'Gjoa Haven', 'Cambridge Bay', 'Resolute Bay', 'Nain'],$ + scr_xsize = 100, XOFFSET = 15, YOFFSET = 10) + + year_select = WIDGET_DROPLIST(base, FRAME = 5, TITLE = 'Select Year',$ + UVALUE = 'YEAR', VALUE = ['1997', '1998', '1999', '2000', '2001', '2002', '2003', '2004','2005','2006','2007'],$ + scr_xsize = 100, XOFFSET = 15, YOFFSET = 50) + + component_select = CW_BGROUP(base, ['x component', 'y component', 'z component'],$ + SET_VALUE = 0, UVALUE = 'COMPONENT', XOFFSET = 295, YOFFSET = 15,$ + /COLUMN, /EXCLUSIVE, /NO_RELEASE) + + y_range = WIDGET_SLIDER(base, value = 0, TITLE = 'y range(+/-)', UVALUE='RANGE',$ + maximum = 1000, XOFFSET = 625, YOFFSET = 10, scr_xsize = 100) + + + + ev_var = ptr_new({n:0,x:fltarr(100),y:fltarr(100),$ + slope: fltarr(366),$ + yintercept: fltarr(366),$ + start_day: 0.,$ + stop_day: 365.,$ + data: fltarr(3,24366),$ + station: 'Pangnirtung',$ + basex_index: 0,$ + year: '2001',$ + component: 0.,$ + mouse_select_ID: mouse_select_ID,$ + mouse: intarr(3),$ + hour: 0.,$ + day: 0.,$ + range: 0.,$ + ave_val: 0.,$ + disp_err: " ",$ + motion: 0,$ + lx_yval: fltarr(24366),$ + ly_yval: fltarr(24366),$ + lz_yval: fltarr(24366),$ + lalpha: fltarr(24366),$ + lbeta: fltarr(24366),$ + yval_hours: fltarr(3,24366),$ + y_val_all3: fltarr(366,3),$ + m:0, x2:fltarr(1000), y2:fltarr(1000)}) + + WIDGET_CONTROL, base, SET_UVALUE = ev_var + + WIDGET_CONTROL, /REALIZE, base + + WIDGET_CONTROL, draw, GET_VALUE = index + + WSET, index + + + XMANAGER, 'Wid_draw', base + + ptr_free, ev_var + + END + + + + PRO PLOT_IT, ev_var + t = findgen(8760) + s = (ev_var).start_day 24 + e = (ev_var).stop_day 24 - 1 + IF (s GE e) THEN print, 'Invalid start and end day' ELSE BEGIN + index = where ((ev_var).data((ev_var).component,s:e) ne 32767) + IF (index(0) ne -1) THEN BEGIN + IF ((ev_var).range eq 0) THEN BEGIN + PLOT, t(s:e)/24, FLAG((ev_var).data((ev_var).component,s:e)),$ + MAX_VAL = 100000, /YSTYLE,$ + XRANGE = [(ev_var).start_day, (ev_var).stop_day], XSTYLE = 1 + OPLOT, findgen(366), (ev_var).y_val_all3(0:365,(ev_var).component), PSYM = -5, COLOR = 25 + ENDIF ELSE BEGIN + (ev_var).ave_val = MEDIAN((ev_var).data((ev_var).component,index+s)) + PLOT, t(s:e)/24, FLAG((ev_var).data((ev_var).component, s:e)),$ + MAX_VAL = 100000, YSTYLE = 1,$ + XRANGE = [(ev_var).start_day, (ev_var).stop_day], XSTYLE = 1,$ + YRANGE = [(ev_var).ave_val-(ev_var).range, (ev_var).ave_val+(ev_var).range] + OPLOT, findgen(366), (ev_var).y_val_all3(0:365,(ev_var).component), PSYM = -5, COLOR = 25 + ENDELSE + ENDIF ELSE BEGIN + print, 'No data in range: ', 'Day ', BYTE((ev_var).start_day),$ + ' to Day ', BYTE((ev_var).stop_day) + ENDELSE + ENDELSE + IF ((ev_var).mouse((ev_var).component) eq 1) THEN WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 0 + END + + + + PRO GET_THE_FILE, ev_var + (ev_var).n = 0 + (ev_var).x() = 0 + (ev_var).y() = 0 + (ev_var).slope() = 0 + (ev_var).yintercept() = 0 + (ev_var).y_val_all3(,) = 0 + (ev_var).data(,) = 0 + (ev_var).lx_yval() = 0 + (ev_var).ly_yval() = 0 + (ev_var).lz_yval() = 0 + (ev_var).lalpha() = 0 + (ev_var).lbeta() = 0 + IF ((ev_var).station eq 'Pangnirtung') THEN (ev_var).station = 'pg' + hour_read, code = STRUPCASE((ev_var).station), year = (ev_var).year, temp_data + (ev_var).data=temp_data + t = findgen(8760) + s = (ev_var).start_day * 24 + e = (ev_var).stop_day 24 - 1 + i = where ((ev_var).data((ev_var).component,s:e) ne 32767) + IF (i(0) eq -1) THEN BEGIN + errmessage = DIALOG_MESSAGE(['There is no data for this station in the year you selected.',$ + 'Please select a different file.'], DIALOG_PARENT = DRAW, /ERROR) + (ev_var).disp_err = errmessage + ENDIF ELSE BEGIN + (ev_var).ave_val = MEDIAN((ev_var).data((ev_var).component,i+s)) + IF ((ev_var).range eq 0) THEN BEGIN + PLOT, t((ev_var).start_day * 24:(ev_var).stop_day 24 - 1)/24,$ + FLAG((ev_var).data((ev_var).component,)), MAX_VAL=100000, /YSTYLE,$ + XRANGE = [(ev_var).start_day, (ev_var).stop_day], XSTYLE = 1 + PLOTS, t(0)/365., FLAG((ev_var).data((ev_var).component,0)) + ENDIF ELSE BEGIN + PLOT, t((ev_var).start_day * 24:(ev_var).stop_day 24 - 1)/24,$ + FLAG((ev_var).data((ev_var).component,)), MAX_VAL=100000, YSTYLE = 1,$ + XRANGE = [(ev_var).start_day, (ev_var).stop_day], XSTYLE = 1,$ + YRANGE = [(ev_var).ave_val-(ev_var).range, (ev_var).ave_val+(ev_var).range] + PLOTS, t(0)/365., FLAG((ev_var).data((ev_var).component,0)) + ENDELSE + ENDELSE + index = where((ev_var).data((ev_var).component,) ne 32767) + (ev_var).y(0) = (ev_var).data((ev_var).component,index(0)) + (ev_var).y_val_all3(0,(ev_var).component) = (ev_var).data((ev_var).component,index(0)) + WIDGET_CONTROL, (ev_var).mouse_select_ID, SENSITIVE = 13, SET_VALUE = 0 + (*ev_var).mouse = 0 + + END

hour read.pro

maccs — 2007-07-25 21:46:07

Differences for hour read.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ Pro hour_read, code=code, year=year, month=month, length=length, data + + if not keyword_set(month) then month=1 + month = month - 1 + if not keyword_set(length) then length=12 + length = length - 1 + + path='/magneto3/maccs/murr/hour/' + path='/atmos5/2000/hour/' + path='/raid/2004/unrotated/hour/' + months = ['jan','feb','mar','apr','may','jun','jul','aug','sep','oct','nov','dec'] + days = [31,28,31,30,31,30,31,31,30,31,30,31] + if year mod 4 eq 0 then days(1)=days(1)+1 + hours = days24. + total_hours = total(hours(month:month+length)) + + data = fltarr(3,total_hours) + + j=0 + for i = 0,length do begin + filename = path+code+strmid(strip(year), 2,2)+months(i+month)+'.1h' + openr,file,filename,/get_lun,error=err + if err ne 0 then begin + print,'Error in '+filename+' '+!err_string + data(,j:j+hours(i+month)-1)=32767 + j = j + hours(i+month) + endif else begin + print,'Processing '+filename + temp_data = bytarr(12hours(i+month)) + readu,file,temp_data + for k = 0,hours(i+month)-1 do begin + data(0,j) = (long(temp_data(12k:12k+11),0)) / 1000. + data(1,j) = (long(temp_data(12k:12k+11),4)) / 1000. + data(2,j) = (long(temp_data(12k:12*k+11),8)) / 1000. + j=j+1 + endfor + close,file + free_lun,file + endelse + endfor + + + end

findbeta.pro

maccs — 2007-07-25 21:45:28

Differences for findbeta.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ Function FindBeta, zprime, xnaught, xp + + ;This function uses 1-stage iteration to find the sensor rotation angle + ;BETA, a rotation about the BH axis + + beta1=(xnaught-xp)/zprime + beta=(xnaught-(xp*cos(beta1)))/zprime + + return,beta + + end

houravrg.pro

maccs — 2007-07-25 21:43:55

Differences for houravrg.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ;Program to make 1-hour averaged files from 1-minute averaged monthly + + ;files and to plot them in 1 or 6 month format + + + + Pro houravrg, wdin=wdin, wdout=wdout, code=code, yr=yr + + + + + + ;cd,wdin + + + + ;print,'ls '+code+''+yr+'.1m' + + ;spawn,'ls '+code+''+yr+'[a-z].1m',fnames + + search = FILEPATH(code+''+yr+'.1m', ROOT_DIR = wdin) + + print, search + + fnames = findfile(search) ;,count=num_raw) + + fnames = file_basename(fnames) + + + + print,fnames + + numfiles=n_elements(fnames) + + code=strarr(numfiles) + + year=code + + month=code + + + + for i = 0L,numfiles-1 do begin + + code(i) = strmid(fnames(i),0,2) + + year(i) = strmid(fnames(i),2,2) + + month(i) = strmid(fnames(i),4,3) + + endfor + + + + hor = '.1h' + + + + for j = 0L,numfiles-1 do begin + + + + name = fnames(j) + + print,'Now processing file '+name+'....' + + + + if month(j) eq 'jan' then begin + + njours = 31.0 + + endif + + if month(j) eq 'feb' then begin + + if (year(j) eq 92) or (year(j) eq 96) or (year(j) eq 00) then begin + + njours = 29.0 + + endif else begin + + njours = 28.0 + + endelse + + endif + + if month(j) eq 'mar' then begin + + njours = 31.0 + + endif + + if month(j) eq 'apr' then begin + + njours = 30.0 + + endif + + if month(j) eq 'may' then begin + + njours = 31.0 + + endif + + if month(j) eq 'jun' then begin + + njours = 30.0 + + endif + + if month(j) eq 'jul' then begin + + njours = 31.0 + + endif + + if month(j) eq 'aug' then begin + + njours = 31.0 + + endif + + if month(j) eq 'sep' then begin + + njours = 30.0 + + endif + + if month(j) eq 'oct' then begin + + njours = 31.0 + + endif + + if month(j) eq 'nov' then begin + + njours = 30.0 + + endif + + if month(j) eq 'dec' then begin + + njours = 31.0 + + endif + + name=FILEPATH(name, ROOT_DIR = wdin) + + openr,file,name,/get_lun + + + + scale = 1000.0 + + print,'Reading all data into component arrays....' + + len = 20160.0 * njours + + data = bytarr(len) + + numrecords = 1440.0 * njours + + x = fltarr(numrecords) + + y = x + + z = x + + buf = bytarr(numrecords) + + + + readu,file,data + + + + for k = 0L,numrecords-1 do begin + + ind1 = 14 * k + + ind2 = ind1 + 13 + + buf = data(ind1:ind2) + + x(k) = (long(buf,2)) / scale + + y(k) = (long(buf,6)) / scale + + z(k) = (long(buf,10)) / scale + + endfor + + + + close,file + + free_lun,file + + + + print,'Averaging data....' + + xhrav = fltarr(njours24) + + yhrav = xhrav + + zhrav = xhrav + + hrnum = findgen((njours24) + 1) + + newfile = wdout+code(j)+year(j)+month(j)+hor + + + + ; cd,wd + + + + openw,nfile,newfile,/get_lun + + + + for p = 0L,numrecords-1,60 do begin + + divisx = 0 + + divisy = 0 + + divisz = 0 + + subx = 0 + + suby = 0 + + subz = 0 + + for q = 0L,59 do begin + + if x(p+q) eq 32767.0 then begin + + divisx = divisx + + subx = subx + + endif else begin + + divisx = divisx + 1 + + subx = subx + x(p+q) + + endelse + + if y(p+q) eq 32767.0 then begin + + divisy = divisy + + suby = suby + + endif else begin + + divisy = divisy + 1 + + suby = suby + y(p+q) + + endelse + + if z(p+q) eq 32767.0 then begin + + divisz = divisz + + subz = subz + + endif else begin + + divisz = divisz + 1 + + subz = subz + z(p+q) + + endelse + + endfor + + elem = (p + 1) / 60 + + if divisx lt 45 then begin + + xhrav(elem) = 32767.0 + + endif else begin + + xhrav(elem) = subx / divisx + + endelse + + if divisy lt 45 then begin + + yhrav(elem) = 32767.0 + + endif else begin + + yhrav(elem) = suby / divisy + + endelse + + if divisz lt 45 then begin + + zhrav(elem) = 32767.0 + + endif else begin + + zhrav(elem) = subz / divisz + + endelse + + xav = long(xhrav(elem) * 1000.0) + + yav = long(yhrav(elem) * 1000.0) + + zav = long(zhrav(elem) * 1000.0) + + writeu,nfile,xav,yav,zav + + endfor + + print,'1-hour file written.' + + close,nfile + + free_lun,nfile + + endfor + + + + print,'DONE!' + + + + end + + + + + + +

Processing Software

maccs — 2007-07-25 21:42:43

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 26:	Line 26:
- Nb. Requires an extra file "["missing.1m"]", to substitute	+ Nb. Requires an extra file "[[File(missing.1m)]]", to substitute

Processing Software

maccs — 2007-07-25 21:42:21

Upload of file missing.1m.

merge files.pro

maccs — 2007-07-25 21:36:39

Differences for merge files.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ pro merge_files,month=month,year=year,code=code,in_dir=in_dir,out_dir=out_dir,can=can,grn=grn,missing_min_path=missing_min_path + + ; This program merges daily 1 min. files into 1 big file + + mm=['JANUARY','FEBRUARY','MARCH','APRIL','MAY','JUNE',$ + 'JULY','AUGUST','SEPTEMBER','OCTOBER','NOVEMBER','DECEMBER'] + months=['jan','feb','mar','apr','may','jun',$ + 'jul','aug','sep','oct','nov','dec'] + set=strarr(31) + missdays=intarr(31) + yrstr=string(year,format='(i2.2)') + if (year mod 4 eq 0) then begin + day1=[1,32,61,92,122,153,183,214,245,275,306,336] + day2=[31,60,91,121,152,182,213,244,274,305,335,366] + endif else begin + day1=[1,32,60,91,121,152,182,213,244,274,305,335] + day2=[31,59,90,120,151,181,212,243,273,304,334,365] + endelse + + ; Select stations + + can_stations=['mc','co','rl','sm','si','da','pi','is','gi','ba','cc','es','rn','ta'] + grn_stations=['am','sc','dn','dm','nr','na','fh','gb','sk','st','at','gd','um',$ + 'up','ku','sv','th','me','mw','mn','mg'] + mac_stations=['re','cy','ig','rb','pb','gh','cb','pg','iq','cd','ch','bl', 'na'] + stations = mac_stations + if keyword_set(can) then stations = can_stations + if keyword_set(grn) then stations = grn_stations + if keyword_set(code) then stations = [code] + + ; Set up loop + + if keyword_set(month) then begin + start_month = month + end_month = month + endif else begin + start_month = 1 + end_month = 12 + endelse + + for month = start_month, end_month do begin + for ii = 0, n_elements(stations)-1 do begin + code=STRUPCASE(stations(ii)) + mo=month-1 + ndays=(day2(mo)-day1(mo))+1 + print,'Processing '+expandcode(code)+' '+mm(mo)+' '+yrstr + searchstr=code+strtrim(string(year),2)+'*'+'.1m' + print,in_dir+'\'+searchstr + fn=findfile(in_dir+'/'+searchstr,count=nel) + dot_pos = strpos(fn(0),'.') + d=fix(strmid(fn,dot_pos-3,3)) ;form array of days + if nel EQ 0 then begin + print,'NO MATCH FOR GIVEN YEAR AND STATION CODE' + goto, next_file + endif + + ngood=0 + nbad=0 + s=0 + for k=day1(mo),day2(mo) do begin + j=k-day1(mo) + i=where((d EQ k),count) + if count NE 0 then begin + set(j)=fn(i) ;names of month files + ngood=ngood+1 + endif else begin + set(j)='missing.1m' + nbad=nbad+1 + missdays(s)=k ;missing days + s=s+1 + endelse + endfor + if ngood EQ 0 then begin + print,'NO FILES FOR GIVEN MONTH HAVE BEEN FOUND' + goto, next_file + endif + if nbad NE 0 then begin + print,format='(I3," missing days have been found")',nbad + print,'They are:' + print,missdays(0:s-1) + endif + + ; Open month file and write + + newfn=out_dir+code+yrstr+months(mo)+'.1mg' + openw,newf,newfn,/get_lun + for kk=0,ndays-1 do begin + if set(kk) NE 'missing.1m' then openr,minf,set(kk),/get_lun $ + else openr,minf,missing_min_path,/get_lun + rec=assoc(minf,bytarr(20160)) + buf=rec(0) + writeu,newf,buf + free_lun,minf + endfor + free_lun,newf + + next_file: + + print,'ALL DONE...' + + endfor ; station loop + endfor ; month loop + end

expandcode.pro

maccs — 2007-07-25 21:35:42

Differences for expandcode.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ function expandcode,code + ;expands string CODE + + case strupcase(code) of + 'BU': a='BOSTON UNIVERSITY' + 'PG': a='PANGNIRTUNG' + 'CD': a='CAPE DORSET' + 'CH': a='CORAL HARBOUR' + 'RB': a='REPULSE BAY' + 'CY': a='CLYDE RIVER' + 'IG': a='IGLOOLIK' + 'PB': a='PELLY BAY' + 'GH': a='GJOA HAVEN' + 'RE': a='RESOLUTE BAY' + 'CB': a='CAMBRIDGE BAY' + 'BL': a='BAKER LAKE' + 'IQ': a='IQALUIT' + 'BA': a='BACK' + 'GI': a='GILLAM' + 'CC': a='CHURCHILL' + 'ES': a='ESKIMO POINT' + 'RN': a='RANKIN INLET' + 'IS': a='ISLAND LAKE' + 'PI': a='PINAWA' + 'SM': a='FORT SMITH' + 'CO': a='CONTWOYTO LAKE' + 'RL': a='RABBIT LAKE' + 'DA': a='DAWSON CREEK' + 'SI': a='FORT SIMPSON' + 'MC': a='FORT MCMURRAY' + 'TA': a='TALOYAK' + 'AM': a='AMK' + 'GW': a='GREAT WHALE RIVER' + 'PD': a='GREAT WHALE RIVER' + 'TH': a='THULE' + 'GD': a='GODHAVEN' + 'NA': a='NAIN' + ; 'NA': a='NARSARSUAQ' + 'MG': a='MAGIC GISP' + 'MN': a='MAGIC NORTH' + 'ME': a='MAGIC EAST' + 'MW': a='MAGIC WEST' + 'NE': a='NEWPORT' + 'RP': a='RAPID CITY' + 'CS': a='CAMP DOUGLAS' + 'ML': a='MOUNT CLEMENS' + 'SU': a='SUDBURY' + 'LO': a='LOMPOC' + 'TP': a='TAMPA' + + else: begin + a='unknown ' + ; message, 'Unknown station code'+': '+code + end + + endcase + return,a + end

sec to min.pro

maccs — 2007-07-25 21:34:51

Differences for sec to min.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/17/07 + + ; sec_to_min.pro, compiles and runs with idl + + ; it is used in the 5 second to 1 minute average step + + ; needs read_maccs.pro & write_maccs.pro to run + + ; input must be 5 second average files (.5s files) + + ; output is 1 minute average files (.1m files) + + ; example file names: input: CD04024.5s output: CD04024.1m + + ; to compile: .compile sec_to_min + ; to run: sec_to_min, files="/path_to_input_file(s)/name_of_input_file(s)", out_dir="/path_to_output_directory/" (you can use * and ?) + + ; Example: five_sec_avg, files="/Volumes/physics_data/Ftp/MACCS_DATA/Unrotated/5sec/CD/2005/.5s", out_dir="/Volumes/physics_data/Ftp/MACCS_DATA/Unrotated/5sec/CD/2005/" + + pro sec_to_min, files=files, out_dir=out_dir + + + if (not keyword_set(files)) and (not keyword_set(out_dir)) then begin + print,'Enter files=search string and out_dir=output directory' + print,'Also, you must complie first with .r sec_to_min' + stop + endif + + ; This program makes 1 min averages from 5 sec MACCS data 10/30/01 + + print,'running sec_to_min ver 1.0' + data_files = findfile(files,count=count) + if count eq 0 then begin + print,'No files found in '+in_dir+' with '+files + stop + endif + for i = 0, count-1 do begin + read_maccs,data_files(i),time,bx,by,bz,/nt + bx_avg = fast_avg(bx) + by_avg = fast_avg(by) + bz_avg = fast_avg(bz) + ; plot,bx_avg,max_val=30000,/ystyle + dot_pos=strpos(data_files(i),'.') + new_file = out_dir+$ + strmid(data_files(i),dot_pos-7,8)+'1m' + write_maccs,new_file,[32767,bx_avg,32767],$ + [32767,by_avg,32767],$ + [32767,bz_avg,32767],type='1mg' + endfor + + end + + function fast_avg,b + b_tmp = reform(b(12:17267),12,1438) + bad = b_tmp eq 32767 + badsums = float(total(bad,1))/12. + bad = where(b_tmp eq 32767,count) + if count ne 0 then b_tmp(bad)=!values.f_nan + b_avg = total(b_tmp,1,/nan)/(12.-badsums12.) + bad = where(badsums ge 0.4,count) + if count ne 0 then b_avg(bad) = 32767. + return,b_avg + end

five sec avg fast avg.pro

maccs — 2007-07-25 21:33:25

Differences for five sec avg fast avg.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/16/07 + + ; five_sec_avg_fast_avg.pro, compiles and runs with idl + + ; called by five_sec_avg.pro which is used in the 1/2 sec to 5 sec avg step + + ; inputs b1 & b2 + + ; returns b_avg + + + + function five_sec_avg_fast_avg,b1,b2 + + ; # of sec in a day is 864000 + + b_tmp = fltarr(864002) + + t1 = lindgen(86400)2 + + t2 = lindgen(86400)2+1 + + b_tmp(t1) = b1 + + b_tmp(t2) = b2 + + ; now all b1 and b2 for the same day + + ; are adjacent in the b_tmp array + + + + ; Always skip the first five values in front + + ; and the fifteen values in the back + + ; (see in five_sec_avg.pro where the values + + ; are printed), so basically two 5 sec intervals + + ; are missing in the final result + + b_tmp2 = reform(b_tmp(6:172785),10,17278) + + ; now b_tmp2 includes 10x17278 array, i.e. all + + ; the values from the a 5 sec interval are + + ; grouped together + + ; Nb. Mean of each row is then the 5 sec avg + + + + ; Nb. The bad value is 32767000L in the raw data. + + ; As the derived data is scaled with 1/1000 that + + ; gives this derived bad value + + bad = b_tmp2 eq 32767 + + + + badsums = float(total(bad,1))/10. + + + + bad = where(b_tmp2 eq 32767,count) + + + + if count ne 0 then b_tmp2(bad)=!values.f_nan + + ; Nb. Strictly speaking the next line is not valid + + ; as it is illdefined, when badsums = 10, + + ; i.e. all the data points in the interval bad. + + ; This is recovered from in the next to last step + + ; by setting the average of any interval with more + + ; than 4 bad points to '32767' the designated bad value. + + b_avg = total(b_tmp2,1,/nan)/(10.-badsums10.) + + + + bad = where(badsums ge 0.4,count) + + if count ne 0 then b_avg(bad) = 32767. + + return,b_avg + + end

five sec avg.pro

maccs — 2007-07-25 21:32:35

Differences for five sec avg.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/16/07 + + ; five_sec_avg.pro, compiles and runs with idl + + ; it is used in the 1/2 sec to 5 sec avg step + + ; needs five_sec_avg_fast_avg.pro, read_maccs.pro & write_maccs.pro to run + + ; input must be clean maccs files (.s2 files) + + ; output is 5 second average files (.5s files) + + ; example file names: input: CD04024.s2 output: CD04024.5s + + ; to compile & run: five_sec_avg, files="/path_to_input_file(s)/name_of_input_file(s)", out_dir="/path_to_output_directory/" (you can use * and ?) + + ; Example: five_sec_avg, files="/Volumes/physics_data/Ftp/MACCS_DATA/Clean/CD/2005/*.s2", out_dir="/Volumes/physics_data/Ftp/MACCS_DATA/Unrotated/5sec/CD/2005/" + + + + pro five_sec_avg, files=files, out_dir=out_dir + + + + + + if (not keyword_set(files)) and (not keyword_set(out_dir)) then begin + + print,'Enter files=search string and out_dir=output directory' + + print,'Also, you must compile first with .r five_sec_avg' + + stop + + endif + + + + ; This program makes 5 sec averages from 1/2 sec MACCS data 04/26/00 + + + + print,'running five_sec_avg ver 1.0' + + data_files = findfile(files,count=count) + + if count eq 0 then begin + + print,'No files found in '+in_dir+' with '+files + + stop + + endif + + for i = 0, count-1 do begin + + read_maccs,data_files(i),time,bx1,by1,bz1,type,$ + + bx2=bx2,by2=by2,bz2=bz2,/nt + + if type eq 2 then begin + + ; bad_bx1=where(bx1 eq 32767,count) + + ; bx2(bad_bx1) = 32767 + + bx_avg = five_sec_avg_fast_avg(bx1,bx2) + + by_avg = five_sec_avg_fast_avg(by1,by2) + + bz_avg = five_sec_avg_fast_avg(bz1,bz2) + + ;PRINT, 'The min and max of bx are ', MIN(bx_avg), ' and ', MAX(bx_avg) + + ;PRINT, 'The min and max of by are ', MIN(by_avg), ' and ', MAX(by_avg) + + ;PRINT, 'The min and max of bz are ', MIN(bz_avg), ' and ', MAX(bz_avg) + + + + endif else begin + + print,'GSC file' + + bx2=bx1 & by2=by1 & bz2=bz1 + + bx_avg = five_sec_avg_fast_avg(bx1,bx2) + + by_avg = five_sec_avg_fast_avg(by1,by2) + + bz_avg = five_sec_avg_fast_avg(bz1,bz2) + + endelse + + ; plot,bx_avg,max_val=30000,/ystyle + + new_file = out_dir+$ + + strmid(data_files(i),strlen(data_files(i))-10,8)+'5s' + + write_maccs,new_file,[32767,bx_avg,32767],$ + + [32767,by_avg,32767],$ + + [32767,bz_avg,32767],type='5sg' + + endfor + + + + end

flag.pro

maccs — 2007-07-25 21:31:58

Differences for flag.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/6/07 + + ; flag.pro, compiles and runs with idl + + ; called by step_view.pro (which is used in the manual step of removing spikes) + + + + function Flag,inarr + + ;raise flag levels to fit into MAXLEVEL + + outarr=(inarr NE !BAD)inarr+(inarr EQ !BAD)1E23 + + return,outarr + + end

cleaner.pro

maccs — 2007-07-25 21:29:06

Differences for cleaner.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- cleaner.pro, compiles and runs with idl - - needs strip.pro to run - - input must be raw MACCS data file(s) - - output is a cleaned binary version of the raw data with filetype .s2 - - example: if input file is CD05.4, output file is CD05004.s2 - - to compile & run: cleaner, "path_and_name_of_raw_data_file(s)" (you can use * and ?) - - default output directory is e:\ - - to set output directory: out_dir="output_directory" - - to display a window with a graph: view="view" - - to create summary text file(s) containg the command line output: summary="summary" - - to save the .s2 file(s) in a subdirectory folder (which must already exist): month_str="sub_dir_name" - - to move the raw file(s) after creating the clean file(s): move="path" (if you used the month_str parameter, the file(s) will be moved to the subdirectory within the folder you specified for the move directory) Ex: if parameters are month_str="Jan05/", move="/Volumes/MACCS_DATA/" then raw file(s) will be moved to /Volumes/MACCS_DATA/Jan05/ - - the click parameter should not be used unless changes are made to the program - - Example: cleaner, "/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2005/CD05.4", out_dir="/Users/johnson8/maccs/", summary="summary", month_str="Jan05/", move="/Users/johnson8/Desktop/", view="view"	+ ; Comments added by Erik Johnson 7/3/07 + ; cleaner.pro, compiles and runs with idl + ; needs strip.pro to run + ; input must be raw MACCS data file(s) + ; output is a cleaned binary version of the raw data with filetype .s2 + ; example: if input file is CD05.4, output file is CD05004.s2 + ; to compile & run: cleaner, "path_and_name_of_raw_data_file(s)" (you can use * and ?) + ; default output directory is e:\ + ; to set output directory: out_dir="output_directory" + ; to display a window with a graph: view="view" + ; to create summary text file(s) containg the command line output: summary="summary" + ; to save the .s2 file(s) in a subdirectory folder (which must already exist): month_str="sub_dir_name" + ; to move the raw file(s) after creating the clean file(s): move="path" (if you used the month_str parameter, the file(s) will be moved to the subdirectory within the folder you specified for the move directory) Ex: if parameters are month_str="Jan05/", move="/Volumes/MACCS_DATA/" then raw file(s) will be moved to /Volumes/MACCS_DATA/Jan05/ + ; the click parameter should not be used unless changes are made to the program + ; Example: cleaner, "/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2005/CD05.4", out_dir="/Users/johnson8/maccs/", summary="summary", month_str="Jan05/", move="/Users/johnson8/Desktop/", view="view" + + pro cleaner,search,view=view,summary=summary,month_str=month_str,$ + calc_mon=calc_mon,out_dir=out_dir,click=click,move=move + + + !p.multi=[0,0,4] + if not keyword_set(month_str) then month_str = '' + flagged_record = byte([32767000L,32767000L,32767000L,32767000L,32767000L,32767000L],0,1,24) + x = 35 ;bytes + clean_data = bytarr(28,86400) + raw_files = findfile(search,count=num_raw) + + + for i = 0, n_elements(raw_files)-1 do begin ; Loop over number of files to be processed + if keyword_set(view) then window,0,xsize=600,ysize=700 + for ii = 0L,86399L do clean_data(0,ii) = [0B,0B,0B,0B,reform(flagged_record)] + print,'done' + print,raw_files(i) + dot_pos = strpos(raw_files(i),'.') + date = string(fix(strmid(raw_files(i),dot_pos+1,3)),format='(i3.3)') + if keyword_set(calc_mon) then date_var,yrday=fix(strmid(raw_files(i),dot_pos-2,2)+date),month_str=month_str + if not keyword_set(out_dir) then out_dir = 'e:\' + ; OLD clean_file = out_dir+month_str+'\'+strmid(raw_files(i),dot_pos-4,4)+date+'.s2' + clean_file = FILEPATH(strmid(raw_files(i),dot_pos-4,4)+date+'.s2', ROOT_DIR = out_dir, SUBDIR = [month_str]) + ; OLD text_file = out_dir+month_str+'\'+strmid(raw_files(i),dot_pos-4,4)+date+'.txt' + text_file = FILEPATH(strmid(raw_files(i),dot_pos-4,4)+date+'.txt', ROOT_DIR = out_dir, SUBDIR = [month_str]) + print,clean_file,text_file + + ; Open "summary" text file is summary keyword is selected + + if keyword_set(summary) then openw,summary_file,text_file,/get_lun + + ; Open and read raw data file + + openr, unit, raw_files(i), error=err, /get_lun + if err eq 0 then begin + file_info = fstat(unit) + print,file_info.isatty + y = file_info.size / x + PRINT, 'Y ', y + print,raw_files(i)+' has '+strip(y)+' records.' + if keyword_set(summary) then printf,summary_file,raw_files(i)+' has '+strip(y)+' records.' + temp = assoc(unit, bytarr(x, y), 0) + raw_data = temp(0) + close,unit + free_lun, unit + endif else begin + print,'An error has occured reading '+raw_files(i) + stop + endelse + + good_time = where((raw_data(30,) ne 0) and (raw_data(31,) ne 1),n_good_time) + no_time = where((raw_data(30,) eq 0) and (raw_data(31,) eq 1),n_no_time) + print,n_no_time,' records without time.' + if n_no_time gt 0 then begin + raw_data = raw_data(,good_time) + y = n_good_time + endif + + ; Read data into arrays + + header= raw_data( 0,) + dd = fix (raw_data( 1: 2,),0,1,y) + hh = raw_data( 3,) + mm = raw_data( 4,) + ss = raw_data( 5,) + bx1 = long(raw_data( 6: 9,),0,1,y)/1000. + by1 = long(raw_data(10:13,),0,1,y)/1000. + bz1 = long(raw_data(14:17,),0,1,y)/1000. + bx2 = long(raw_data(18:21,),0,1,y)/1000. + by2 = long(raw_data(22:25,),0,1,y)/1000. + bz2 = long(raw_data(26:29,),0,1,y)/1000. + tf1 = raw_data(30,) + tf2 = raw_data(31,) + block = raw_data(32,) + status= raw_data(33,) + house = raw_data(34,) + + ; Plot if keyword "view" is selected + + if keyword_set(view) then begin + ; window,1,xsize=600,ysize=600 + seconds = hh3600L + mm60L + ss + diff = seconds(1:n_elements(seconds)-1) - seconds(0:n_elements(seconds)-2) + backward = where(diff lt 0,count) + plot,seconds,/ystyle,title=raw_files(i) + plot,bx1,max_val=median(bx1)+500,min_val=median(bx1)-500,/ystyle + plot,by1,max_val=median(by1)+500,min_val=median(by1)-500,/ystyle + plot,bz1,max_val=median(bz1)+500,min_val=median(bz1)-500,/ystyle + ; if (keyword_set(click) and count gt 0) then cursor,cx,cy,/wait,/up,/norm + ; print,cx,cy + ; if cy lt .5 then goto,skip + ; print,'noskip',cy + endif + + ; Check day + + same_day = where(((dd gt 0) and (dd le 366)) and (dd ne dd(0)) and (tf1 eq 49) and (tf2 eq 48),count) + if count ne 0 then begin + + print,raw_files(i)+' has more than one day.' + ; for jk=0,count-1 do begin + ; print,same_day(jk) + ; for kk = same_day(jk)-2, same_day(jk)+2 do $ + ; print,header(kk),dd(kk),hh(kk),mm(kk),ss(kk),tf1(kk),tf2(kk),block(kk) + ; endfor + stop + endif + + ; Find Gaps + + ; flagged = where((tf1 ne 49) or (tf2 ne 57),n_flagged) + ; good = where((tf1 eq 49) and (tf2 eq 57),n_good) + flagged = where((tf1 ne 49) or (tf2 ne 48),n_flagged) + good = where((tf1 eq 49) and (tf2 eq 48),n_good) + ; if n_good eq 0 then begin + ; print,'n_good',n_good + ; goto,skip + ; endif + delta_good = good(1:n_good-1) - good(0:n_good-2) + good_gaps = where(delta_good ne 1,n_good_gap) + + seconds = hh 3600. + mm * 60. + ss + seconds = reform(seconds) + + ; Find first good record + + print,'first good time at ',hh(good(0)),':',mm(good(0)),':',ss(good(0)) + if keyword_set(summary) then printf,summary_file,'first good time at ',hh(good(0)),':',mm(good(0)),':',ss(good(0)) + clean_data(0,0:seconds(good(0))) = 2b + for ii = 0L,seconds(good(0)) do clean_data(04:27,ii) = flagged_record + + ; Write good data into clean_data + + clean_time = findgen(86400) + clean_data(0,seconds(good)) = 0b + clean_data(1,) = byte(floor(clean_time/3600.)) + clean_data(2,) = byte(floor((clean_time-clean_data(1,)3600.)/60.)) + clean_data(3,) = byte(clean_time-clean_data(1,)3600.-clean_data(2,)60.) + + clean_data(04:27,seconds(good)) = raw_data(06:29,good) + + ; Fix Gaps + + for jj = 0L,n_good_gap-1 do begin + + gap_start = good(good_gaps(jj)) + gap_stop = good(good_gaps(jj)+1) + gap_delta_t = seconds(gap_stop) - seconds(gap_start) + gap_delta_b = block(gap_stop) - block(gap_start) + gap_length = gap_stop-gap_start + print,'gap ',strip(jj),' at ',hh(gap_start),':',mm(gap_start),':',ss(gap_start),$ + ' has ',strip(gap_delta_t),' seconds and ',strip(gap_length),' data points' + if keyword_set(summary) then printf,summary_file,'gap ',strip(jj),' at ',hh(gap_start),$ + ':',mm(gap_start),':',ss(gap_start),' has ',strip(gap_delta_t),' seconds and ',strip(gap_length),' data points' + + ; for kk = gap_start, gap_stop do begin + ; print,dd(kk),hh(kk),mm(kk),ss(kk),bz1(kk),block(kk),tf1(kk),tf2(kk) + ; endfor + + if (gap_length eq gap_delta_t) and (gap_length eq gap_delta_b) then begin + clean_data(0,seconds(gap_start):seconds(gap_stop)) = 1b + clean_data(04:27,seconds(gap_start):seconds(gap_stop)) = raw_data(06:29,gap_start:gap_stop) + if gap_delta_t gt 3600 then stop + endif else begin + if gap_delta_t gt 5 then begin + clean_data(0,seconds(gap_start):seconds(gap_stop)) = 2b + for ii = seconds(gap_start),seconds(gap_stop-1) do clean_data(04:27,ii) = flagged_record + gap_flagged = where((flagged gt gap_start) and (flagged lt gap_stop), n_gap_flagged) + print,' ',strip(n_gap_flagged),' flagged values in gap.' + if keyword_set(summary) then printf,summary_file,'* ',strip(n_gap_flagged),' flagged values in gap.' + if n_gap_flagged/gap_length gt 0.5 then stop + endif else begin + ; clean_data(0,seconds(gap_start):seconds(gap_stop-1)) = 2b + clean_data(0,seconds(gap_start):seconds(gap_stop)) = 2b + for ii = seconds(gap_start),seconds(gap_stop-1) do clean_data(04:27,ii) = flagged_record + endelse + endelse + + endfor + + ; Switch from bx1,by1,bz1,bx2,by2,bz2 to bx1,bx2,by1,by2,bz1,bz2 + + old_bytes = [04,05,06,07,16,17,18,19,08,09,10,11,20,21,22,23,12,13,14,15,24,25,26,27] + clean_data(04:27,) = clean_data(old_bytes,) + + ; Write clean data to file + + openw,unit,clean_file,/get_lun + writeu,unit,clean_data + close,unit + free_lun,unit + + if keyword_set(move) then begin + print,'move '+raw_files(i)+' '+move+month_str+'\'+strmid(raw_files(i),dot_pos-4,8) + spawn,'move '+raw_files(i)+' '+move+month_str+'\'+strmid(raw_files(i),dot_pos-4,8) + ; wait,5 + endif + + ; Close "summary" text file + + ; skip: + + if keyword_set(summary) then close,summary_file + if keyword_set(summary) then free_lun,summary_file + + endfor + + !p.multi=0 + end

step wid.pro

maccs — 2007-07-25 21:27:46

Differences for step wid.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/6/07 + + ; step_wid.pro, compiles and runs with idl + + ; used in the manual step of removing spikes + + + + ; + + ;------------------------------------------------------------------------------- + + ; + + ; Event Handler + + ; + + + + PRO step_wid_event, ev + + + + WIDGET_CONTROL, ev.top, GET_UVALUE=statePtr + + WIDGET_CONTROL, ev.id, GET_UVALUE=uval + + + + CASE uval OF + + 'marker_select':(statePtr).current_marker = ev.value + + + + 'component_select':begin + + ss = (statePtr).start_mark3600 + + ee = (statePtr).stop_mark3600 + + (statePtr).current_component = ev.value + + if ev.value eq 0 then fix_level=-1(median((statePtr).bx(ee-600:ee))$ + + -median((statePtr).bx(ee:ee+600))) + + + + if ev.value eq 1 then fix_level=-1(median((statePtr).by(ee-600:ee))$ + + -median((statePtr).by(ee:ee+600))) + + + + if ev.value eq 2 then fix_level=-1(median((statePtr).bz(ee-600:ee))$ + + -median((statePtr).bz(ee:ee+600))) + + + + WIDGET_CONTROL, (statePtr).slider2_id, SET_VALUE=fix_level + + ; WIDGET_CONTROL, (statePtr).slider2_id, SET_slider_max=fix_level + 1000. + + ; WIDGET_CONTROL, (statePtr).slider2_id, SET_slider_min=fix_level - 1000. + + end + + + + 'plot_box': begin + + location = convert_coord(ev.x,ev.y,/device,/to_data) + + if ev.press eq 1 then begin + + (statePtr).start_mark = location(0) + + new_slider_min = max([location(0)3600 - 1000,0]) + + new_slider_max = min([location(0)3600 + 1000,86399]) + + WIDGET_CONTROL, (statePtr).slider4_id, SET_slider_max=new_slider_max + + WIDGET_CONTROL, (statePtr).slider4_id, SET_slider_min=new_slider_min + + WIDGET_CONTROL, (statePtr).slider4_id, SET_VALUE=location(0)3600 + + endif + + if ev.press eq 4 then begin + + (statePtr).stop_mark = location(0) + + new_slider_min = max([location(0)3600 - 1000,0]) + + new_slider_max = min([location(0)3600 + 1000,86399]) + + WIDGET_CONTROL, (statePtr).slider5_id, SET_slider_max=new_slider_max + + WIDGET_CONTROL, (statePtr).slider5_id, SET_slider_min=new_slider_min + + WIDGET_CONTROL, (statePtr).slider5_id, SET_VALUE=location(0)3600 + + endif + + if (ev.press eq 1 and ev.clicks eq 2) then begin + + (statePtr).start_mark = location(0) - 20./3600. + + WIDGET_CONTROL,(statePtr).slider4_id,SET_VALUE=(location(0)-20./3600.)3600. + + (statePtr).stop_mark = location(0) + 20./3600. + + WIDGET_CONTROL,(statePtr).slider5_id,SET_VALUE=(location(0)+20./3600.)3600. + + endif + + if (ev.press eq 1 or ev.press eq 4) then $ + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + end + + + + 'file' :begin + + WIDGET_CONTROL, (statePtr).file_box_id, get_VALUE=file + + WIDGET_CONTROL, (statePtr).input_dir_box_id, get_VALUE=in + + WIDGET_CONTROL, (statePtr).output_dir_box_id, get_VALUE=out + + (statePtr).file = file & (statePtr).in_dir = in & (statePtr).out_dir = out + + (statePtr).file = dialog_pickfile(path=(statePtr).in_dir, get_path=new_path, filter='.s2') + + (statePtr).in_dir = new_path + + WIDGET_CONTROL, (statePtr).file_box_id, SET_VALUE=(statePtr).file + + IF(FILE_TEST((statePtr).file, /READ)) THEN BEGIN + + WIDGET_CONTROL, (statePtr).input_dir_box_id, SET_VALUE=(statePtr).in_dir + + read_maccs,(statePtr).file,t,x,y,z,/nt,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1 + + (statePtr).bx()=x & (statePtr).by()=y & (statePtr).bz()=z + + (statePtr).bx2()=bx2 & (statePtr).by2()=by2 & (statePtr).bz2()=bz2 + + (statePtr).tf1()=tf1 + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + ENDIF + + end + + + + 'plot' :step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + + + 'fix' :step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,$ + + (statePtr).x_fix,(statePtr).y_fix,(statePtr).z_fix,/fixer + + + + 'do_it':begin + + widget_control, (statePtr).file_box_id, get_VALUE=file + + widget_control, (statePtr).output_dir_box_id, get_VALUE=out + + (statePtr).file = file & (statePtr).out_dir = out + + + + ; OLD filename=(statePtr).out_dir + $ + + ; OLD strmid((statePtr).file,strlen((statePtr).file)-10,10) + + filename=FILEPATH(strmid((statePtr).file,strlen((statePtr).file)-10,10), $ + + ROOT_DIR = (statePtr).out_dir) + + + + openw,unit,strmid(filename,0,strlen(filename)-2)+'txt',/get_lun,/append + + ss = (statePtr).start_mark3600 + + ee = (statePtr).stop_mark3600 + + (statePtr).tf1(ss:ee) = (statePtr).tf1(ss:ee) + 2 + + if !version.os eq 'Win32' then begin + + date_string=systime() + + endif else begin + + ; date=today() + + ; date_string = ' '+strip(fix(date.month))+'/'+$ + + ; strip(fix(date.day))+'/'+strip(date.year)+' '+getenv('USER') + + date_string=systime()+' '+getenv('USER') + + endelse + + printf,unit,ss,ee,(statePtr).x_fix,(statePtr).y_fix,$ + + (statePtr).z_fix,date_string,' fixed' + + close,unit + + free_lun,unit + + + + bad = where((statePtr).bx() eq 32767,count) + + (statePtr).bx(ss:ee) = (statePtr).bx(ss:ee) + (statePtr).x_fix + + if count ne 0 then (statePtr).bx(bad) = 32767 + + bad = where((statePtr).bx2() eq 32767,count) + + (statePtr).bx2(ss:ee) = (statePtr).bx2(ss:ee) + (statePtr).x_fix + + if count ne 0 then (statePtr).bx2(bad) = 32767 + + bad = where((statePtr).by() eq 32767,count) + + (statePtr).by(ss:ee) = (statePtr).by(ss:ee) + (statePtr).y_fix + + if count ne 0 then (statePtr).by(bad) = 32767 + + bad = where((statePtr).by2() eq 32767,count) + + (statePtr).by2(ss:ee) = (statePtr).by2(ss:ee) + (statePtr).y_fix + + if count ne 0 then (statePtr).by2(bad) = 32767 + + bad = where((statePtr).bz() eq 32767,count) + + (statePtr).bz(ss:ee) = (statePtr).bz(ss:ee) + (statePtr).z_fix + + if count ne 0 then (statePtr).bz(bad) = 32767 + + bad = where((statePtr).bz2() eq 32767,count) + + (statePtr).bz2(ss:ee) = (statePtr).bz2(ss:ee) + (statePtr).z_fix + + if count ne 0 then (statePtr).bz2(bad) = 32767 + + fss1 = max([(statePtr).start_mark3600-30,0]) + + fee1 = min([(statePtr).start_mark3600+30,86399]) + + fss2 = max([(statePtr).stop_mark3600-30,0]) + + fee2 = min([(statePtr).stop_mark3600+30,86399]) + + (statePtr).bx(fss1:fee1) = 32767 + + (statePtr).bx(fss2:fee2) = 32767 + + (statePtr).bx2(fss1:fee1) = 32767 + + (statePtr).bx2(fss2:fee2) = 32767 + + (statePtr).by(fss1:fee1) = 32767 + + (statePtr).by(fss2:fee2) = 32767 + + (statePtr).by2(fss1:fee1) = 32767 + + (statePtr).by2(fss2:fee2) = 32767 + + (statePtr).bz(fss1:fee1) = 32767 + + (statePtr).bz(fss2:fee2) = 32767 + + (statePtr).bz2(fss1:fee1) = 32767 + + (statePtr).bz2(fss2:fee2) = 32767 + + (statePtr).x_fix = 0 + + (statePtr).y_fix = 0 + + (statePtr).z_fix = 0 + + end + + + + 'write':begin + + WIDGET_CONTROL, (statePtr).file_box_id, get_VALUE=file + + WIDGET_CONTROL, (statePtr).input_dir_box_id, get_VALUE=in + + WIDGET_CONTROL, (statePtr).output_dir_box_id, get_VALUE=out + + (statePtr).file = file & (statePtr).in_dir = in & (statePtr).out_dir = out + + ; OLD filename = (statePtr).out_dir + strmid((statePtr).file,strlen((statePtr).file)-10,10) + + filename = FILEPATH(strmid((statePtr).file,strlen((statePtr).file)-10,10), ROOT_DIR = (statePtr).out_dir) + + + + write_maccs,strcompress(filename,/remove_all),(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + bx2=(statePtr).bx2,by2=(statePtr).by2,bz2=(statePtr).bz2,$ + + tf1=(statePtr).tf1,type='s2' + + end + + + + 'next' :begin + + (statePtr).start_hour = 0 + + (statePtr).stop_hour = 24 + + WIDGET_CONTROL, (statePtr).slider6_id, SET_VALUE=(statePtr).start_hour + + WIDGET_CONTROL, (statePtr).slider7_id, SET_VALUE=(statePtr).stop_hour + + next_day = string(fix(strmid((statePtr).file,strlen((statePtr).file)-6,3))+1,format='(i3.3)') + + next_file = (statePtr).file + + strput,next_file,next_day,strlen(next_file)-6 + + (statePtr).file = next_file + + WIDGET_CONTROL, (statePtr).file_box_id, SET_VALUE=(statePtr).file + + PRINT, 'Checking the existance of ', next_file + + IF (FILE_TEST(next_file, /READ)) THEN BEGIN + + read_maccs,(statePtr).file,t,x,y,z,/nt,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1 + + (statePtr).bx()=x & (statePtr).by()=y & (statePtr).bz()=z + + (statePtr).bx2()=bx2 & (statePtr).by2()=by2 & (statePtr).bz2()=bz2 + + (statePtr).tf1()=tf1 + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + ENDIF ELSE BEGIN + + PRINT, 'Does not exist. Try again' + + + + + + ENDELSE + + end + + + + 'flag' :begin + + widget_control, (statePtr).file_box_id, get_VALUE=file + + widget_control, (statePtr).output_dir_box_id, get_VALUE=out + + (statePtr).file = file & (statePtr).out_dir = out + + + + filename = (statePtr).out_dir + strmid((statePtr).file,strlen((statePtr).file)-10,10) + + openw,unit,strmid(filename,0,strlen(filename)-2)+'txt',/get_lun,/append + + ss = (statePtr).start_mark3600 + + ee = (statePtr).stop_mark3600 + + if !version.os eq 'Win32' then begin + + date_string=systime() + + endif else begin + + ; date=today() + + ; date_string = ' '+strip(fix(date.month))+'/'+$ + + ; strip(fix(date.day))+'/'+strip(date.year)+' '+getenv('USER') + + date_string=systime()+' '+getenv('USER') + + endelse + + printf,unit,ss,ee,(statePtr).x_fix,(statePtr).y_fix,(statePtr).z_fix,date_string,' flagged' + + close,unit + + free_lun,unit + + + + (statePtr).tf1(ss:ee) = (statePtr).tf1(ss:ee) + 2 + + (statePtr).bx(ss:ee) = 32767 + + (statePtr).by(ss:ee) = 32767 + + (statePtr).bz(ss:ee) = 32767 + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + end + + + + 'slider2' : begin + + if ((statePtr).current_component eq 0) then (statePtr).x_fix = ev.value + + if ((statePtr).current_component eq 1) then (statePtr).y_fix = ev.value + + if ((statePtr).current_component eq 2) then (statePtr).z_fix = ev.value + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,$ + + (statePtr).x_fix,(statePtr).y_fix,(statePtr).z_fix,/fixer + + end + + + + 'slider4' : (statePtr).start_mark = ev.value/3600. + + + + 'slider5' : (statePtr).stop_mark = ev.value/3600. + + + + 'slider6' : begin + + (statePtr).start_hour = ev.value + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + end + + + + 'slider7' : begin + + (statePtr).stop_hour = ev.value + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + end + + + + 'previous': begin + + (statePtr).start_hour = (statePtr).start_hour - 1 + + (statePtr).stop_hour = (statePtr).stop_hour - 1 + + if (statePtr).start_hour lt 0 then (statePtr).start_hour=0 + + if (statePtr).stop_hour lt 1 then (statePtr).stop_hour=1 + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + WIDGET_CONTROL, (statePtr).slider6_id, SET_VALUE=(statePtr).start_hour + + WIDGET_CONTROL, (statePtr).slider7_id, SET_VALUE=(statePtr).stop_hour + + end + + + + 'advance' : begin + + if ((statePtr).start_hour eq 0 and (statePtr).stop_hour eq 24) then begin + + (statePtr).start_hour = -1 + + (statePtr).stop_hour = 0 + + endif + + (statePtr).start_hour = (statePtr).start_hour + 1 + + (statePtr).stop_hour = (statePtr).stop_hour + 1 + + if (statePtr).start_hour gt 23 then (statePtr).start_hour=23 + + if (statePtr).stop_hour gt 24 then (statePtr).stop_hour=24 + + step_view,(statePtr).bx,(statePtr).by,(statePtr).bz,$ + + (statePtr).start_mark,(statePtr).stop_mark,0,0,0,$ + + ss=(statePtr).start_hour,ee=(statePtr).stop_hour + + WIDGET_CONTROL, (statePtr).slider6_id, SET_VALUE=(statePtr).start_hour + + WIDGET_CONTROL, (statePtr).slider7_id, SET_VALUE=(statePtr).stop_hour + + end + + + + 'done': WIDGET_CONTROL, ev.top, /DESTROY + + + + ENDCASE + + + + END + + + + ; + + ;----------------------------------------------------------------------------- + + ; + + ; Widget Definitions + + ; + + + + PRO step_wid, InputDir = InputDir, OutputDir = OutputDir + + + + IF NOT KEYWORD_SET(InputDir) THEN BEGIN + + PRINT, 'Please provide initial input directory' + + STOP + + END + + + + IF NOT KEYWORD_SET(OutputDir) THEN BEGIN + + PRINT, 'Please provide initial input directory' + + STOP + + END + + + + loadct,12 + + base = WIDGET_BASE(xoffset=100) + + + + file_box = widget_text(base, value='', uvalue='file_text',$ + + xoffset=90, yoffset=0, xsize=30, /editable) + + + + file_box_label = widget_label(base, value='Current file: ',$ + + xoffset=0, yoffset=0, xsize=100) + + + + input_dir_box = widget_text(base, value=InputDir, uvalue='in_dir_text',$ + + xoffset=90, yoffset=30, xsize=30 ,/editable) + + + + input_dir_box_label = widget_label(base, value=' Input directory: ',$ + + xoffset=0, yoffset=35, xsize=120) + + + + output_dir_box = widget_text(base, value=OutputDir,$ + + uvalue='out_dir_text',xoffset=90, yoffset=55, xsize=30,$ + + /editable) + + + + output_dir_box_label = widget_label(base, value=' Output directory: ',$ + + xoffset=0, yoffset=60, xsize=120) + + + + file_button = WIDGET_BUTTON(base, VALUE='Select File', UVALUE='file',$ + + xoffset=0, yoffset=90, scr_xsize=100) + + plot_button = WIDGET_BUTTON(base, VALUE='Plot', UVALUE='plot',$ + + xoffset=110, yoffset=90, scr_xsize=100) + + do_it_button = WIDGET_BUTTON(base, VALUE='Do it', UVALUE='do_it',$ + + xoffset=0, yoffset=120, scr_xsize=100) + + write_button = WIDGET_BUTTON(base, VALUE='Write!', UVALUE='write',$ + + xoffset=110, yoffset=120, scr_xsize=100) + + next_button = WIDGET_BUTTON(base, VALUE='Next File', UVALUE='next',$ + + xoffset=220, yoffset=120, scr_xsize=100) + + flag_button = WIDGET_BUTTON(base, VALUE='Flag Selection', UVALUE='flag',$ + + xoffset=620, yoffset=140, scr_xsize=100) + + done_button = WIDGET_BUTTON(base, VALUE='Done', UVALUE='done',$ + + xoffset=110, yoffset=145, scr_xsize=100) + + fix_button = WIDGET_BUTTON(base, VALUE='Fix', UVALUE='fix',$ + + xoffset=220, yoffset=90, scr_xsize=100) + + slider2 = widget_slider(base, value=100, title='', uvalue='slider2',$;fix amount + + xoffset=680, yoffset=10, minimum=-10000, maximum=10000, scr_xsize=100, /vertical) + + slider4 = widget_slider(base, value=1, title='', uvalue='slider4',$ + + xoffset=380, yoffset=130, minimum=0, maximum=86399, scr_xsize=100) + + slider5 = widget_slider(base, value=1, title='', uvalue='slider5',$ + + xoffset=500, yoffset=130, minimum=0, maximum=86399, scr_xsize=100) + + slider6 = widget_slider(base, value=0, title='Start hour', uvalue='slider6',$ + + xoffset=380, yoffset=5, maximum=24, scr_xsize=100) + + slider7 = widget_slider(base, value=24, title='Stop hour', uvalue='slider7',$ + + xoffset=500, yoffset=5, maximum=24, scr_xsize=100) + + previous_button = WIDGET_BUTTON(base, VALUE='Previous', UVALUE='previous',$ + + xoffset=380, yoffset=70, scr_xsize=100) + + advance_button = WIDGET_BUTTON(base, VALUE='Advance', UVALUE='advance',$ + + xoffset=500, yoffset=70, scr_xsize=100) + + marker_select = CW_BGROUP(base, ['start marker','stop marker'], xoffset=400, yoffset=100,$ + + UVALUE='marker_select', /row, /exclusive) + + component_select = CW_BGROUP(base, ['x','y','z'], xoffset=620, yoffset=10,$ + + UVALUE='component_select', /column, /exclusive) + + plot_box = WIDGET_DRAW(base, xoffset = 0, yoffset = 170, XSIZE = 800, YSIZE = 500,$ + + UVALUE='plot_box', /button_events) + + + + + + statePtr = ptr_new( { status: 0,$ + + bx: fltarr(86400),$ + + by: fltarr(86400),$ + + bz: fltarr(86400),$ + + bx2: fltarr(86400),$ + + by2: fltarr(86400),$ + + bz2: fltarr(86400),$ + + tf1: fltarr(86400),$ + + file: '',$ + + in_dir: '/cdrom/',$ + + out_dir: '/magneto1'+getenv('USER')+'/',$ + + slider2_value: 100,$ + + slider2_id: slider2,$ + + slider4_id: slider4,$ + + slider5_id: slider5,$ + + slider6_id: slider6,$ + + slider7_id: slider7,$ + + current_marker: 0,$ + + current_component: 0,$ + + start_mark: 1.0,$ + + stop_mark: 1.0,$ + + start_hour: 0.,$ + + stop_hour: 24.,$ + + x_fix: 0,$ + + y_fix: 0,$ + + z_fix: 0,$ + + file_box_id: file_box,$ + + input_dir_box_id: input_dir_box,$ + + output_dir_box_id: output_dir_box,$ + + current_path: 'v:\murr'} ) + + WIDGET_CONTROL, base, SET_UVALUE=statePtr + + WIDGET_CONTROL, base, /REALIZE + + WIDGET_CONTROL, plot_box, GET_VALUE = index + + WSET, index + + + + XMANAGER, 'step_wid', base + + + + file_value = (*statePtr).file + + ptr_free, statePtr + + print,'done' + + + + + + END

step view.pro

maccs — 2007-07-25 21:26:54

Differences for step view.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/6/07 + + ; step_view.pro, compiles and runs with idl + + ; needs flag.pro to run + + ; used in the manual step of removing spikes + + ; input ? + + ; output: graphs? + + + + pro step_view,bx,by,bz,start_mark,stop_mark,x,y,z,ss=ss,ee=ee,fixer=fixer,$ + + oplot_only=oplot_only + + !p.multi = [0,1,3,2] + + !p.background=255 + + !p.color=0 + + !p.charsize=1.5 + + t = lindgen(86400) + + if keyword_set(fixer) then begin + + !p.multi = [0,2,3,0,1] + + ss = start_mark3600.-600. + + ee = start_mark3600.+600. + + if ss lt 0 then ss=0 + + if ee gt 86399 then ee=86399 + + bbx = bx & bby = by & bbz = bz + + bbx(start_mark3600.:stop_mark3600.) = bx(start_mark3600.:stop_mark3600.) + x + + bby(start_mark3600.:stop_mark3600.) = by(start_mark3600.:stop_mark3600.) + y + + bbz(start_mark3600.:stop_mark3600.) = bz(start_mark3600.:stop_mark3600.) + z + + bad = where(bx eq 32767,count) + + if count ne 0 then bbx(bad) = 32767 + + bad = where(by eq 32767,count) + + if count ne 0 then bby(bad) = 32767 + + bad = where(bz eq 32767,count) + + if count ne 0 then bbz(bad) = 32767 + + fss = start_mark3600.-10 + + fee = start_mark3600.+10 + + if fss lt 0 then fss=0 + + if fee gt 86399 then fee=86399 + + bbx(fss:fee) = 32767 + + bby(fss:fee) = 32767 + + bbz(fss:fee) = 32767 + + fss = stop_mark3600.-10 + + fee = stop_mark3600.+10 + + if fss lt 0 then fss=0 + + if fee gt 86399 then fee=86399 + + bbx(fss:fee) = 32767 + + bby(fss:fee) = 32767 + + bbz(fss:fee) = 32767 + + plot,t(ss:ee)/3600.,flag(bbx(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + plot,t(ss:ee)/3600.,flag(bby(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + plot,t(ss:ee)/3600.,flag(bbz(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + ss = stop_mark3600.-600. + + ee = stop_mark3600.+600. + + if ss lt 0 then ss=0 + + if ee gt 86399 then ee=86399 + + plot,t(ss:ee)/3600.,flag(bbx(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + plot,t(ss:ee)/3600.,flag(bby(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + plot,t(ss:ee)/3600.,flag(bbz(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2 + + endif else begin + + if keyword_set(oplot_only) then begin + + !p.multi=[3,1,3,2] + + ss = ss3600L + + ee = ee3600L-1 + + plot,t(ss:ee)/3600.,flag(bx(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle,/nodata + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + plot,t(ss:ee)/3600.,flag(by(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle,/nodata + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + plot,t(ss:ee)/3600.,flag(bz(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle,/nodata + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + endif else begin + + ss = ss3600L + + ee = ee3600L-1 + + plot,t(ss:ee)/3600.,flag(bx(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + plot,t(ss:ee)/3600.,flag(by(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + plot,t(ss:ee)/3600.,flag(bz(ss:ee)),max_val=100000,$ + + /xstyle,/ystyle + + oplot,[start_mark,start_mark],[-90000,90000],linestyle=2,color=20 + + oplot,[stop_mark,stop_mark],[-90000,90000],linestyle=2,color=140 + + endelse + + endelse + + !p.multi=0 + + end

Processing Software

maccs — 2007-07-25 21:24:50

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 11:	Line 11:
- step_view.pro - step_wid.pro - flag.pro	+ ["step_view.pro"] + ["step_wid.pro"] + ["flag.pro"]
Line 15:	Line 15:
- five_sec_avg.pro - five_sec_avg_fast_avg.pro (called by five_sec_avg.pro)	+ ["five_sec_avg.pro"] + ["five_sec_avg_fast_avg.pro"] (called by five_sec_avg.pro)
Line 20:	Line 20:
- sec_to_min.pro	+ ["sec_to_min.pro"]
Line 24:	Line 24:
- expandcode.pro - merge_files.pro - Nb. Requires an extra file "missing.1m", to substitute	+ ["expandcode.pro"] + ["merge_files.pro"] + Nb. Requires an extra file "["missing.1m"]", to substitute
Line 29:	Line 29:
- houravrg.pro	+ ["houravrg.pro"]
Line 31:	Line 31:
- findbeta.pro - strip.pro: - hour_read.pro - flag.pro - wid_draw.pro	+ ["findbeta.pro"] + ["strip.pro"] + ["hour_read.pro"] + ["flag.pro"] + ["wid_draw.pro"]

write maccs.pro

maccs — 2007-07-25 21:20:45

Differences for write maccs.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/6/07 + + ; write_maccs.pro, compiles and runs with idl + + ; called by igloolik_despike.pro (which creates despiked .s2 files) + ; called by five_sec_avg.pro (which creates 5 second average .5s files) + ; called by sec_to_min.pro (which creates 1 minute average .1m files) + + ; writes 5 different types of maccs data files: .1m (1 minute files), .1mg (1 month of 1 min files merged together in one file), .5sg (rotated 5 second files), .5s (5 second files), .s2 (cleaned files) + ; uses the type parameter to specify what type of file to write, Ex: type="1m" + ; all parameters are required + + + + + + pro write_maccs,filename,bx,by,bz,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1,type=type + + + + case type of + + '1m':begin + + new_data=bytarr(14,1440) + + for j=0,1439 do begin + + hr=floor(j60./3600.) + + mi=floor((j60.-hr3600.)/60.) + + ; writeu,unit2,byte(hr),byte(mi),long(bx(j)1000),long(by(j)1000),long(bz(j)1000) + + new_data(,j)=byte([byte(hr),byte(mi),$ + + reform(byte(long(bx(j)1000),0,1,4)),$ + + reform(byte(long(by(j)1000),0,1,4)),$ + + reform(byte(long(bz(j)1000),0,1,4))],0,1,14) + + endfor + + openw,unit2,filename,/get_lun + + writeu,unit2,new_data + + free_lun,unit2 + + end + + '1mg':begin + + new_data=bytarr(14,1440) + + for j=0,1439 do begin + + hr=floor(j60./3600.) + + mi=floor((j60.-hr3600.)/60.) + + ; writeu,unit2,byte(hr),byte(mi),long(bx(j)1000),long(by(j)1000),long(bz(j)1000) + + new_data(,j)=byte([byte(hr),byte(mi),$ + + reform(byte(long(bx(j)1000),0,1,4)),$ + + reform(byte(long(by(j)1000),0,1,4)),$ + + reform(byte(long(bz(j)1000),0,1,4))],0,1,14) + + endfor + + openw,unit2,filename,/get_lun + + writeu,unit2,new_data + + free_lun,unit2 + + end + + '5sg':begin + + openw,unit2,filename,/get_lun + + for j=0,17279 do begin + + hr=floor(j5./3600.) + + mi=floor((j5.-hr3600.)/60.) + + se=j5.-(hr3600.+mi60.) + + writeu,unit2,byte(hr),byte(mi),byte(se),long(bx(j)1000),long(by(j)1000),long(bz(j)1000) + + endfor + + free_lun,unit2 + + end + + '5s':begin + + openw,unit2,filename,/get_lun + + for j=0,17279 do begin + + hr=floor(j5./3600.) + + mi=floor((j5.-hr3600.)/60.) + + se=j5-(hr3600.+mi60.) + + writeu,unit2,byte(hr),byte(mi),byte(se),long(bx(j)1000),long(by(j)1000),long(bz(j)1000) + + endfor + + free_lun,unit2 + + end + + 's2':begin + + openw,unit2,filename,/get_lun + + for j=0L,86399L do begin + + hr=floor(j/3600.) + + mi=floor((j-hr3600.)/60.) + + se=j-(hr3600.+mi60.) + + writeu,unit2,byte(tf1(j)),byte(hr),byte(mi),byte(se),$ + + long(bx(j)1000),long(bx2(j)1000),$ + + long(by(j)1000),long(by2(j)1000),$ + + long(bz(j)1000),long(bz2(j)*1000) + + ;if j eq 86399L then begin + + ; print, bx(j),long(bx(j)),tf1(j),byte(tf1(j)),byte(hr),byte(mi),byte(se) + + ; help, bx, tf1, hr, mi, se + + ;endif + + endfor + + free_lun,unit2 + + end + + endcase + + print,'done writing' + + end

read maccs.pro

maccs — 2007-07-25 21:19:28

Differences for read maccs.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/16/07 + + ; read_maccs.pro, compiles and runs with idl + + ; called by igloolik_despike.pro (which creates despiked .s2 files) + ; called by five_sec_avg.pro (which creates 5 second average .5s files) + ; called by sec_to_min.pro (which creates 1 minute average .1m files) + + ; reads 5 different types of maccs data: raw maccs, cleaned maccs, raw gsc, cleaned gsc, 5 sec & 1 min + + ; GSC = Geological Survey of Canada (The Geomagnetic Monitoring Service of the GSC operates a network of 13 Magnetic Observatories across Canada which includes all CANMOS magnetometers and the Alert magnetometer. It used to operate the Mould Bay magnetometer which is now closed.) + ; calculates and returns time + + ; stores the data in variables and returns them + ; the only required parameter is the filename unless it is a raw file (then raw must be set to 1 or 2) + ; Ex: read_maccs, "CD04025.s2" + ; if you set the diag parameter (diag="something") it outputs the following to the command line: + ; ***************************************************************************** + ; if you are reading a raw file you must set the raw parameter to 1 for a maccs file or 2 for a gsc file. + + ; to prevent the program from printing the name of the file it is processing: quiet="something" + ; If you set the nt parameter (ex: nt="nt") the field values will be divided by 1000 to get the values in nanoteslas. + + ; Ex: read_maccs, "/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2007ir/CD07193.dat", diag="bob", raw=1, nt="nanoT", quiet="please" + + + pro read_maccs,filename,time,bx1,by1,bz1,type,raw=raw,nt=nt,$ + + bx2=bx2,by2=by2,bz2=bz2,tf1=tf1,int=int,diag=diag,quiet=quiet,block=block + + + + ; set the keyword raw to 1 for raw maccs and to 2 for raw gsc + + + + ; x and y are the byte dimensions of the file. The order for the different file + + ; types is raw maccs, raw gsc, cleaned maccs, cleaned gsc, 5 sec, and 1 min + + ; (the raw files do not have fixed length) + + + + x = [35, 21, 28, 15, 15, 14] + + y = [00, 00, 86400L, 86400L, 17280L, 1440L] + + sizes = [00, 00, 2419200L, 1296000L, 259200L, 20160L] + + + + ; Open file and get file size + + + + if not keyword_set(quiet) then print,'Now processing ',filename + + openr,unit,filename,error=err,/get_lun + + if err ne 0 then print,'no file ',filename + + file_info = fstat(unit) + + file_size = file_info.size + + + + + + if keyword_set(raw) then begin + + type = raw - 1 + + if raw eq 1 then y(0) = file_size / x(0) + + if raw eq 2 then y(1) = file_size / x(1) + + endif else begin + + type = where(file_size eq sizes, count) + + if count eq 0 then begin + + print,'Error in file size.' + + stop + + endif else type = type(0) + + endelse + + + + if (err eq 0) then begin + + m=x(type) + + n=y(type) + + data_array = bytarr(m,n) + + readu,unit,data_array + + free_lun,unit + + endif else begin + + print,'An error has occurred while trying to read.' + + stop + + endelse + + + + ; Extract the individual data arrays from the file byte array. Also, divide + + ; the field values by 1000. to get nanotesla. + + + + ; all files + + + + offset = [3, 2, 1, 0, 0, 0] + + + + hh = data_array(offset(type) + 0,) + + mm = data_array(offset(type) + 1,) + + offset(5) = -1 + + bx1 = long(data_array(offset(type) + 3:offset(type) + 6,),0,1,y(type)) + + by1 = long(data_array(offset(type) + 7:offset(type) + 10,),0,1,y(type)) + + bz1 = long(data_array(offset(type) + 11:offset(type) + 14,),0,1,y(type)) + + + + case type of + + 5: ss = 0 + + 4: ss = data_array(2,) ; 5 sec + + 3: ss = data_array(2,) ; gsc clean + + 2: begin ; maccs clean + + tf1 = data_array(0,) + + ss = data_array(3,) + + bx1 = long(data_array(04:07,),0,1,y(type)) + + bx2 = long(data_array(08:11,),0,1,y(type)) + + by1 = long(data_array(12:15,),0,1,y(type)) + + by2 = long(data_array(16:19,),0,1,y(type)) + + bz1 = long(data_array(20:23,),0,1,y(type)) + + bz2 = long(data_array(24:27,),0,1,y(type)) + + end + + 1: begin ; gsc raw + + dd = fix (data_array( 0: 1,),0,1,y(type)) + + ss = data_array(4,) + + end + + 0: begin ; maccs raw + + header= data_array( 0,) + + dd = fix (data_array( 1: 2,),0,1,y(type)) + + ss = data_array(5,) + + bx2 = long(data_array(18:21,),0,1,y(type)) + + print, bx2(10) + + by2 = long(data_array(22:25,),0,1,y(type)) + + print, by2(10) + + bz2 = long(data_array(26:29,),0,1,y(type)) + + print, bz2(10) + + tf1 = data_array(30,) + + tf2 = data_array(31,) + + block = data_array(32,) + + status= data_array(33,) + + house = data_array(34,) + + end + + endcase + + + + time = hh3600. + mm60. + ss + + if keyword_set(int) then begin + + good = where(bx1 ne 32767000,count) + + if count gt 0 then bx1=interpol(bx1(good),time(good),time) + + good = where(by1 ne 32767000,count) + + if count gt 0 then bx1=interpol(by1(good),time(good),time) + + good = where(bz1 ne 32767000,count) + + if count gt 0 then bx1=interpol(bz1(good),time(good),time) + + endif + + if keyword_set(nt) then begin + + bx1 = bx1/1000. + + by1 = by1/1000. + + bz1 = bz1/1000. + + if type eq 2 then begin + + bx2 = bx2/1000. + + by2 = by2/1000. + + bz2 = bz2/1000. + + endif + + endif + + if keyword_set(diag) then print,bx1(0:10),format='(11f7.1)' + + end + + + + + + + + + + + + + + + + + +

igloolik despike.pro

maccs — 2007-07-25 21:17:52

Differences for igloolik despike.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/5/07 + ; igloolik_despike.pro, compiles and runs with idl + ; needs read_maccs.pro & write_maccs.pro to run + ; input must be cleaned MACCS binary .s2 data file(s) (it accepts original files & despiked files) + ; output is a despiked binary version of the cleaned data + ; if the output directory is the same as the input directory the original cleaned file(s) is/are replaced by the despiked version(s) + ; example file names: if input file is CD05004.s2, output file is CD05004.s2 + ; to compile & run: igloolik_despike, "name_of_input_file(s)", "/path_to_input_file(s)/", "/path_to_output_directory/" (you can use * and ?) + ; to display windows with graphs (after the first 2 graphs appear, close the windows (bottom graph first) to display the next graph): view="something" (WARNING: If the input file has not been despiked and the view parameter is set, it will display hundreds of graphs that you have to click through one at a time before it outputs a despiked file. Also, if you click through the graphs too quickly it will have a bus error and exit IDL.) + ; the spikeview parameter is not used in the program + ; Example: igloolik_despike, "CD05*.s2", "/Volumes/physics_data/Ftp/MACCS_DATA/Clean/CD/2005/", "/Volumes/physics_data/Ftp/MACCS_DATA/Despiked/CD/2005/", view="view" + + PRO igloolik_despike,File_Specification,in_dir,out_dir,view=view,spikeview=spikeview + + !p.multi=[0,0,3] + + window,0 + + window,1 + + ; OLD files=findfile(in_dir+file) + + files=FINDFILE(FILEPATH(File_Specification, ROOT_DIR = in_dir)) + + FOR j = 0, n_elements(files)-1 DO BEGIN + + read_maccs,files(j),t,bx,by,bz,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1,/nt + + + + x_diff = abs(bx(1:86399) - bx(0:86398)) + + y_diff = abs(by(1:86399) - by(0:86398)) + + z_diff = abs(bz(1:86399) - bz(0:86398)) + + spikes = where((x_diff gt 10 and x_diff lt 10000) $ + + or (y_diff gt 10 and y_diff lt 10000) $ + + or (z_diff gt 10 and z_diff lt 10000)) + + index=where(spikes gt 11 and spikes lt 86388,count) + + if count lt 2 then goto, next + + spikes=spikes(index) + + spike_diff = spikes(1:n_elements(spikes)-1) - spikes(0:n_elements(spikes)-2) + + repeats=where(spike_diff gt 2) + + spikes=spikes(repeats+1) + + + + + + if keyword_set(view) then begin + + wset,0 + + plot,bx,max_val=30000,/ystyle + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[-20000,bx(spikes(i))-20],linestyle=2 + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[bx(spikes(i))+20,20000],linestyle=2 + + plot,by,max_val=30000,/ystyle + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[-20000,by(spikes(i))-20],linestyle=2 + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[by(spikes(i))+20,20000],linestyle=2 + + plot,bz,min_val=40000,/ystyle + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[-20000,bz(spikes(i))-20],linestyle=2 + + for i = 0, n_elements(spikes)-1 do $ + + oplot,[spikes(i),spikes(i)],[bz(spikes(i))+20,60000],linestyle=2 + + + + wset,1 + + for k = 0, n_elements(spikes)-1 do begin + + print,spikes(k) + + if (spikes(k) gt 101 and spikes(k) lt 86298) then begin + + plot,bx(spikes(k)-100:spikes(k)+100),max_val=30000,/ystyle + + oplot,[90,90],[-20000,20000],linestyle=2 + + oplot,[110,110],[-20000,20000],linestyle=2 + + plot,by(spikes(k)-100:spikes(k)+100),max_val=30000,/ystyle + + plot,bz(spikes(k)-100:spikes(k)+100),min_val=40000,/ystyle + + cursor,x,y,/up + + endif + + ; read,junk + + endfor + + endif + + ;plot,bx(spikes(25)-100:spikes(25)+100),max_val=30000,/ystyle + + ;oplot,[spikes(25),spikes(25)],[-20000,20000],linestyle=2 + + ;read,junk + + + + for i = 0, n_elements(spikes)-1 do begin + + bx(spikes(i)-10:spikes(i)+10)=32767 + + by(spikes(i)-10:spikes(i)+10)=32767 + + bz(spikes(i)-10:spikes(i)+10)=32767 + + bx2(spikes(i)-10:spikes(i)+10)=32767 + + by2(spikes(i)-10:spikes(i)+10)=32767 + + bz2(spikes(i)-10:spikes(i)+10)=32767 + + endfor + + + + files(j)=strmid(files(j),strpos(files(j),'.')-7,10) + + ; OLD print,out_dir+files(j) + + ; OLD write_maccs,out_dir+files(j),bx,by,bz,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1,type='s2' + + + + PRINT,FILEPATH(files(j), ROOT_DIR = out_dir) + + write_maccs,FILEPATH(files(j), ROOT_DIR = out_dir) ,bx,by,bz,bx2=bx2,by2=by2,bz2=bz2,tf1=tf1,type='s2' + + next: + + ENDFOR + + ;stop + + !p.multi=0 + + END +

Processing Software

maccs — 2007-07-25 21:16:53

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 7:	Line 7:
- igloolik_despike.pro - read_maccs.pro (called by igllolik_despike.pro) - write_maccs.pro (called by igllolik_despike.pro)	+ ["igloolik_despike.pro"] + ["read_maccs.pro"] (called by igllolik_despike.pro) + ["write_maccs.pro"] (called by igllolik_despike.pro)
Line 17:	Line 17:
- read_maccs.pro (called by five_sec_avg.pro) - write_maccs.pro (called by five_sec_avg.pro)	+ ["read_maccs.pro"] (called by five_sec_avg.pro) + ["write_maccs.pro"] (called by five_sec_avg.pro)
Line 21:	Line 21:
- read_maccs.pro (called by sec_to_min.pro) - write_maccs.pro (called by sec_to_min.pro)	+ ["read_maccs.pro"] (called by sec_to_min.pro) + ["write_maccs.pro"] (called by sec_to_min.pro)

strip.pro

maccs — 2007-07-25 21:14:16

Differences for strip.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ ; Comments added by Erik Johnson 7/3/07 + ; strip.pro, compiles and runs with idl + ; called by cleaner.pro (which creates clean .s2 files) + + function strip,str + + + + new_str = strcompress(string(str),/remove_all) + + + + return, new_str + + + + end

Processing Software

maccs — 2007-07-25 21:13:45

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 5:	Line 5:
- [[File(strip.pro)]] (called by cleaner.pro)	+ ["strip.pro"] (called by cleaner.pro)

Processing Software

maccs — 2007-07-25 21:11:37

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 5:	Line 5:
- strip.pro (called by cleaner.pro)	+ [[File(strip.pro)]] (called by cleaner.pro)

Processing Software

maccs — 2007-07-25 21:10:58

Upload of file strip.pro.

Processing Software

maccs — 2007-07-25 21:09:58

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 3:	Line 3:
- *The IDL program used in the clean step	+ *The IDL programs used in the clean step
Line 6:	Line 6:
- *The IDL program used in the despike step	+ *The IDL programs used in the despike step
Line 10:	Line 10:
- *The IDL program used in the manual step of removing spikes	+ *The IDL programs used in the manual step of removing spikes
Line 14:	Line 14:
- *The IDL program used in the 1/2 sec to 5 sec avg step	+ *The IDL programs used in the 1/2 sec to 5 sec avg step
Line 19:	Line 19:
- *The IDL program used in the 5sec to 1 min avg step	+ *The IDL programs used in the 5sec to 1 min avg step
Line 23:	Line 23:
- *The IDL program used to merge all 1 min files in 1 big file	+ *The IDL programs used to merge all 1 min files in 1 big file
Line 28:	Line 28:
- *The IDL program used in the 1 min merged files to 1 hour avg step	+ *The IDL programs used in the 1 min merged files to 1 hour avg step
Line 30:	Line 30:
- *The IDL program used in prepare the baselines for rotation	+ *The IDL programs used in prepare the baselines for rotation
Line 36:	Line 36:
- *The IDL program used in the rotate step	+ *The IDL programs used in the rotate step

Processing Software

maccs — 2007-07-25 21:04:45

Edited By Erik Johnson 7/25/07

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 5:	Line 5:
- strip.pro	+ strip.pro (called by cleaner.pro)
Line 8:	Line 8:
- read_maccs.pro - write_maccs.pro	+ read_maccs.pro (called by igllolik_despike.pro) + write_maccs.pro (called by igllolik_despike.pro)
Line 15:	Line 15:
- five_sec_avg_fast_avg.pro
Line 17:	Line 16:
	+ five_sec_avg_fast_avg.pro (called by five_sec_avg.pro) + read_maccs.pro (called by five_sec_avg.pro) + write_maccs.pro (called by five_sec_avg.pro)
Line 18:	Line 20:
- sec_to_min_fast_avg.pro
Line 20:	Line 21:
	+ read_maccs.pro (called by sec_to_min.pro) + write_maccs.pro (called by sec_to_min.pro)
Line 25:	Line 28:
- The IDL program used in the 1 min merged files to 1 hour avg step	+ *The IDL program used in the 1 min merged files to 1 hour avg step
Line 34:	Line 37:
	+ ?

Realtime Plots

maccs — 2007-07-25 19:04:27

Differences for Realtime Plots

No differences found!

Realtime Plots

maccs — 2007-07-25 19:04:04

Differences for Realtime Plots

No differences found!

Realtime Plots

maccs — 2007-07-25 18:40:34

Differences for Realtime Plots

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
- - [[Image(nain_current.jpg)]]	+ [http://engineering.dartmouth.edu/~david_murr/mic/nain_current.png]

Realtime Plots

maccs — 2007-07-25 18:39:21

Differences for Realtime Plots

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ + [[Image(nain_current.jpg)]]

Front Page

maccs — 2007-07-24 21:16:10

Upload of image pang1.jpg.

Front Page

maccs — 2007-07-24 21:15:43

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 2:	Line 2:
	+ + [[Image(pang1.jpg)]]

cleaner.pro

maccs — 2007-07-24 21:09:50

Differences for cleaner.pro

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ cleaner.pro, compiles and runs with idl + + needs strip.pro to run + + input must be raw MACCS data file(s) + + output is a cleaned binary version of the raw data with filetype .s2 + + example: if input file is CD05.4, output file is CD05004.s2 + + to compile & run: cleaner, "path_and_name_of_raw_data_file(s)" (you can use * and ?) + + default output directory is e:\ + + to set output directory: out_dir="output_directory" + + to display a window with a graph: view="view" + + to create summary text file(s) containg the command line output: summary="summary" + + to save the .s2 file(s) in a subdirectory folder (which must already exist): month_str="sub_dir_name" + + to move the raw file(s) after creating the clean file(s): move="path" (if you used the month_str parameter, the file(s) will be moved to the subdirectory within the folder you specified for the move directory) Ex: if parameters are month_str="Jan05/", move="/Volumes/MACCS_DATA/" then raw file(s) will be moved to /Volumes/MACCS_DATA/Jan05/ + + the click parameter should not be used unless changes are made to the program + + Example: cleaner, "/Volumes/physics_data/Ftp/MACCS_DATA/Raw/CD/2005/CD05.4", out_dir="/Users/johnson8/maccs/", summary="summary", month_str="Jan05/", move="/Users/johnson8/Desktop/", view="view"

Processing Software

maccs — 2007-07-24 21:09:40

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 4:	Line 4:
- [cleaner.pro]	+ ["cleaner.pro"]

Processing Software

maccs — 2007-07-24 21:09:26

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 4:	Line 4:
- cleaner.pro	+ [cleaner.pro]

Processing Software

maccs — 2007-07-24 21:08:00

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 7:	Line 7:
- igloolik_despike.pro - read_maccs.pro - write_maccs.pro - The IDL program used in the manual step of removing spikes - step_view.pro - step_wid.pro - flag.pro - The IDL program used in the 1/2 sec to 5 sec avg step - five_sec_avg_fast_avg.pro - five_sec_avg.pro - The IDL program used in the 5sec to 1 min avg step - sec_to_min_fast_avg.pro - sec_to_min.pro - The IDL program used to merge all 1 min files in 1 big file - expandcode.pro - merge_files.pro - Nb. Requires an extra file "missing.1m", to substitute - missing days	+ igloolik_despike.pro + read_maccs.pro + write_maccs.pro + The IDL program used in the manual step of removing spikes + step_view.pro + step_wid.pro + flag.pro + The IDL program used in the 1/2 sec to 5 sec avg step + five_sec_avg_fast_avg.pro + five_sec_avg.pro + The IDL program used in the 5sec to 1 min avg step + sec_to_min_fast_avg.pro + sec_to_min.pro + The IDL program used to merge all 1 min files in 1 big file + expandcode.pro + merge_files.pro + Nb. Requires an extra file "missing.1m", to substitute + missing days
Line 26:	Line 26:
- houravrg.pro - The IDL program used in prepare the baselines for rotation - findbeta.pro - strip.pro: - hour_read.pro - flag.pro - wid_draw.pro - The IDL program used in the rotate step	+ houravrg.pro + The IDL program used in prepare the baselines for rotation + findbeta.pro + strip.pro: + hour_read.pro + flag.pro + wid_draw.pro + The IDL program used in the rotate step

Processing Software

maccs — 2007-07-24 21:06:46

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 4:	Line 4:
- cleaner.pro - strip.pro	+ cleaner.pro + strip.pro

Processing Software

maccs — 2007-07-24 21:06:14

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 3:	Line 3:
- 1. The IDL program used in the clean step	+ *The IDL program used in the clean step
Line 6:	Line 6:
- 2. The IDL program used in the despike step	+ *The IDL program used in the despike step

Processing Software

maccs — 2007-07-24 21:05:31

Differences for Processing Software

Deletions are marked with - .	Additions are marked with +.
Line 1:	Line 1:
	+ Describe Processing Software here. + + 1. The IDL program used in the clean step + cleaner.pro + strip.pro + 2. The IDL program used in the despike step + igloolik_despike.pro + read_maccs.pro + write_maccs.pro + The IDL program used in the manual step of removing spikes + step_view.pro + step_wid.pro + flag.pro + The IDL program used in the 1/2 sec to 5 sec avg step + five_sec_avg_fast_avg.pro + five_sec_avg.pro + The IDL program used in the 5sec to 1 min avg step + sec_to_min_fast_avg.pro + sec_to_min.pro + The IDL program used to merge all 1 min files in 1 big file + expandcode.pro + merge_files.pro + Nb. Requires an extra file "missing.1m", to substitute + missing days + The IDL program used in the 1 min merged files to 1 hour avg step + houravrg.pro + The IDL program used in prepare the baselines for rotation + findbeta.pro + strip.pro: + hour_read.pro + flag.pro + wid_draw.pro + The IDL program used in the rotate step

Front Page

2007-07-24 20:58:27

Differences for Front Page

Deletions are marked with - .	Additions are marked with +.
Line 4:	Line 4:
- 1. First read the rest of this page!	+ 1. First read the rest of this page!!