##// END OF EJS Templates
schain
RSS
Update2 for EW-Drifts
Update2 for EW-Drifts
Percy Condor - - Load All Authors

File last commit:

r1383:3e971ac8dea1
r1383:3e971ac8dea1
Show More
jroIO_heispectra.py
850 lines | 25.0 KiB | text/x-python | PythonLexer
/ schainpy / model / io / jroIO_heispectra.py
History | Source | Raw |Copy content |Copy permalink
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 '''
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 Created on Jul 3, 2014
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 @author: roj-idl71
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 '''
import os, sys
import time, datetime
import numpy
import fnmatch
import glob
Miguel Valdez
Version 2.1.3: ...
 r664 from time import sleep
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 try:
import pyfits
George Yong
Python 2to3, Spectra (all operations) working
 r1167 except ImportError as e:
Juan C. Espinoza
Fix CLI and remove imports warnings
 r1284 pass
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 from xml.etree.ElementTree import ElementTree
George Yong
Python 2to3, Spectra (all operations) working
 r1167 from .jroIO_base import isRadarFolder, isNumber
Miguel Valdez
Version 2.1.3: ...
 r664 from schainpy.model.data.jrodata import Fits
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 from schainpy.model.proc.jroproc_base import Operation, ProcessingUnit, MPDecorator
from schainpy.utils import log
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
class PyFits(object):
Percy Condor
Update2 for EW-Drifts
 r1383 name = None
format = None
array = None
data = None
thdulist = None
prihdr = None
hdu = None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 def __init__(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 pass
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def setColF(self, name, format, array):
self.name = name
self.format = format
self.array = array
a1 = numpy.array([self.array], dtype=numpy.float32)
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.col1 = pyfits.Column(name=self.name, format=self.format, array=a1)
return self.col1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 # def setColP(self,name,format,data):
# self.name=name
# self.format=format
# self.data=data
# a2=numpy.array([self.data],dtype=numpy.float32)
# self.col2 = pyfits.Column(name=self.name, format=self.format, array=a2)
# return self.col2
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568
Percy Condor
Update2 for EW-Drifts
 r1383 def writeData(self, name, format, data):
self.name = name
self.format = format
self.data = data
a2 = numpy.array([self.data], dtype=numpy.float32)
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.col2 = pyfits.Column(name=self.name, format=self.format, array=a2)
return self.col2
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def cFImage(self, idblock, year, month, day, hour, minute, second):
self.hdu = pyfits.PrimaryHDU(idblock)
self.hdu.header.set("Year", year)
self.hdu.header.set("Month", month)
self.hdu.header.set("Day", day)
self.hdu.header.set("Hour", hour)
self.hdu.header.set("Minute", minute)
self.hdu.header.set("Second", second)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 return self.hdu
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568
Percy Condor
Update2 for EW-Drifts
 r1383 def Ctable(self, colList):
self.cols = pyfits.ColDefs(colList)
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.tbhdu = pyfits.new_table(self.cols)
return self.tbhdu
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def CFile(self, hdu, tbhdu):
self.thdulist = pyfits.HDUList([hdu, tbhdu])
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def wFile(self, filename):
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 if os.path.isfile(filename):
os.remove(filename)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.thdulist.writeto(filename)
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
class ParameterConf:
ELEMENTNAME = 'Parameter'
def __init__(self):
self.name = ''
self.value = ''
def readXml(self, parmElement):
self.name = parmElement.get('name')
self.value = parmElement.get('value')
def getElementName(self):
return self.ELEMENTNAME
Miguel Valdez
Version 2.1.3: ...
 r664 class Metadata(object):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __init__(self, filename):
self.parmConfObjList = []
self.readXml(filename)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readXml(self, filename):
self.projectElement = None
self.procUnitConfObjDict = {}
self.projectElement = ElementTree().parse(filename)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.project = self.projectElement.tag
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
parmElementList = self.projectElement.getiterator(ParameterConf().getElementName())
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 for parmElement in parmElementList:
parmConfObj = ParameterConf()
parmConfObj.readXml(parmElement)
self.parmConfObjList.append(parmConfObj)
Juan C. Espinoza
Rewrite controller, remove MPDecorator to units (keep for plots an writers) use of queues for interproc comm instead of zmq, self operations are no longer supported
 r1287 @MPDecorator
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 class FitsWriter(Operation):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 def __init__(self, **kwargs):
Operation.__init__(self, **kwargs)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.isConfig = False
self.dataBlocksPerFile = None
self.blockIndex = 0
self.flagIsNewFile = 1
self.fitsObj = None
self.optchar = 'P'
self.ext = '.fits'
self.setFile = 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 def setFitsHeader(self, dataOut, metadatafile=None):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header_data = pyfits.PrimaryHDU()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 header_data.header['EXPNAME'] = "RADAR DATA"
header_data.header['DATATYPE'] = "SPECTRA"
header_data.header['COMMENT'] = ""
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 if metadatafile:
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 metadata4fits = Metadata(metadatafile)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 for parameter in metadata4fits.parmConfObjList:
parm_name = parameter.name
parm_value = parameter.value
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 header_data.header[parm_name] = parm_value
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header_data.header['DATETIME'] = time.strftime("%b %d %Y %H:%M:%S", dataOut.datatime.timetuple())
header_data.header['CHANNELLIST'] = str(dataOut.channelList)
header_data.header['NCHANNELS'] = dataOut.nChannels
Percy Condor
Update2 for EW-Drifts
 r1383 # header_data.header['HEIGHTS'] = dataOut.heightList
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header_data.header['NHEIGHTS'] = dataOut.nHeights
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header_data.header['IPPSECONDS'] = dataOut.ippSeconds
header_data.header['NCOHINT'] = dataOut.nCohInt
header_data.header['NINCOHINT'] = dataOut.nIncohInt
header_data.header['TIMEZONE'] = dataOut.timeZone
header_data.header['NBLOCK'] = self.blockIndex
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header_data.writeto(self.filename)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 self.addExtension(dataOut.heightList, 'HEIGHTLIST')
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 def setup(self, dataOut, path, dataBlocksPerFile=100, metadatafile=None):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.path = path
self.dataOut = dataOut
self.metadatafile = metadatafile
self.dataBlocksPerFile = dataBlocksPerFile
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def open(self):
self.fitsObj = pyfits.open(self.filename, mode='update')
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def addExtension(self, data, tagname):
self.open()
extension = pyfits.ImageHDU(data=data, name=tagname)
Percy Condor
Update2 for EW-Drifts
 r1383 # extension.header['TAG'] = tagname
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.fitsObj.append(extension)
self.write()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def addData(self, data):
self.open()
extension = pyfits.ImageHDU(data=data, name=self.fitsObj[0].header['DATATYPE'])
extension.header['UTCTIME'] = self.dataOut.utctime
self.fitsObj.append(extension)
self.blockIndex += 1
self.fitsObj[0].header['NBLOCK'] = self.blockIndex
self.write()
def write(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.fitsObj.flush(verbose=True)
self.fitsObj.close()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def setNextFile(self):
ext = self.ext
path = self.path
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 timeTuple = time.localtime(self.dataOut.utctime)
subfolder = 'd%4.4d%3.3d' % (timeTuple.tm_year, timeTuple.tm_yday)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
Percy Condor
Update2 for EW-Drifts
 r1383 fullpath = os.path.join(path, subfolder)
if not(os.path.exists(fullpath)):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 os.mkdir(fullpath)
Percy Condor
Update2 for EW-Drifts
 r1383 self.setFile = -1 # inicializo mi contador de seteo
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 else:
Percy Condor
Update2 for EW-Drifts
 r1383 filesList = os.listdir(fullpath)
if len(filesList) > 0:
filesList = sorted(filesList, key=str.lower)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 filen = filesList[-1]
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 if isNumber(filen[8:11]):
self.setFile = int(filen[8:11]) # inicializo mi contador de seteo al seteo del ultimo file
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 else:
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.setFile = -1
else:
Percy Condor
Update2 for EW-Drifts
 r1383 self.setFile = -1 # inicializo mi contador de seteo
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 setFile = self.setFile
setFile += 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 thisFile = '%s%4.4d%3.3d%3.3d%s' % (self.optchar,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 timeTuple.tm_year,
timeTuple.tm_yday,
setFile,
Percy Condor
Update2 for EW-Drifts
 r1383 ext)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
Percy Condor
Update2 for EW-Drifts
 r1383 filename = os.path.join(path, subfolder, thisFile)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.blockIndex = 0
self.filename = filename
self.setFile = setFile
self.flagIsNewFile = 1
Percy Condor
Update2 for EW-Drifts
 r1383 print('Writing the file: %s' % self.filename)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.setFitsHeader(self.dataOut, self.metadatafile)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 1
def writeBlock(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.addData(self.dataOut.data_spc)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.flagIsNewFile = 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __setNewBlock(self):
if self.flagIsNewFile:
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.blockIndex < self.dataBlocksPerFile:
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 if not(self.setNextFile()):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 1
def writeNextBlock(self):
Percy Condor
Update2 for EW-Drifts
 r1383 if not(self.__setNewBlock()):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 0
self.writeBlock()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 return 1
def putData(self):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.flagIsNewFile:
self.setNextFile()
self.writeNextBlock()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
José Chávez
reworked
 r954 def run(self, dataOut, path, dataBlocksPerFile=100, metadatafile=None, **kwargs):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(self.isConfig):
José Chávez
reworked
 r954 self.setup(dataOut, path, dataBlocksPerFile=dataBlocksPerFile, metadatafile=metadatafile, **kwargs)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.isConfig = True
self.putData()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Juan C. Espinoza
Rewrite controller, remove MPDecorator to units (keep for plots an writers) use of queues for interproc comm instead of zmq, self operations are no longer supported
 r1287
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 class FitsReader(ProcessingUnit):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 # __TIMEZONE = time.timezone
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 expName = None
datetimestr = None
utc = None
nChannels = None
nSamples = None
dataBlocksPerFile = None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 comments = None
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 lastUTTime = None
header_dict = None
data = None
data_header_dict = None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def __init__(self): # , **kwargs):
ProcessingUnit.__init__(self) # , **kwargs)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.isConfig = False
self.ext = '.fits'
self.setFile = 0
self.flagNoMoreFiles = 0
self.flagIsNewFile = 1
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.flagDiscontinuousBlock = None
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.fileIndex = None
self.filename = None
self.fileSize = None
self.fitsObj = None
self.timeZone = None
self.nReadBlocks = 0
self.nTotalBlocks = 0
self.dataOut = self.createObjByDefault()
Percy Condor
Update2 for EW-Drifts
 r1383 self.maxTimeStep = 10 # deberia ser definido por el usuario usando el metodo setup()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.blockIndex = 1
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def createObjByDefault(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 dataObj = Fits()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return dataObj
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def isFileinThisTime(self, filename, startTime, endTime, useLocalTime=False):
try:
Percy Condor
Update2 for EW-Drifts
 r1383 fitsObj = pyfits.open(filename, 'readonly')
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 except:
Percy Condor
Update2 for EW-Drifts
 r1383 print("File %s can't be opened" % (filename))
Miguel Valdez
-Using ValueError raises instead of IOError...
 r684 return None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 header = fitsObj[0].header
struct_time = time.strptime(header['DATETIME'], "%b %d %Y %H:%M:%S")
Percy Condor
Update2 for EW-Drifts
 r1383 utc = time.mktime(struct_time) - time.timezone # TIMEZONE debe ser un parametro del header FITS
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 ltc = utc
if useLocalTime:
ltc -= time.timezone
thisDatetime = datetime.datetime.utcfromtimestamp(ltc)
thisTime = thisDatetime.time()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not ((startTime <= thisTime) and (endTime > thisTime)):
return None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return thisDatetime
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __setNextFileOnline(self):
Miguel Valdez
-Using ValueError raises instead of IOError...
 r684 raise NotImplementedError
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __setNextFileOffline(self):
idFile = self.fileIndex
while (True):
idFile += 1
if not(idFile < len(self.filenameList)):
self.flagNoMoreFiles = 1
George Yong
Python 2to3, Spectra (all operations) working
 r1167 print("No more Files")
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 0
filename = self.filenameList[idFile]
# if not(self.__verifyFile(filename)):
# continue
fileSize = os.path.getsize(filename)
Percy Condor
Update2 for EW-Drifts
 r1383 fitsObj = pyfits.open(filename, 'readonly')
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 break
self.flagIsNewFile = 1
self.fileIndex = idFile
self.filename = filename
self.fileSize = fileSize
self.fitsObj = fitsObj
self.blockIndex = 0
Percy Condor
Update2 for EW-Drifts
 r1383 print("Setting the file: %s" % self.filename)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Signal Chain GUI updated:...
 r587 def __setValuesFromHeader(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
self.dataOut.header = self.header_dict
Miguel Valdez
Signal Chain GUI updated:...
 r587 self.dataOut.expName = self.expName
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Signal Chain GUI updated:...
 r587 self.dataOut.timeZone = self.timeZone
self.dataOut.dataBlocksPerFile = self.dataBlocksPerFile
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.dataOut.comments = self.comments
Miguel Valdez
Signal Chain GUI updated:...
 r587 # self.dataOut.timeInterval = self.timeInterval
self.dataOut.channelList = self.channelList
self.dataOut.heightList = self.heightList
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Signal Chain GUI updated:...
 r587 self.dataOut.nCohInt = self.nCohInt
self.dataOut.nIncohInt = self.nIncohInt
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 self.dataOut.ipp_sec = self.ippSeconds
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readHeader(self):
headerObj = self.fitsObj[0]
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.header_dict = headerObj.header
George Yong
Python 2to3, Spectra (all operations) working
 r1167 if 'EXPNAME' in list(headerObj.header.keys()):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.expName = headerObj.header['EXPNAME']
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
George Yong
Python 2to3, Spectra (all operations) working
 r1167 if 'DATATYPE' in list(headerObj.header.keys()):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.dataType = headerObj.header['DATATYPE']
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.datetimestr = headerObj.header['DATETIME']
channelList = headerObj.header['CHANNELLIST']
channelList = channelList.split('[')
channelList = channelList[1].split(']')
channelList = channelList[0].split(',')
channelList = [int(ch) for ch in channelList]
self.channelList = channelList
self.nChannels = headerObj.header['NCHANNELS']
self.nHeights = headerObj.header['NHEIGHTS']
self.ippSeconds = headerObj.header['IPPSECONDS']
self.nCohInt = headerObj.header['NCOHINT']
self.nIncohInt = headerObj.header['NINCOHINT']
self.dataBlocksPerFile = headerObj.header['NBLOCK']
self.timeZone = headerObj.header['TIMEZONE']
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
JRODATA: timeInterval is a property now...
 r527 # self.timeInterval = self.ippSeconds * self.nCohInt * self.nIncohInt
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
George Yong
Python 2to3, Spectra (all operations) working
 r1167 if 'COMMENT' in list(headerObj.header.keys()):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.comments = headerObj.header['COMMENT']
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.readHeightList()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readHeightList(self):
self.blockIndex = self.blockIndex + 1
obj = self.fitsObj[self.blockIndex]
self.heightList = obj.data
self.blockIndex = self.blockIndex + 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readExtension(self):
obj = self.fitsObj[self.blockIndex]
self.heightList = obj.data
self.blockIndex = self.blockIndex + 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def setNextFile(self):
if self.online:
newFile = self.__setNextFileOnline()
else:
newFile = self.__setNextFileOffline()
if not(newFile):
return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.readHeader()
Miguel Valdez
Signal Chain GUI updated:...
 r587 self.__setValuesFromHeader()
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.nReadBlocks = 0
# self.blockIndex = 1
return 1
Juan C. Espinoza
Change multiSchain by MPProject
 r1052 def searchFilesOffLine(self,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 path,
startDate,
endDate,
Percy Condor
Update2 for EW-Drifts
 r1383 startTime=datetime.time(0, 0, 0),
endTime=datetime.time(23, 59, 59),
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 set=None,
expLabel='',
ext='.fits',
walk=True):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 pathList = []
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not walk:
pathList.append(path)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 else:
dirList = []
for thisPath in os.listdir(path):
Percy Condor
Update2 for EW-Drifts
 r1383 if not os.path.isdir(os.path.join(path, thisPath)):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 continue
Miguel Valdez
-USRP Reader was added to Signal Chain GUI...
 r589 if not isRadarFolder(thisPath):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 continue
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 dirList.append(thisPath)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(dirList):
return None, None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 thisDate = startDate
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 while(thisDate <= endDate):
year = thisDate.timetuple().tm_year
doy = thisDate.timetuple().tm_yday
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 matchlist = fnmatch.filter(dirList, '?' + '%4.4d%3.3d' % (year, doy) + '*')
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if len(matchlist) == 0:
thisDate += datetime.timedelta(1)
continue
for match in matchlist:
Percy Condor
Update2 for EW-Drifts
 r1383 pathList.append(os.path.join(path, match, expLabel))
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 thisDate += datetime.timedelta(1)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if pathList == []:
Percy Condor
Update2 for EW-Drifts
 r1383 print("Any folder was found for the date range: %s-%s" % (startDate, endDate))
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return None, None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 print("%d folder(s) was(were) found for the date range: %s - %s" % (len(pathList), startDate, endDate))
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 filenameList = []
datetimeList = []
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 for i in range(len(pathList)):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 thisPath = pathList[i]
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 fileList = glob.glob1(thisPath, "*%s" % ext)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 fileList.sort()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 for thisFile in fileList:
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 filename = os.path.join(thisPath, thisFile)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 thisDatetime = self.isFileinThisTime(filename, startTime, endTime)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(thisDatetime):
continue
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 filenameList.append(filename)
datetimeList.append(thisDatetime)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(filenameList):
Percy Condor
Update2 for EW-Drifts
 r1383 print("Any file was found for the time range %s - %s" % (startTime, endTime))
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return None, None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 print("%d file(s) was(were) found for the time range: %s - %s" % (len(filenameList), startTime, endTime))
George Yong
Python 2to3, Spectra (all operations) working
 r1167 print()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 for i in range(len(filenameList)):
Percy Condor
Update2 for EW-Drifts
 r1383 print("%s -> [%s]" % (filenameList[i], datetimeList[i].ctime()))
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
self.filenameList = filenameList
self.datetimeList = datetimeList
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return pathList, filenameList
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def setup(self, path=None,
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 startDate=None,
endDate=None,
Percy Condor
Update2 for EW-Drifts
 r1383 startTime=datetime.time(0, 0, 0),
endTime=datetime.time(23, 59, 59),
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 set=0,
Percy Condor
Update2 for EW-Drifts
 r1383 expLabel="",
ext=None,
online=False,
delay=60,
walk=True):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if path == None:
George Yong
Python 2to3, Spectra (all operations) working
 r1167 raise ValueError("The path is not valid")
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
if ext == None:
ext = self.ext
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(online):
George Yong
Python 2to3, Spectra (all operations) working
 r1167 print("Searching files in offline mode ...")
Juan C. Espinoza
Change multiSchain by MPProject
 r1052 pathList, filenameList = self.searchFilesOffLine(path, startDate=startDate, endDate=endDate,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 startTime=startTime, endTime=endTime,
set=set, expLabel=expLabel, ext=ext,
walk=walk)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(pathList):
Percy Condor
Update2 for EW-Drifts
 r1383 print("No *%s files into the folder %s \nfor the range: %s - %s" % (ext, path,
datetime.datetime.combine(startDate, startTime).ctime(),
datetime.datetime.combine(endDate, endTime).ctime()))
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 sys.exit(-1)
self.fileIndex = -1
self.pathList = pathList
self.filenameList = filenameList
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.online = online
self.delay = delay
ext = ext.lower()
self.ext = ext
if not(self.setNextFile()):
Percy Condor
Update2 for EW-Drifts
 r1383 if (startDate != None) and (endDate != None):
print("No files in range: %s - %s" % (datetime.datetime.combine(startDate, startTime).ctime(), datetime.datetime.combine(endDate, endTime).ctime()))
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 elif startDate != None:
Percy Condor
Update2 for EW-Drifts
 r1383 print("No files in range: %s" % (datetime.datetime.combine(startDate, startTime).ctime()))
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 else:
George Yong
Python 2to3, Spectra (all operations) working
 r1167 print("No files")
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
sys.exit(-1)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readBlock(self):
dataObj = self.fitsObj[self.blockIndex]
self.data = dataObj.data
self.data_header_dict = dataObj.header
self.utc = self.data_header_dict['UTCTIME']
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.flagIsNewFile = 0
self.blockIndex += 1
self.nTotalBlocks += 1
self.nReadBlocks += 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __jumpToLastBlock(self):
Miguel Valdez
-Using ValueError raises instead of IOError...
 r684 raise NotImplementedError
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
def __waitNewBlock(self):
"""
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 Return 1 si se encontro un nuevo bloque de datos, 0 de otra forma.
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 Si el modo de lectura es OffLine siempre retorn 0
"""
if not self.online:
return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if (self.nReadBlocks >= self.dataBlocksPerFile):
return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 currentPointer = self.fp.tell()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 neededSize = self.processingHeaderObj.blockSize + self.basicHeaderSize
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 for nTries in range(self.nTries):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.fp.close()
Percy Condor
Update2 for EW-Drifts
 r1383 self.fp = open(self.filename, 'rb')
self.fp.seek(currentPointer)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
Percy Condor
Update2 for EW-Drifts
 r1383 self.fileSize = os.path.getsize(self.filename)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 currentSize = self.fileSize - currentPointer
Percy Condor
Update2 for EW-Drifts
 r1383 if (currentSize >= neededSize):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.__rdBasicHeader()
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 print("\tWaiting %0.2f seconds for the next block, try %03d ..." % (self.delay, nTries + 1))
sleep(self.delay)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def __setNewBlock(self):
if self.online:
self.__jumpToLastBlock()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.flagIsNewFile:
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.lastUTTime = self.utc
if self.online:
if self.__waitNewBlock():
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.nReadBlocks < self.dataBlocksPerFile:
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(self.setNextFile()):
return 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
deltaTime = self.utc - self.lastUTTime
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.flagDiscontinuousBlock = 0
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
if deltaTime > self.maxTimeStep:
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.flagDiscontinuousBlock = 1
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def readNextBlock(self):
if not(self.__setNewBlock()):
return 0
if not(self.readBlock()):
return 0
return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 def printInfo(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 pass
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def getData(self):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.flagNoMoreFiles:
self.dataOut.flagNoData = True
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 return (0, 'No more files')
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Merge with branch schain_julia_drifts from rev. 803 to 995....
 r568 self.flagDiscontinuousBlock = 0
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.flagIsNewBlock = 0
if not(self.readNextBlock()):
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 return (1, 'Error reading data')
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Miguel Valdez
Version 2.1.3: ...
 r664 if self.data is None:
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.dataOut.flagNoData = True
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 return (0, 'No more data')
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.dataOut.data = self.data
self.dataOut.data_header = self.data_header_dict
self.dataOut.utctime = self.utc
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
# self.dataOut.header = self.header_dict
Miguel Valdez
Signal Chain GUI updated:...
 r587 # self.dataOut.expName = self.expName
# self.dataOut.nChannels = self.nChannels
# self.dataOut.timeZone = self.timeZone
# self.dataOut.dataBlocksPerFile = self.dataBlocksPerFile
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 # self.dataOut.comments = self.comments
Miguel Valdez
Signal Chain GUI updated:...
 r587 # # self.dataOut.timeInterval = self.timeInterval
# self.dataOut.channelList = self.channelList
# self.dataOut.heightList = self.heightList
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.dataOut.flagNoData = False
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 # return self.dataOut.data
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def run(self, **kwargs):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(self.isConfig):
self.setup(**kwargs)
self.isConfig = True
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.getData()
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 @MPDecorator
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 class SpectraHeisWriter(Operation):
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 # set = None
setFile = None
idblock = None
doypath = None
subfolder = None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 def __init__(self): # , **kwargs):
Operation.__init__(self) # , **kwargs)
Miguel Valdez
Version 2.1.3: ...
 r664 self.wrObj = PyFits()
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 # self.dataOut = dataOut
Percy Condor
Update2 for EW-Drifts
 r1383 self.nTotalBlocks = 0
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 # self.set = None
self.setFile = None
self.idblock = 0
self.wrpath = None
self.doypath = None
self.subfolder = None
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 self.isConfig = False
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def isNumber(str):
"""
Chequea si el conjunto de caracteres que componen un string puede ser convertidos a un numero.
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 Excepciones:
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 Si un determinado string no puede ser convertido a numero
Input:
str, string al cual se le analiza para determinar si convertible a un numero o no
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 Return:
True : si el string es uno numerico
False : no es un string numerico
"""
try:
Percy Condor
Update2 for EW-Drifts
 r1383 float(str)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return True
except:
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 return False
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def setup(self, dataOut, wrpath):
if not(os.path.exists(wrpath)):
os.mkdir(wrpath)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.wrpath = wrpath
# self.setFile = 0
self.dataOut = dataOut
def putData(self):
Percy Condor
Update2 for EW-Drifts
 r1383 name = time.localtime(self.dataOut.utctime)
ext = ".fits"
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.doypath == None:
Percy Condor
Update2 for EW-Drifts
 r1383 self.subfolder = 'F%4.4d%3.3d_%d' % (name.tm_year, name.tm_yday, time.mktime(datetime.datetime.now().timetuple()))
self.doypath = os.path.join(self.wrpath, self.subfolder)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 os.mkdir(self.doypath)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if self.setFile == None:
# self.set = self.dataOut.set
self.setFile = 0
# if self.set != self.dataOut.set:
Percy Condor
Update2 for EW-Drifts
 r1383 # # self.set = self.dataOut.set
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 # self.setFile = 0
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 # make the filename
thisFile = 'D%4.4d%3.3d_%3.3d%s' % (name.tm_year, name.tm_yday, self.setFile, ext)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 filename = os.path.join(self.wrpath, self.subfolder, thisFile)
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487
Percy Condor
Update2 for EW-Drifts
 r1383 idblock = numpy.array([self.idblock], dtype="int64")
header = self.wrObj.cFImage(idblock=idblock,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 year=time.gmtime(self.dataOut.utctime).tm_year,
month=time.gmtime(self.dataOut.utctime).tm_mon,
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 day=time.gmtime(self.dataOut.utctime).tm_mday,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 hour=time.gmtime(self.dataOut.utctime).tm_hour,
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897 minute=time.gmtime(self.dataOut.utctime).tm_min,
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 second=time.gmtime(self.dataOut.utctime).tm_sec)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 c = 3E8
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 deltaHeight = self.dataOut.heightList[1] - self.dataOut.heightList[0]
Percy Condor
Update2 for EW-Drifts
 r1383 freq = numpy.arange(-1 * self.dataOut.nHeights / 2., self.dataOut.nHeights / 2.) * (c / (2 * deltaHeight * 1000))
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 colList = []
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 colFreq = self.wrObj.setColF(name="freq", format=str(self.dataOut.nFFTPoints) + 'E', array=freq)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 colList.append(colFreq)
Percy Condor
Update2 for EW-Drifts
 r1383 nchannel = self.dataOut.nChannels
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 for i in range(nchannel):
Percy Condor
Update2 for EW-Drifts
 r1383 col = self.wrObj.writeData(name="PCh" + str(i + 1),
format=str(self.dataOut.nFFTPoints) + 'E',
data=10 * numpy.log10(self.dataOut.data_spc[i, :]))
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 colList.append(col)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 data = self.wrObj.Ctable(colList=colList)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Percy Condor
Update2 for EW-Drifts
 r1383 self.wrObj.CFile(header, data)
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
self.wrObj.wFile(filename)
Percy Condor
Update2 for EW-Drifts
 r1383 # update the setFile
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.setFile += 1
self.idblock += 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 return 1
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 def run(self, dataOut, **kwargs):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 if not(self.isConfig):
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
Daniel Valdez
This is the new organization by packages and scripts for Signal Chain, this version contains new features and bugs fixed until August 2014
 r487 self.setup(dataOut, **kwargs)
self.isConfig = True
José Chávez
cambiados los kwargs para cada operacion/unidad de procesamiento
 r897
George Yong
Multiprocessing for heispectra (Fits) all working
 r1191 self.putData()
Percy Condor
Update2 for EW-Drifts
 r1383 return dataOut