.. _SIRintro: Introduction ============ The SIR :term:`Processing Function` is in charge of reducing all the NISP spectroscopic data of the Euclid wide and deep surveys. It is also in change to manage calibration fields to create a set of Calibration Data Products to be used on Euclid survey data processing. The purpose of this section is to describe data produced by the SIR Pipelines to allow other PFs (mainly SPE and LE3) to design their interfaces with SIR. A description of the SIR PF can be found on the SIR Software Description Document (SDD, EUCL-IPN-DDD-8-001), which is based on the SIR Requirements Specifications Document (RSD, EUCL-IMI-RS-8-001). List of SIR Data Products ------------------------- There are two types os SIR Data Products: - the **SIR Calibration Data Products** as results of the **SIR Calibration Pipelines** execution on the calibration fields; - the **SIR Scientific Data Products** as result of the **SIR Science Pipelines** execution on scientific pointing. SIR Calibration Data Products ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The **SIR Calibration Data Products** are used as input for the **SIR Science pipelines** to remove instrument signature and also to located, extracted, and calibrate the spectra. The produces are not useful for other PF, but the are used by **SIR Scientific Pipelines**. SIR Calibration Data Products Summary ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ========================================================== ========================== Dpd Data Product Description ========================================================== ========================== DpdSirDetectorScaling (Not part of DR1-Foundation)` The average QE maps weighted over wavelength DpdSirOptModel (Not part of DR1-Foundation) The astrometry model DpdSirCrvModel (Not part of DR1-Foundation) The description of the spectral curvature DpdSirIdsModel (Not part of DR1-Foundation) The relation between wavelengths and pixels DpdSirSpectralPsfModel (Not part of DR1-Foundation) The description of the 2D spectrogram width DpdSirRelativeFluxScaling (Not part of DR1-Foundation) The description of the large-scale spatial transmission variations DpdSirAbsoluteFluxScaling (Not part of DR1-Foundation) The sensitivity functions ========================================================== ========================== SIR Scientific Data Products ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The **SIR Scientific Data Products** are the outputs of the **SIR Science Pipelines** runs. SIR has 2 main scientific IAL pipelines that run at different levels of granularity.: * the **SpectraExtraction Pipeline**, which runs on an Observation bases. It starts from a LE1 frames and ends producing 1D calibrated spectra (SIRExtractedSpectraCollection - not distributed on DR1-Foundation). * the **SpectraCombination Pipeline**, which runs on a MER tile bases. Starting from the SIRExtractedSpectraCollection, it stacks single dither spectra producing 1D :ref:`Combined Spectra ` Both the 2 pipelines run on data coming from wide fields (composed by 4 dithers) and deep fields (composed by 60 dithers). For each dither the **SpectraExtraction Pipeline** produces: * 1 :ref:`background subtracted ` frame; * 16 SIRLocationTable (not part of DR1-Foundation) (1 for each detector): these products contain information about location and geometry of the spectra within the frame; * 1 SIRLE3LocationTable (not part of DR1-Foundation) short version of the LocationTable designed for the SAS; * 16 SIRExtractedSpectraCollection (not part of DR1-Foundation) (1 for each LocationTable): these products contain spectra wavelength and fluxes calibrated. For each MER tile the **SpectraCombination Pipeline** produces 1 :ref:`Combined Spectra Collection `. The Processing Elements directly involved in the production of these produces are the following. Spectra Location Processing Element ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The Spectra Location PE uses preprocessed frames and geometrical models to produce both the SIRLocationTable and the SIRLE3LocationTable. .. _SIR_SpectraLocationPE: .. figure:: ./figures/SIR_SpectraLocationPE.png : The Spectra Location processing element description Background Subtraction Processing Element ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The BackgroundSubtraction PE produces :ref:`background subtracted frames ` using preprocessed frames. Input Location Tables are used to mask out spectra signals. .. _SIR_BackgroundSubtractionPE: .. figure:: ./figures/SIR_BackgroundSubtractionPE.png : The Background Subtraction processing element description 1D Extraction, Relative and Absolute flux calibrations Processing Elements ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The 1D Extraction, the Relative and the Absolute flux calibrations PEs running in sequence produce the final SIRExtractedSpectraCollection ready to be combined [#f1]_. .. _SIR_SpectraExtractionPE: .. figure:: ./figures/SIR_SpectraExtractionPE.png : The 1D Extraction processing element description .. _SIR_RELFluxPE: .. figure:: ./figures/SIR_RLXFluxPE.png : The Relative Flux Calibration processing element description .. _SIR_ABSFluxPE: .. figure:: ./figures/SIR_ABSFluxPE.png : The Absolute Flux Calibration processing element description .. [#f1] The Spectra Decontamination PE is not explicitly mentioned here because its products are not stored in the archive, but decontaminated spectrograms are the input of the chain described above. Spectra Combination Processing Element ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Once the Extracted Spectra from all dithers covering a MER tile have been produced, the **SpectraCombination Pipeline** runs producing 1 :ref:`Combined Spectra Collection`. .. _SIR_SpectraCombinationPE: .. figure:: ./figures/SIR_SpectraCombinationPE.png : The Spectra Combination processing element description SIR Scientific Data Products summary ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ======================================================================== ========================== Dpd Data Product Description ======================================================================== ========================== SIRLocationTable (not part of DR1-Foundation) The Location Table used by the SIR-PEs SIRLE3LocationTable (not part of DR1-Foundation) The SAS Location Table :ref:`DpdSirScienceFrame ` The background subtracted frames SIRExtractedSpectraCollection (not part of DR1-Foundation) The (single dither) extracted spectra :ref:`DpdSirCombinedSpectra ` The (all dithers) combined spectra ======================================================================== ========================== SIR Configuration Set ~~~~~~~~~~~~~~~~~~~~~ This special Data Product (SIRConfigurationSet - not distributed with DR1-Foundation) is used to collect all the configuration parameters used to run the pipelines. It is manually produced and uploaded to the archive.