.. _VMPZIDintro: Introduction ============ VMPZ-ID products, used in other LE3 Processing Functions, consist in (with increasing complexity): * Reconstructing accurate :ref:`survey footprint ` (using MER tiling in HEALPix MOC) * Collecting :ref:`bit Masks ` derived at previous levels (VIS, NIR, EXT) and construction the coverage mask (footprint+not masked regions in bit masks) * Collecting :ref:`instrumental/environmental information ` needed to compute the limiting magnitude and visibility masks * estimating the :ref:`depth maps ` based on rms Noise * estimating the :ref:`photometric visibility mask and the random catalog ` for a given selection used for 2PCF-WL, PK-WL, 2PCF-GC, 3PCF-GC, PK-GC, DET-CL, PROF-CL and VMSP-ID. They are also expected to be used by SWG-GC, SWG-WL and SWG-CL.. VMPZ-ID is triggered at the MER tile level, where all products are first produced as (potentially weighted) MOC Healpix maps, at a given MOC order. In the following, this stage is named the stage 1. A second step, prior to triggering other "client" LE3 processing functions implies "merging" the MOC maps, and a HEALPix partial map or MOC map is produced at the resolution prescribed by the user in the parameter files. Potential mangle maps could be derived from this product. In the following, this stage is named the stage 2. VMPZ-ID masks and random catalogs will be available by tiles and for the full survey. .. _intraFootprint: Survey footprint ++++++++++++++++ For the survey footprint, beside parameters :ref:`VMPZIDParamsFootprint ` the footprint requires: * for stage 1 (processing on MER tiles), products containing the list of coordinates describing the geometry of the survey for the set of given band/instrument are first ingested (e.g.: the ReconsFPAPointing in VIS :ref:`VISObsFrame` for NIR/VIS, the ImgSpatialFootprint in EXT `CalibratedFrame `_ if precise enough). The fraction of HEALPix pixel covered is reported in a :ref:`VMPZIDMOCFootprintMask `. This is the processing run for Q1 * for stage 2 (processing at skypatch level), a set of MOC HEALPix Maps :ref:`VMPZIDMOCFootprintMask ` are processed on the different MER tiles overlapping with the prescribed region. This stage is not run at Q1. The two stages will produce a :ref:`VMPZIDHEALPixFootprintMask ` or :ref:`VMPZIDMOCFootprintMask `. .. _intraBitMasks: Bit Masks and coverage mask +++++++++++++++++++++++++++ The coverage masks correspond to regions of the survey footprint that have not been flagged using the bitmask. It is therefore the same format as the survey footprint, but the flagged areas are set to 1. Parameters are set in :ref:`VMPZIDParamsCoverage `. The two stages will produce the product :ref:`VMPZIDHEALPixCoverageMask ` or :ref:`VMPZIDMOCCoverageMask `. In case of sky patch processing, or a mangle file :ref:`VMPZIDMangleCoverageMask ` can also be outputted, using :ref:`VMPZIDParamsMangle ` parameter files. For the bit masks, besides parameters :ref:`VMPZIDParamsBitMask `, and a HEALPix :ref:`VMPZIDMOCFootprintMask `, one would need: * for stage 1, the pixel flag maps defined in MER :ref:`MERMosaic` or (see in `human readable format `_) for the different bands/instruments, to produce :ref:`VMPZIDMOCBitMask ` * for stage 2, a set of :ref:`VMPZIDMOCBitMask ` computed on the different MER tiles overlapping with the prescribed region to produce :ref:`VMPZIDHEALPixBitMask ` or :ref:`VMPZIDMOCBitMask ` This stage is not run at Q1. .. _intraInfo: Instrumental/Environmental Information ++++++++++++++++++++++++++++++++++++++ Using parameters :ref:`VMPZIDParamsInfoMaps `, MOC maps of instrumental and environmental effects are first collected in a product :ref:`VMPZIDMOCCollectInfoMaps `. This implies to have access to all relevant statistics (mean/median/max/min?) on relevant quantities to compute the limiting magnitude, such as PSF/seeing FWHM, background level, RMS map, exposureTime, airmass,solar aspect angle, zodiacal light emissions. In the table below are listed a series of potential inputs to collect this maps. +---------------+-------------+------------+----------------------------------------------------+ | Instrumental/ | | | | | Environmental | Statistics | Instrument | Input Product | | Parameters | | | | +===============+=============+============+====================================================+ | Noise | RMS (pixel) | MER | :ref:`MERMosaic`/:ref:`MERBksMosaic` (RmsStorage) | +---------------+-------------+------------+----------------------------------------------------+ | Weights | RMS (pixel) | EXT | ExtCalibratedFrame (DataStorage) | | +-------------+------------+----------------------------------------------------+ | | Value | DES | DesCalibratedFrame (desObservation) | | +-------------+------------+----------------------------------------------------+ | | Value | KIDS | reducedScienceFrame (Weight)? | | +-------------+------------+----------------------------------------------------+ | | RMS (pixel) | LSST | ExtLssCalexp (lssCalexpFitsFile) | +---------------+-------------+------------+----------------------------------------------------+ | Exposures | TBD | VIS | :ref:`VISCalibratedFrame` (ObservationSequence) | | +-------------+------------+----------------------------------------------------+ | | TBD | NIR | :ref:`NIRCalibratedFrame` (ObservationSequence) | | +-------------+------------+----------------------------------------------------+ | | time | MER | :ref:`MERMosaic`/:ref:`MERBksMosaic` (imgBaseFrame)| | +-------------+------------+----------------------------------------------------+ | | time | EXT | ExtCalibratedFrame (imgBaseFrame) | | +-------------+------------+----------------------------------------------------+ | | time | DES | DesCalibratedFrame (imgBaseFrame) | | +-------------+------------+----------------------------------------------------+ | | total time | KIDS | reducedScienceFrame (ExpTime single exposure) | | +-------------+------------+----------------------------------------------------+ | | time | LSST | ExtLssCalexp (imgBaseFrame) | +---------------+-------------+------------+----------------------------------------------------+ | | FWHM | MER | :ref:`MERMosaic` or :ref:`MERBksMosaic` | | PSF | | | (merPsfModelStorage) | | +-------------+------------+----------------------------------------------------+ | | FWHM | EXT | ExtPSF (extPsfModel, keyword FITS) | +---------------+-------------+------------+----------------------------------------------------+ | Seeing | median | DES | DesCalibratedFrame (PsfModelStorage, FHWM) | | +-------------+------------+----------------------------------------------------+ | | median | KIDS | reducedScienceFrame (Seeing) | | +-------------+------------+----------------------------------------------------+ | | | LSST | ExtLssCalexp (lssPsfModelFitsFile ?) | +---------------+-------------+------------+----------------------------------------------------+ | Background | Pixel value | VIS | :ref:`VISCalibratedFrame` (BackgroundStorage) | | +-------------+------------+----------------------------------------------------+ | | Pixel value | NIR | :ref:`NIRCalibratedFrame` (BackgroundStorage) | | +-------------+------------+----------------------------------------------------+ | | Pixel value | MER | :ref:`MERBksMosaic` (BackgroundStorage) | | +-------------+------------+----------------------------------------------------+ | | Pixel value | EXT | ExtCalibratedFrame (ext.detrendedFrame) | | +-------------+------------+----------------------------------------------------+ | | Pixel value | DES | DesCalibratedFrame (BackgroundStorage) | | +-------------+------------+----------------------------------------------------+ | | | KIDS | ? | | +-------------+------------+----------------------------------------------------+ | | | LSST | ExtLssCalexp (lssCalexpFitsFile) | +---------------+-------------+------------+----------------------------------------------------+ | Airmass | ? | DES | DesCalibratedFrame (desObservation) ? | | +-------------+------------+----------------------------------------------------+ | | ? | KIDS | RawScienceFrame (AirmassStart/AirmassEnd) " | | +-------------+------------+----------------------------------------------------+ | | | LSST | ? (lssVisitInfo) | +---------------+-------------+------------+----------------------------------------------------+ | Atmospheric | | DES | | | Extinction +-------------+------------+----------------------------------------------------+ | | | KIDS | photometricParameters (Extinction) | | +-------------+------------+----------------------------------------------------+ | | | LSST | | +---------------+-------------+------------+----------------------------------------------------+ | SAA | | VIS | :ref:`VISCalibratedFrame` (ReconsOrbit) | | +-------------+------------+----------------------------------------------------+ | | | NIR | :ref:`NIRCalibratedFrame` (ReconstructedOrbit) | +---------------+-------------+------------+----------------------------------------------------+ | Zodiacal | | | TBD | | Light | | | | +---------------+-------------+------------+----------------------------------------------------+ .. _intraDepth: Depth Maps ++++++++++ The depth map is then estimated using parameters :ref:`VMPZIDParamsDepth `, and information collected in :ref:`VMPZIDMOCCollectInfoMaps `. In stage 1 MOC HEALPix maps :ref:`VMPZIDMOCDepth ` are produced at the MER level, while in stage 2 the data is gathered at the sky patch level in either partial HEALPix maps :ref:`VMPZIDHEALPixDepth ` or :ref:`VMPZIDMOCDepth `. .. _intraVisibility: Photometric Visibility Mask and Random Catalog ++++++++++++++++++++++++++++++++++++++++++++++ Along with parameters :ref:`VMPZIDParamsVisibility ` and the ref:`VMPZIDMOCDepth ` maps, the photometric visibility mask can be produced and stored as partial HEALPix map :ref:`VMPZIDHEALPixVisibility ` or MOC :ref:`VMPZIDMOCVisibility `. A random catalog :ref:`VMPZIDRandomCatalog ` can then be produced using luminosity function representative of the bin/population selected, or a proxy where to draw samples (deep survey). Input products * VMPZIDParamsBitMask * VMPZIDParamsCoverage * VMPZIDParamsDepth * VMPZIDParamsFootprint * VMPZIDParamsInfoMap * VMPZIDParamsRandom * VMPZIDParamsVisibility Output products * :ref:`VMPZIDHEALPixBitMask` * :ref:`VMPZIDHEALPixCoverageMask` * :ref:`VMPZIDHEALPixDepth` * :ref:`VMPZIDHEALPixFootprintMask` * :ref:`VMPZIDHEALPixInfoMap` * VMPZIDHEALPixVisibility * VMPZIDMOCBitMask * VMPZIDMOCCoverageMask * VMPZIDMOCDepth * VMPZIDMOCFootprintMask * VMPZIDMOCInfoMap * VMPZIDMOCVisibility * VMPZIDRandomCatalog .. |badge1| image:: https://img.shields.io/badge/EDEN-3.0-Green .. |badge2| image:: https://img.shields.io/badge/ML-ML2B-yellow .. |badge3| image:: https://img.shields.io/badge/DM-9.0.2-red .. |badge4| image:: https://img.shields.io/badge/FDM-9.0.2-red