Vis Raw Frame Product

Data product name

DpdVisRawFrame

Data product custodian

LE1

Name of the Schema file

euc-le1-VisRawFrame.xsd

DPDD version

1.1

Processing Element(s) creating/using the data product

Creators:

  • LE1_VIS

Consumers:

  • VIS_PF

Processing function using the data product

VIS processing function.

Data product elements

Header:

object of type sys:genericHeader

Data:

object of type le1vis:visRawFrame

QualityFlags:

object of type dqc:sqfPlaceHolder

Parameters:

object of type ppr:genericKeyValueParameters

Detailed description of the data product

The LE1-VIS component of the LE1 processing function provides calibration and scientific exposures and the associated metadata.

Calibration and scientific exposure is provided as one multi-extension FITS (MEF) file, with one extension per quadrant, that is 144 extensions altogether.

The CCD numbering and location on the detector plane is showed on Fig. 6 and Fig. 7 below. The dotted circles are attachements of the CDD packages.

../../_images/CCD_numbering.png

Fig. 6 : CCD numbering and location at detector plane level (Front view) From VIS FPA ICD (EUCL-SAP-ICD-6-001) issue 2.5 2014/20/10

../../_images/CCD_organisation.png

Fig. 7 : CCD numbering and location at detector plane level (Front view) From VIS FPA ICD (EUCL-SAP-ICD-6-001) issue 5.1 2020/10/23

One can notice that CCDs on the right side of the focal plane are rotated by 180° with respect to those on the left. This means that CCD quadrants are not positioned the same way across the FPA, as showed on the Fig. 8 below for CCD 1-3 and 1-4.

../../_images/Quadrant_position.png

Fig. 8 : Quadrant position on the FPA

Fig. 9 below shows one CCD with the position of the 51 pre-scan and 20 over-scan pixels with respect to the imaging area. Each quadrant is marked with either E, F, G or H, according to the naming used by the manufacturer.

../../_images/Quadrant_organisation.png

Fig. 9 : Quadrant organisation in a CCD

Note: the charge injection structure which is four rows in the middle of the CCD: this will create a gap in the images.

Data encoding

All pixel data are in units of ADU, 16-bit unsigned integer.

The origin of each data array is located at the bottom left of the FPA with respect to Fig. 6. The following Fig. 10 shows the origin of the data array and NAXIS1, NAXIS2 axes for each quadrant in a CCD.

../../_images/FITS_data_array_organisation.png

Fig. 10 : FITS data array organisation for each quadrant in a CCD

Header content

Primary header

HDU PRIMARY: header

Name

Description

Value

Keywords

FITS_DEF

FITS definition name

string = le1.visRawImage

FITS_VER

FITS definition version

string = 0.1

BUNIT

Pixel data unit, e.g. ‘electrons’ or ‘adu’

string

OBASW

On board application software version: version.subversion.revision

string

DATE

UT date when this file was created

string

SOFTVERS

version of the simulator or version of the LE1 software

string

AUX_VERS

Version of the AUX Processor

string

EXPTIME

Commanded integration time in seconds, e.g. 565.0

double

IMG_CAT

DP category (SCIENCE, CALIB, …)

string

IMG_T1

DP type (OBJ, SRD, DARK, …)

string

IMG_T2

DP type (LAMP, SKY, …)

string

OBSMODE

Observation Mode (WIDE, DEEP, CALIBRATION)

string

OBSTYPE

DP technique (IMAGE, SPECTROIMAGE)

string = IMAGE

INSTRUME

VIS, or VISsim for simulations

string

TELESCOP

Telescope name: Euclid

string = Euclid

OBT_STA1

Integer, number of seconds of OBT (START_TIME)

integer

OBT_STA2

Integer, number of milliseconds of OBT (START_TIME)

integer

DATE-OBS

UTC Date of observation (start), e.g. ‘2014-03-15T09:30:09.313’

string

TIMESYS

Time scale of the time-related keywords

string

MJD-OBS

MJD start time, e.g. 56731.39594113

double

DATE_AUX

ISO-format timestamp when AUX Processor has added additional metadata

string

FIELDID

integer = 0

PLAN_ID

SOC Planning ID

integer

PATCH_ID

Patch ID

integer

OBS_ID

Observation ID, e.g. 1

integer

DITHOBS

Dither Id in observation sequence

integer

PTGID

integer

CALBLKID

Calibration Block ID

string

EXPNUM

Exposure Id in dither

integer

TOTEXP

Total number of Exposures in specific pointing

integer

INSTRMOD

VIS intrument mode: Science or Manual

string

COMPALGO

Science TM compression mode: NoCompression, CompressionWithoutRordering, CompressionWithRordering

string

COMPPARA

Science TM compression parameters: pixels/block

integer

MDUSIZE

Science TM minimum decompressable unit

integer

RA

Commanded FPA pointing right ascension (deg)

double

DEC

Commanded FPA pointing declination (deg)

double

PA

Position angle (deg). The rotation of the FPA about the line of sight, east of north

double

EQUINOX

Standard FK5 (years), e.g. 2000.

double

ELONG

Ecliptic longitude of the commanded attitude

double

ELAT

Ecliptic latitude of the commanded attitude

double

POS

Position Angle of the commanded attitude

double

SAA

Solar Aspect Angle of the commanded attitude

double

ALPHA

Solar Alpha angle, in degrees, at the start of the exposure (commanded)

double

BETA

Solar Alpha angle, in degrees, at the start of the exposure (commanded)

double

SEQID

VIS sequences as defined in EUCL-IFS-ICD-6-002 VIS Data ICD

string

OBT_END1

Integer, number of seconds of OBT (VIS sequence end time)

integer

OBT_END2

Integer, number of milliseconds of OBT (VIS sequence end time)

integer

DATE-END

VIS sequence end time in UTC, as ISO-format string

string

NOMCHAIN

VDGT2771: 0 if nominal CDPU-PMCU-CU-RSU chain is active, 1 if redundant.

integer

VSTART

Index of first readout line (starting at 0)

integer

VEND

Index of last readout line | 1

integer

IDLTIME

Time (s) between end of shutter opening or end of CCD flush or end of charge injection and start of readout

double

ROECFGID

ROE configuration table ID

integer

RSUSINID

Table version of RSU SINE table used in the RSU initialisation

integer

RSUFRID

Table version of RSU FREQ table used in the RSU initialisation

integer

RSUSFRID

Table version of RSU short FREQ table used in the RSU initialisation

integer

RSUCFSTA

Shutter unit configuration status: CLOSED_LOOP, OPEN_LOOP, NOT_INITIALISED

string

CUSTATUS

Calibration unit status: On or Off

string

CULEDDUR

If CU on: pulse duration (s)

double

CULEDMSK

Indicates which LEDs are active. Bit0(LSB)=LED1, …, Bit5=LED6

integer

LED1RAW

LED1 current DAC value

integer

LED1CURN

If nominal LED1 on: current (mA)

double

LED1FLUN

If nominal LED1 on: fluence (ADU)

double

LED1CURR

If redundant LED1 on: current (mA)

double

LED1FLUR

If redundant LED1 on: fluence (ADU)

double

LED2RAW

LED2 current DAC value

integer

LED2CURN

If nominal LED2 on: current (mA)

double

LED2FLUN

If nominal LED2 on: fluence (ADU)

double

LED2CURR

If redundant LED2 on: current (mA)

double

LED2FLUR

If redundant LED2 on: fluence (ADU)

double

LED3RAW

LED3 current DAC value

integer

LED3CURN

If nominal LED3 on: current (mA)

double

LED3FLUN

If nominal LED3 on: fluence (ADU)

double

LED3CURR

If redundant LED3 on: current (mA)

double

LED3FLUR

If redundant LED3 on: fluence (ADU)

double

LED4RAW

LED4 current DAC value

integer

LED4CURN

If nominal LED4 on: current (mA)

double

LED4FLUN

If nominal LED4 on: fluence (ADU)

double

LED4CURR

If redundant LED4 on: current (mA)

double

LED4FLUR

If redundant LED4 on: fluence (ADU)

double

LED5RAW

LED5 current DAC value

integer

LED5CURN

If nominal LED5 on: current (mA)

double

LED5FLUN

If nominal LED5 on: fluence (ADU)

double

LED5CURR

If redundant LED5 on: current (mA)

double

LED5FLUR

If redundant LED5 on: fluence (ADU)

double

LED6RAW

LED6 current DAC value

integer

LED6CURN

If nominal LED6 on: current (mA)

double

LED6FLUN

If nominal LED6 on: fluence (ADU)

double

LED6CURR

If redundant LED6 on: current (mA)

double

LED6FLUR

If redundant LED6 on: fluence (ADU)

double

CI_STAT

Charge injection status: On or Off

string

CI_IDL

If charge injection on: injection drain low bias (V)

double

CI_IDWID

If charge injection on: injection drain pulse duration (s)

double

CI_IDDLY

If charge injection on: injection drain low pulse delay (s)

double

CI_IG1

If charge injection on: injection gate 1 voltage (V)

double

CI_IG2

If charge injection on: injection gate 2 voltage (V)

double

CI_IJON

If charge injection on: number of lines injected in each cycle

integer

CI_IJOFF

If charge injection on: number of lines without injection, after the CI_IJON lines injected, in each cycle

integer

CI_VSTAR

If charge injection on: image line where the pattern starts

integer

CI_VEND

If charge injection on: image line where the pattern ends

integer

CI_TOI

If charge injection on: image clock pulse edge overlap (us)

double

CI_TDWEL

If charge injection on: dwell time inserted in waveform cycle(On or Off)

string

CI_IDH

If charge injection on: injection drain high bias (V)

string

TP_STAT

Trap pumping status: off, parallel, serial, multiple serial

string

TP_PSHM

If parallel trap pumping: shuffling mode: 123, 234, 341, 412

string

TP_PDWEL

If parallel trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_TOI

If parallel trap pumping: phase time (s)

double

TP_PSHCY

If parallel trap pumping: number of parallel shuffling cycles

integer

TP_SRO

If serial trap pumping: number of readouts

integer

TP_SSHM1

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE1

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC1

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD1

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM2

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE2

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC2

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD2

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM3

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE3

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC3

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD3

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM4

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE4

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC4

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD4

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM5

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE5

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC5

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD5

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM6

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE6

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC6

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD6

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM7

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE7

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC7

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD7

If serial trap pumping: number of rows shuffled and read out

integer

TP_SSHM8

If serial trap pumping: shuffling mode: 12, 23

string

TP_SDWE8

If serial trap pumping: parallel dwelling time within each pumping cycle (s)

double

TP_SSHC8

If serial trap pumping: number of serial shuffling cycles

integer

TP_SRD8

If serial trap pumping: number of rows shuffled and read out

integer

M2_POS

The M2 focus position

double

M2MTEMP

The M2 mechanism temperature, which correlates with the M2 focus

double

Extension headers

Each extension shall contain the CCD and quadrant identification. CCD will be identified with the numbering shown above (‘1-1’, ‘1-2’,…, ‘6-6’) and the quadrant by the letters ‘E’, ‘F’, ‘G’ or ‘H’ according to Fig. 9.

HDU SCI.n: header

Name

Description

Value

Keywords

DETID

CCD-ID field from science TM (0-35)

integer

EXTNAME

Format: CCD row-CCD column.quadrant id, e.g. 2.3-H

string

CCDID

e.g. Detector ID, e.g. ‘0-0’, ‘1-1’ … ‘6-6’

string

QUADID

e.g. Quadrant ID, e.g. ‘E’, ‘F’, ‘G’ or ‘H’

string

ROEID

ROE ID: 1-12

integer

ROECTV

ROE configuration table version

integer

BUNIT

Pixel data unit, e.g. ‘electrons’ or ‘adu’

string

NAXIS

integer

NAXIS1

integer

NAXIS2

integer

BITPIX

integer

PRESCANX

number of serial prescan pixels, e.g 51

integer

OVRSCANX

number of serial overscan pixels, e.g 29

integer

OVRSCANY

number of parallel overscan pixels, e.g 20

integer

EXPDUR1

Nominal/Short, nominal with CI, Flat: duration (s) between shutter start opening and end closing. Other: duration (s) between end flushing and start readout.

integer

EXPDUR2

Nominal/Short, nominal with CI, Flat: duration (s) between shutter fully open and start closing. Other: 0.

integer

WCSAXES

Number of axes in the WCS description. This keyword must precede all WCS keywords except NAXIS in the HDU.

integer

CRVAL1

Right ascension at ref pixel

double

CRVAL2

Declination at ref pixel

double

CRPIX1

Reference pixel x coordinate

double

CRPIX2

Reference pixel y coordinate

double

CD1_1

Translation matrix element

double

CD1_2

Translation matrix element

double

CD2_1

Translation matrix element

double

CD2_2

Translation matrix element

double

CTYPE1

Coordinamte 1 type

string

CTYPE2

Coordinamte 2 type

string

CUNIT1

Physical units of CRVAL1

string

CUNIT2

Physical units of CRVAL2

string

RADESYS

Coordinate reference frame, e.g. ‘FK5’

string

CMPRTSCI

Quadrant image compression ratio obtained on-board

double

ROETEMP

Mean ROE Video Board temperature

double

DETTEMP

Mean Detector (CCD) temperature

double

On the next LE1 PF release, these two keywords value will be modified or added:

  1. Predicted / instantaneous spacecraft velocities in TBD referential:

    The spacecraft instantaneous velocity will be used to correct the velocity aberration (astrometric effect which produces an apparent displacement of celestial objects about their true positions, dependent on the velocity of the observer). In case the instantaneous spacecraft velocities were not available in time to be included in the LE1 data product we would use a predicted velocity to apply a first approximative correction that will be refined afterwards with the instantaneous value.

  2. Temperatur of the CCD check with VIS IDT that this data is available as such (which temperature sensors are there, which data will be available on ground?).

  3. Temperature of the telescope.

  4. File checksum.