Production list

Production list#

Find below the list of lstmcpipe productions. Real source names are not provided here. To find the actual source name corresponding to its ID used in the prod ID, visit the LST wiki page.

Production date

Prod ID

Readme

2025-02-17

20250212_v0.10.17_allsky_interp_dl2_irfs

(re)production of DL2 and IRFs for the NSB grid production with pointing interpolation

See https://github.com/cta-observatory/cta-lstchain/pull/1320

After merging this feature, reproduction of test DL2 and IRFs is needed to analyse data.
Uses models from prod 20240918_v0.10.12_allsky_nsb_grid

Resulting IRFs

IRFs to use for data analysis can be found under:

/fefs/aswg/data/mc/IRF/AllSky/20250212_v0.10.17_allsky_interp_dl2_irfs_nsb_*
└── TestingDataset
    ├── Gamma
    │   ├── dec_2276
    │   ├── dec_3476
    │   ├── dec_4822
    │   ├── dec_6166
    │   ├── dec_6676
    │   ├── dec_931
    │   ├── dec_min_1802
    │   ├── dec_min_2924
    │   └── dec_min_413
    └── GammaDiffuse
        ├── ...
        └── dec_min_41320250212_v0.10.17_allsky_interp_dl2_irfs

Steps done to produce configs:

  • copied prod 20240918_v0.10.12_allsky_nsb_grid
  • applied python process.py
  • fixed paths to DL1 files in prod NSB-0.00
2024-12-23

20240918_v0.10.12_allsky_nsb_grid

allsky production with NSB grid

Production for all declination bands with a NSB-wise grid using the following parameters:

NSB (p.e.) Tailcut cleaning values
0.07 (8, 4)
0.14 (8, 4)
0.22 (8, 4)
0.38 (10, 5)
0.50 (10, 5)
0.81 (12, 6)
1.25 (14, 7)
1.76 (16, 8)
2.34 (18, 9)

The GammaDiffuse dataset has been divided into training and test datasets with a 50-50% ratio.

lstmcpipe_generate_nsb_levels_configs -c PathConfigAllSkyFullSplitDiffuse --nsb 0.0 0.07 0.14 0.22 0.38 0.50 0.81 1.25 1.76 2.34 -pid 20240918_v0.10.12

Modifications applied afterwards

  • slurm options have been modified to accomodate for the usage of the cluster, adding the nice option so that lstmcpipe jobs are sent after lstosa ones and managing jobs times to reduce the time they are hanging
python add_slurm_options.py
  • The n_estimators value has been changed to 50 following recommendations from https://github.com/cta-observatory/cta-lstchain/pull/1294 in all config except NSB-0.00.
python change_estimators.py
  • The lstchain configs have been modified to include the IRF production config from https://github.com/cta-observatory/cta-lstchain/blob/v0.10.12/docs/examples/irf_dl3_tool_config.json

Tree structure

Trained models for analysis can be found under:

/fefs/aswg/data/models/AllSky
├── 20240918_v0.10.12_allsky_nsb_tuning_0.00
├── 20240918_v0.10.12_allsky_nsb_tuning_0.07
├── 20240918_v0.10.12_allsky_nsb_tuning_0.14
├── 20240918_v0.10.12_allsky_nsb_tuning_0.22
├── 20240918_v0.10.12_allsky_nsb_tuning_0.38
├── 20240918_v0.10.12_allsky_nsb_tuning_0.50
├── 20240918_v0.10.12_allsky_nsb_tuning_0.81
├── 20240918_v0.10.12_allsky_nsb_tuning_1.25
├── 20240918_v0.10.12_allsky_nsb_tuning_1.76
├── 20240918_v0.10.12_allsky_nsb_tuning_2.34

Please DO NOT use IRFs under /fefs/aswg/data/IRFs/AllSky/20240918_v0.10.12_allsky_nsb_tuning_* but refer to production 20250212_v0.10.17_allsky_interp_dl2_irfs for the correct IRFs to use for data analysis.

2024-10-23

20240917_v0.10.12_src15_dec_min_2924_tuned

PROD 20240917_v0.10.12_src15_dec_min_2924_tuned

I need this production to analyse the LST-1 data of src15 (see https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions) with dec 29.24 deg. The median of the NSB standard deviation for this dataset is approximately 2.308 p.e.

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_min_2924 --prod_id 20240917_v0.10.12_src15_dec_min_2924_tuned --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base

Config for the NSB tuning:

"image_modifier": {
    "increase_nsb": true,
    "extra_noise_in_dim_pixels": 3.843,
    "extra_bias_in_dim_pixels": 1.07,
    "transition_charge": 8,
    "extra_noise_in_bright_pixels": 5.178
  }

Contact: Lisa N

2024-09-06

20240828_v0.10.9_GC_dec_min_2924_tuned

Prod 20240828_v0.10.9_GC_dec_min_2924_tuned

Description of the config

"image_modifier": {
    "increase_nsb": true,
    "extra_noise_in_dim_pixels": 2.98,
    "extra_bias_in_dim_pixels": 0.858,
    "transition_charge": 8,
    "extra_noise_in_bright_pixels": 3.989
    }

lstchain_tune_nsb command

lstchain_tune_nsb --config standard_lstchain_config.json --input-mc /fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/Protons/dec_min_2924/sim_telarray/node_corsika_theta_69.813_az_217.303_/output_v1.4/simtel_corsika_theta_69.813_az_217.303_run10.simtel.gz --input-data /fefs/aswg/data/real/DL1/20220502/v0.9/tailcut84/dl1_LST-1.Run08079.0035.h5 -o tuned_lstchain_config.json

lstmcpipe config command

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_min_2924 --prod_id 20240906_v0.10.9_GC_dec_min_2924_tuned  --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base

Then used the script below to add time and nice options to each step.

python add_slurm_options.py lstmcpipe_config_2024-09-06_PathConfigAllSkyFullDL1ab.yaml 

Why this production is needed?

To analyze the Galactic Center data at dec_min_2924.

2024-08-30

20240821_v0.10.11_src14_dec2276_tuned

New Prod Config

Prod_ID

20240821_v0.10.11_src14_tuned

Description

full DL1ab production (with NSB tuning for src14) with lstchain v0.10.11

NSB level was checked in the following way:

input_mc = /fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/Protons/dec_2276/sim_telarray/node_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run10.simtel.gz

input_data = /fefs/aswg/data/real/DL1/20240613/v0.10/tailcut84/dl1_LST-1.Run17799.0016.h5

print("this config was downloaded (and modified) on %s" % download_config_modified_time)
config_file = Path("./lstchain_standard_config.json")

lstchain_tune_nsb --config standard_lstchain_config.json --input-mc /fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/Protons/dec_2276/sim_telarray/node_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run10.simtel.gz --input-data /fefs/aswg/data/real/DL1/20240613/v0.10/tailcut84/dl1_LST-1.Run17799.0016.h5 -o tuned_lstchain_config.json

Why this config is needed

Analysis of future data taken on src14

Config file creation

The config file was initially cretaed by using lstmcpipe_generate_config:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_2276 --prod_id 20240821_v0.10.11_src14_dec2276_tuned --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base
2024-08-06

20240727_v0.10.11_src12_tuned

New Prod Config

Prod_ID

20240727_v0.10.11_src12_tuned

Short description of the config

full DL1ab production (with NSB tuning for src12) with lstchain v0.10.11

NSB level was checked in the following way:

input_mc_base = Path("/fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/GammaDiffuse/")
input_mc = input_mc_base / "dec_min_413/sim_telarray/node_corsika_theta_33.058_az_173.79_/output_v1.4/simtel_corsika_theta_33.058_az_173.79_run1.simtel.gz"

input_data_base = Path("/fefs/aswg/data/real/DL1/")
input_data = input_data_base / "20240701/v0.10/tailcut84/dl1_LST-1.Run17967.0000.h5"

print("this config was downloaded (and modified) on %s" % download_config_modified_time)
config_file = Path("./lstchain_standard_config.json")

!lstchain_tune_nsb --input-mc $input_mc --input-data $input_data --config $config_file

The resulting values are the followings:

this config was downloaded (and modified) on 2024-07-27 10:21:03

Real data:
   Number of bad pixels (from calibration): 13
   Median of FF pixel charge: 75.561 p.e.
   Median across camera of good pixels' pedestal std 2.217 p.e.
   Number of pixels beyond 3 std dev of median:    34, (above 2.73 p.e.)
Good and not too bright pixels: 1812


{
  "increase_nsb": true,
  "extra_noise_in_dim_pixels": 1.297,
  "extra_bias_in_dim_pixels": 0.385,
  "transition_charge": 8,
  "extra_noise_in_bright_pixels": 1.536
}

These are pasted on the lstchain_config_2024-07-27.json.

contact: Hideaki Katagiri

Why this config is needed

Reprocess the data of src12 with version of lstchain v0.10.11 and with NSB tunning.

Other information

command-line:

prod_id = "20240727_v0.10.11_src12_tuned"
dec_list = "dec_min_413" # declination=-4.13, Decl. of G17.8+16.8 = -5.145
source_prod_id = "20240131_allsky_v0.10.5_all_dec_base"
!lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --overwrite --prod_id $prod_id --kwargs source_prod_id=$source_prod_id --dec_list $dec_list
2024-07-17

20240716_v0.10.7_src10_dec3476_tuned

Product Configuration for src10

Prod_ID

20240716_v0.10.7_src10_dec3476_tuned

Description

Config for reprocessing of Gamma Diffuse MC at declination line of 34.76 deg, based on 20240430_v0.10.4_src9_dec3476_tuned.

NSB tuning adapted to the observed data of src10.

Objective

Need diffuse MC with tuning for new source: src10

Config file creation

The config file was initially cretaed by using lstmcpipe_generate_config: ''' lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_3476 --prod_id 20240716_v0.10.7_src10_dec3476_tuned --kwargs source_prod_id=20240430_v0.10.4_src9_dec3476_tuned '''

Added image_modifier to tune NSB to src10. Manually edited to split dataset similar as 20240430_v0.10.4_src9_dec3476_tuned.

2024-06-07

20240529_v0.10.11_src4_dense_MC_line

Source with dec 6166 at LZA and NSB tuning

20240529

Production on the full high density line (dec_6166_high_density) with all nodes and with to NSB of the LZA data

Short description of the config

Config for a source src4 with line dec_6166_high_density and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)

{
  "increase_nsb": true,
  "extra_noise_in_dim_pixels": 2.124,
  "extra_bias_in_dim_pixels": 0.738,
  "transition_charge": 8,
  "extra_noise_in_bright_pixels": 2.766
}

Only test nodes on the declination line are included

The config is produced as following:

MC_line='dec_6166_high_density'

config = paths_config.PathConfigAllSkyFull('20240519_v0.10.11_src4_dense_MC_line', [MC_line])

config.stages = [
        'r0_to_dl1',
        'merge_dl1',
        'train_pipe',
        'dl1_to_dl2']

config.generate()

# mask tests too far from the training nodes
train_zd=90*u.deg-config.train_configs[MC_line]._training_pointings['alt']
train_az=config.train_configs[MC_line]._training_pointings['az']

n_test_points=len(config.test_configs[MC_line]._testing_pointings)
mask_test=np.zeros(n_test_points,dtype=bool)
for point in np.arange(n_test_points):

    zd=90*u.deg-config.test_configs[MC_line]._testing_pointings['alt'][point]
    az=config.test_configs[MC_line]._testing_pointings['az'][point]


    for test in np.arange(len(train_zd)):
        dist=angular_separation(az,zd,train_az[test],train_zd[test])

        if dist < 1.*u.deg:
            print(f"dist {dist} keep {test_zd[test]:6.2f} {zd:6.2f}")
            mask_test[point]=True


# select only the on line tests
config.test_configs[MC_line]._testing_pointings=config.test_configs[MC_line]_testing_pointings = config.test_configs[MC_line]._testing_pointings[mask_test]

Plot:

config.plot_pointings()
2024-05-17

20240430_v0.10.4_src9_dec3476_tuned

New Product Configuration for src9

Prod_ID

20240430_v0.10.4_src9_dec3476_tuned

Description

Config for training RF splitting Gamma Diffuse MC datasets in halves for the declination line of 34.76 deg.

NSB tuning adapted to the observed data of src9.

Objective

Prepare full enclosure IRFs for src9.

Config file creation

The config file was initially cretaed by using lstmcpipe_generate_config: lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20240430_v0.10.4_src9_dec3476_tuned --dec_list dec_3476

Then, some manually changes were added in order to split the datasets and add the specific NSB tuning configuration parameters.

2024-05-03

20240426_v0.10.9_src3_dec3476_4822_tunedNSB

Source with dec 3476/4822 and NSB tuning for moon data (x3-4 the previous production, which was made to reproduce the specific dark background of the source due to its proximity to the galactic plane). The mean_diffuse_nsb_std for this dataset is approximately 3 p.e.

Prod_ID

20240426_v0.10.9_src3_dec3476_4822_tunedNSB

20240426

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20240426_v0.10.9_src3_dec3476_4822_tunedNSB --dec_list dec_3476 dec_4822

Short description of the config

Config for a source with dec within 3476/4822 and NSB tuning:

"image_modifier": {
   "increase_nsb": true,
   "extra_noise_in_dim_pixels": 6.974,
   "extra_bias_in_dim_pixels": 1.825,
   "transition_charge": 8,
   "extra_noise_in_bright_pixels": 4.195
}

Why this config is needed

See wiki page (src 3) https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions

2024-02-29

20240229_nsb14

DL1a=> Production for the dec_3476 line and high NSB conditions, with cleaning levels (14, 7)

Command:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_3476 --prod_id 20240229_dec34_nsb14 --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base

Then I modified in the yaml file the versions of lstchain and lstmcpipe to be used

2024-02-19

20240219_allsky_v0.10.7_all_dec_srcdep_base

Prod 20240219_allsky_v0.10.7_all_dec_srcdep_base

Base production for all declinations lines with lstchain v0.10.7 & source-dependent approach

lstmcpipe_generate_config PathConfigAllTrainTestDL1b --dec_list dec_2276 dec_4822 dec_6166 dec_6676 dec_min_1802 dec_min_413 dec_931 dec_min_2924 dec_3476 --prod_id 20240219_allsky_v0.10.7_all_dec_srcdep_base --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base
lstchain_dump_config -o lstchain_config_2024-02-19_srcdep.json --mc --update-with lstchain_src_dep_config.json

contact: Seiya N.

2024-02-19

20240122_v0.10.4_prod5_trans_80

20240122_v0.10.4_prod5_trans80

20 degrees for performance study

lstmcpipe_generate_config PathConfigProd5Trans80 --prod_id 20240122_v0.10.4_prod5_trans80

Contact : Mathieu de Bony, Léo Le Moigne, David Sanchez

2024-02-07

20240126_v0.10.4_src6_dec2276_tuned

New Prod Config

Prod_ID

20240126_v0.10.4_src6_dec2276_tuned

Short description of the config

Config for the processing of MC at dec_2276 with NSB tuning to src6 and src-dependent configuration using a specific NSB tunning for the source.

Why this config is needed

Reprocess the data at declination 22.76 with version of lstchain v0.10.4 and with new tunning for new source: src6.

Other information

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20240126_v0.10.4_src6_dec2276_tuned --kwargs source_prod_id=20230901_v0.10.4_allsky_base_prod --dec_list dec_2276
2024-02-06

20240206_v0.10.5_lst_school_dummy_prod

PROD 20240206_v0.10.5_lst_school_dummy_prod

I need this production for the LST school

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_2276 --prod_id 20240206_v0.10.5_lst_school_dummy_prod --kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base

contact: Thomas V.

2024-02-05

20240235_v0.10.5_dec_931_dec_min_2924_dec_3476

Prod 20240235_v0.10.5_dec_931_dec_min_2924_dec_3476

Base prod with missing declinations in 20240131_allsky_v0.10.5_all_dec_base

source /fefs/aswg/software/conda/etc/profile.d/conda.sh conda activate lstchain-v0.10.5 lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20240131_allsky_v0.10.5_all_dec_base --dec_list dec_931 dec_min_2924 dec_3476

contact: Thomas V.

2024-01-31

20240131_allsky_v0.10.5_all_dec_base

Prod 20240131_allsky_v0.10.5_all_dec_base

Base production for all declinations lines with lstchain v0.10.5

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20240131_allsky_v0.10.5_all_dec_base --dec_list dec_2276 dec_4822 dec_6166 dec_6676 dec_min_1802 dec_min_413

contact: Thomas V.

2023-11-06

20231106_v0.9.12_base_dl1_dec_931_min-2924_min-1802_6166

Prod 20231106_v0.9.12_base_dl1_dec_931_min-2924_min-1802_6166

Base DL1 prod for missing declination in 20221215_v0.9.12_base_prod

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20231106_v0.9.12_base_dl1_dec_931_min-2924_min-1802_6166 --dec_list dec_931 dec_min_2924 dec_min_1802 dec_6166

contact: Thomas Vuillaume

2023-10-27

20231017_v0.10.4_seasonal_atmospheres_summer

20231017_v0.10.4_seasonal_atmospheres_summer

Full production of a test node simulated with a summer atmospheric profile. Reconstructed with - training datasets produced with the same atmosphere as for the production. - training datasets produced with the standard average winter atmospheric profile.

The goal is to estimate the systematics introduced by using the same average winter atmospheric profile in order to analyse all LST data.

The config file was created manually, inspired by the configurations of the production 20230927_v0.10.4_crab_tuned.

Contact : Georgios Voutsinas

2023-10-24

20231024_v0.10.4_base_dec_min_2924_min_1802_6166

Prod 20231024_v0.10.4_base_dec_min_2924_min_1802_6166

Base prod for missing declination in 20230901_v0.10.4_base_prod

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20231024_v0.10.4_base_dec_min_2924_min_1802_6166 --dec_list dec_min_2924 dec_min_1802 dec_6166

contact: Thomas Vuillaume

2023-09-28

20230927_v0.10.4_crab_tuned

New Prod Config

Prod_ID

20230927_v0.10.4_crab_tuned

Short description of the config

full DL1ab production (with NSB tuning for Crab) with lstchain v0.10.4

NSB level was checked in the following way:

input_mc = Path("/fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/GammaDiffuse/dec_2276/sim_telarray/node_corsika_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run1.simtel.gz") input_data = Path("/fefs/aswg/data/real/DL1/20221201/v0.9/tailcut84/dl1_LST-1.Run11282.0000.h5") print("this config is commit ac7d379 on Sep 14, 2023 ") config_file = Path("./lstchain_standard_config.json") !lstchain_tune_nsb --input-mc $input_mc --input-data $input_data --config $config_file

The resulting values are the followings:

this config is commit ac7d379 on Sep 14, 2023 Real data: median across camera of good pixels' pedestal std 2.633 p.e. Number of pixels beyond 3 std dev of median: 34, (above 3.82 p.e.) Good and not too bright pixels: 1811

{ "increase_nsb": true, "extra_noise_in_dim_pixels": 2.197, "extra_bias_in_dim_pixels": 0.82, "transition_charge": 8, "extra_noise_in_bright_pixels": 2.88 }

These are pasted on the lstchain_config_2023-09-27.json.

contact: Hideaki Katagiri

Why this config is needed

Reprocess the data of Crab with version of lstchain v0.10.4 and with tunning.

Other information

command-line:

prod_id = "20230927_v0.10.4_crab_tuned"
dec_list = "dec_2276"
source_prod_id = "20230901_v0.10.4_allsky_base_prod"
!lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id $prod_id --kwargs source_prod_id=$source_prod_id --dec_list $dec_list --overwrite
2023-09-25

20230925_v0.10.4_src3_dec3476_4822_tuned

New Prod Config

Prod_ID

20230925_v0.10.4_src3_dec3476_4822_tuned

Short description of the config

full DL1ab production (dec3476 and dec4822 with NSB tuning for src3) with lstchain v0.10.4

contact: Seiya Nozaki

Why this config is needed

Reprocess the data at declination 34.76 and 48.22 with version of lstchain v0.10.4 and with tunning for src3.

Other information

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20230925_v0.10.4_src3_dec3476_4822_tuned --kwargs source_prod_id=20230901_v0.10.4_allsky_base_prod --dec_list dec_3476 dec_4822
2023-09-01

20230901_v0.10.4_allsky_base_prod

New Prod Config

20230901_v0.10.4_base_prod

Short description of the config

Full allsky production with lstchain v0.10.4 standard settings (https://github.com/cta-observatory/cta-lstchain/blob/v0.10.4/lstchain/data/lstchain_standard_config.json) Only change to the config is the added integration_correction, that is needed for simulations.

Why this config is needed

There have been datamodel-changes in the transition from lstchain 0.9 to 0.10, which is why a new production is in order. Also old lstchain configs dont necessarily work with the new versions (e.g. due to floating point verbose values).

This request includes all declination lines and no NSB-tuning in order act as a new baseline. For the same reason all processing steps are included. That should make it possible to directly compare the performance to the older 20230127_v0.9.12_base_prod_az_tel production.

For Crab or other high-NSB sources, a dl1ab reprocessing or another podcution will thus be needed.

Command to produce

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20230901_v0.10.4_allsky_base_prod --dec_list dec_2276 dec_931 dec_min_413 dec_6676 dec_4822 dec_3476

to produce the list of steps. Then change lstchain version in the mcpipe config. For the lstchain config, use the standard config of that version from here: https://github.com/cta-observatory/cta-lstchain/blob/v0.10.4/lstchain/data/lstchain_standard_config.json and set apply_integration_correction to true

2023-08-30

20230829_src5_dec3476_v0.10_tuned

New Prod Config

Prod_ID

20230829_src5_dec3476_v0.10_tuned

Short description of the config

dec_3476 with NSB tuning to src5, src-dependent and lstchain v0.10 configuration.

Why this config is needed

Reprocess the data at declination 34.76 with version of lstchain v0.10 and with tunning for src5.

Other information

command-line:

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20230829_src5_dec3476_v0.10_tuned  --dec_list dec_3476
2023-06-19

20230601_v0.9.13_src7_darkNSB

New Prod Config

Prod_ID

20230601_v0.9.13_src7_darkNSB

Short description of the config

Reprocess production of 20230601_v0.9.13_dec_4822_dec_6166 matching the NSB noise to source 7 in dark conditions.

Why this config is needed

Add NSB noise to match the NSB in the FoV of source 7 in the production 20230601_v0.9.13_dec_4822_dec_6166

Command used to produce the lstmcpipe config

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_4822 dec_6166 --prod_id 20230601_v0.9.13_src7_darkNSB --kwargs source_prod_id=20230601_v0.9.13_dec_4822_dec_6166

Also, I increased the memory for the DL2 to IRF stage o 100 GB following the fix memory issue in prod. 20230329_v0.9.13_src4_full_line.

2023-06-02

20230601_v0.9.13_dec_4822_dec_6166

New Prod Config

Prod_ID

20230601_v0.9.13_dec_4822_dec_6166

Short description of the config

Create a production with lstchain-v0.9.13 with all testing nodes for dec_4822 and dec_6166. The stage r0_to_dl1 is the only stage used because this production will be used as the base prod. to latter tune the NSB.

Why this config is needed

Processing of source 7 with MC processed with lstchain-v0.9.13 for dec. bands dec_4822 and dec_6166 with all available testing nodes.

Command used to produce the lstmcpipe config

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20230601_v0.9.13_dec_4822_dec_6166 --dec_list dec_4822 dec_6166

Also, I removed the stages merge_dl1, train_pipe, dl1_to_dl2 and dl2_to_irfs from the lstmcpipe config file.

2023-06-01

20230529_v0.9.13_src4_full_line

Source with dec 6166 at LZA and NSB tuning

20230529

Production on the full node with all nodes and with to NSB of the LZA data

Short description of the config

Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)

{ "increase_nsb": true, "extra_noise_in_dim_pixels": 2.124, "extra_bias_in_dim_pixels": 0.738, "transition_charge": 8, "extra_noise_in_bright_pixels": 2.766 }

Only test nodes on the declination line are included

The config is produced as following:

{

config = paths_config.PathConfigAllSkyFull('20230529_v0.9.13_src4_full_line', ['dec_6166'])
config.generate()
# mask test outside the line
n_test_points=len(config.test_configs['dec_6166']._testing_pointings)
mask_test=np.zeros(n_test_points,dtype=bool)
for point in np.arange(n_test_points):
    zd=90*u.deg-config.test_configs['dec_6166']._testing_pointings['alt'][point]
    az=config.test_configs['dec_6166']._testing_pointings['az'][point]

    for test in np.arange(len(test_zd)):
        dist=angular_separation(az,zd,test_az[test]*u.deg,test_zd[test]*u.deg)

        if dist < 1.*u.deg:
            mask_test[point]=True

# select only the on line tests   
config.test_configs['dec_6166']._testing_pointings=config.test_configs['dec_6166']._testing_pointings = config.test_configs['dec_6166']._testing_pointings[mask_test]
# generate again
config.generate()

config.save_yml('lstmcpipe_config_2023-05-29_PathConfigAllSkyFull.yaml', overwrite=True)

}


Plot:

config.plot_pointings() ```

2023-05-18

20230517_v0.9.13_large_offset_crab_tuned

20230517_v0.9.13_large_offset_crab_tuned

DL1ab step to apply NSB tuning for Crab gamma diffuse MC.

lstchain config taken from '20221027_v0.9.9_crab_tuned'

Contact : Mathieu de Bony, Mathieu de Bony, Léo Le Moigne, David Sanchez

2023-05-17

20230517_v0.9.13_large_offset

20230517_v0.9.13_large_offset

DL1 production of the test node for IRF using gamma diffuse MC

lstchain config taken from '20230127_v0.9.12_base_prod_az_tel'

Contact : Mathieu de Bony, Léo Le Moigne, David Sanchez

2023-04-28

20230428_src_dec2276_tuned_nsb_az_tel

New Prod Config

20230428

Short description of the config

Config for a galactic source with dec 22.47 and NSB tuning. Started from prod 20230315_src_dec2276_tuned_nsb with new lstchain config.

Why this config is needed

The feature az_tel must be used to analyse real data.

2023-04-20

20230315_src_dec2276_tuned_nsb

New Prod Config

20230315

Short description of the config

Config for a galactic source with dec 22.47 and NSB tuning:

"image_modifier": { "increase_nsb": true, "extra_noise_in_dim_pixels": 1.309, "extra_bias_in_dim_pixels": 0.54, "transition_charge": 8, "extra_noise_in_bright_pixels": 1.79 } The NSB parameters have been computed by using lstchain script lstchain_tune_nsb with configuration file lstchain_config_v0.9.4_from2022onwards.json.

The configuration file for lstchain and lstmcpipe included in this directory have been produced by running

source /fefs/aswg/software/conda/etc/profile.d/conda.sh

conda activate lstchain-v0.9.13

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_2276 --prod_id 20230315_src_dec2276_tuned_nsb --kwargs source_prod_id=20230315_src_dec2276_tuned_nsb

Why this config is needed

Processing of data taken from this galactic source which has a particular NSB level.

2023-04-16

20230414_v0.9.13_dec_931_az_tel

prod 20230414_v0.9.13_dec_931_az_tel

Reprocessing of faulty dec_931. This production should be used instead of 20230127_v0.9.12_base_prod_az_tel for dec_931.

See related issues: - https://github.com/cta-observatory/lstmcpipe/issues/371 - https://github.com/cta-observatory/lst-sim-config/issues/55

The config was generated using:

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20230414_v0.9.13_dec_931_az_tel --output lstmcpipe_config.yml --overwrite --lstchain_conf lstchain_config.json --dec_list dec_931

After failure of the merging step, the faulty DL1 files were removed to allow proper merging and the processing was started again, commenting the r0_to_dl1 step.

2023-04-01

20230329_v0.9.13_src4_full_line

Source with dec 6166 at LZA and NSB tuning

20230329

Production on the full node (but still with some nodes missing) and with to NSB of the LZA data

Short description of the config

Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)

{ "increase_nsb": true, "extra_noise_in_dim_pixels": 2.124, "extra_bias_in_dim_pixels": 0.738, "transition_charge": 8, "extra_noise_in_bright_pixels": 2.766 }

Only test nodes on the declination line are included


Plot:

config.plot_pointings() ```

2023-01-27

20230127_v0.9.12_base_prod_az_tel

New Prod Config

template_prod

Short description of the config

Full MC / model dataset with lstchain v0.9.12 standard settings / az instead of sin(az) in training features.

Why this config is needed

Processing standard AGN data (+Crab) with recent lstchain (after the discussion in slack). Last full production with Models date from May 2022. For now requesting a standard 'un-tuned' production to evaluate blind reconstruction and to test how a 'bad NSB setting' can spoil the SED.

Declination tracks needed:

dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413

Command to produce this request:

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20230127_v0.9.12_base_prod_az_tel --output lstmcpipe_config.yml --overwrite --lstchain_conf lstchain_config.json --dec_list dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413

and then replace sin_az_tel with az_tel in lstchain config

Note on dec_931

16/04/2023, T. Vuillaume.

dec_931 from this prod is faulty and thus should not be used! Please use prod 20230414_v0.9.13_dec_931_az_tel instead.

2023-01-25

20230124_src6_dec2276_tuned

New Prod Config

Prod_ID

20230124_src6_dec2276_tuned

Short description of the config

dec_2276 with NSB tuning to src6 and src-dependent configuration.

Why this config is needed

Reprocess the data at declination 22.76 with version of lstchain v0.9.12 and with new tunning for new source: src6.

Other information

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20230124_src6_dec2276_tuned --dec_list dec_2276 --kwargs source_prod_id=20221215_v0.9.12_base_prod
2022-12-16

20221212_v0.9.6_src4_high_NSB_LZA

Source with dec 6166 at LZA and NSB tuning

20221212

LZA production as 20221025_src4_high_NSB_LZA but with lstchain release 0.9.6

Short description of the config

Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)

{ "increase_nsb": true, "extra_noise_in_dim_pixels": 2.124, "extra_bias_in_dim_pixels": 0.738, "transition_charge": 8, "extra_noise_in_bright_pixels": 2.766 }

Config generated with:

from lstmcpipe.config import paths_config
import astropy.units as u

config = paths_config.PathConfigAllSkyFullDL1ab('20221212_v0.9.6_src4_high_NSB_LZA', '20221027_v0.9.9_base_prod', ['dec_6166'])

mask_train = config.train_configs['dec_6166']._training_pointings['alt'] < 38 *u.deg
mask_test = config.test_configs['dec_6166']._testing_pointings['alt'] < 38 *u.deg

config.test_configs['dec_6166']._testing_pointings = config.test_configs['dec_6166']._testing_pointings[mask_test]
config.train_configs['dec_6166']._training_pointings = config.train_configs['dec_6166']._training_pointings[mask_train]

config.generate()

config.save_yml('lstmcpipe_config_2022-11-02_PathConfigAllSkyFullDL1ab.yaml', overwrite=True)

Plot:

config.plot_pointings()
2022-12-16

20221215_v0.9.12_base_prod

New Prod Config

template_prod

Short description of the config

Full MC / model dataset with lstchain v0.9.12 standard settings

Why this config is needed

Processing standard AGN data (+Crab) with recent lstchain (after the discussion in slack). Last full production with Models date from May 2022. For now requesting a standard 'un-tuned' production to evaluate blind reconstruction and to test how a 'bad NSB setting' can spoil the SED.

Declination tracks needed:

dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413

Command to produce this request:

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20221215_v0.9.12_base_prod --output lstmcpipe_config.yml --overwrite --lstchain_conf lstchain_config.json --dec_list dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413

Note on dec_931

16/04/2023, T. Vuillaume.

dec_931 from this prod is faulty and thus should not be used! Please use prod 20230414_v0.9.13_dec_931_az_tel instead.

2022-11-29

20221128_src5_dec3476_tuned

New Prod Config

Prod_ID

20221128_src5_dec3476_tuned

Short description of the config

dec_3476 with NSB tuning to src5 and src-dependent configuration.

Why this config is needed

Reprocess the data at declination 34.76 with version of lstchain v0.9.9 and with new tunning for new source: src5.

Other information

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20221128_src5_dec3476_tuned  --dec_list dec_3476 --kwargs source_prod_id=20221027_v0.9.9_base_prod
2022-11-08

20221104_src3_dec3476_4822_tuned

20221104_src3_dec3476_4822_tuned

full DL1ab production (dec3476 and dec4822 with NSB tuning for src3) with lstchain v0.9.9

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20221104_src3_dec3476_4822_tuned --kwargs source_prod_id=20221027_v0.9.9_base_prod --dec_list dec_3476 dec_4822
2022-11-08

20221108_galsource_min_413_tuned_nsb

New Prod Config

Prod_ID

20221108_galsource_min_413_tuned_nsb

Short description of the config

dec_min_413 with NSB tuning to galactic source (src1).

Why this config is needed

Reprocess with the latest version of lstchain v0.9.9. Previous prod_id is galsource_min_413_tuned_nsb.

Other information

RF features following issue #369

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20221108_galsource_min_413_tuned_nsb --kwargs source_prod_id=20221027_v0.9.9_base_prod --dec_list dec_min_413
2022-11-02

20221027_v0.9.9_base_prod

20221027_v0.9.9_base_prod

New full base prod with lstchain v0.9.9 and all declinations and nodes currently available. Commented stages > merge, so only the DL1 will be produced. Training will be done dec wise depending on required tunings / lstchain configs.

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20221027_v0.9.9_base_prod --dec_list dec_2276  dec_3476  dec_4822  dec_6166  dec_6676  dec_931  dec_min_2924  dec_min_413
2022-10-27

20221027_v0.9.9_crab_tuned

20221027_v0.9.9_crab_tuned

DL1ab step to apply NSB tuning for Crab.

Generated config:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --dec_list dec_2276 --prod_id 20221027_v0.9.9_crab_tuned --kwargs source_prod_id=20221021_crab_full_lstchain097

lstchain config taken from 20221021_crab_full_lstchain097

Contact:Thomas or Abelardo

2022-10-26

20221025_src4_high_NSB_LZA

Source with dec 6166 at LZA and NSB tuning

20221025

LZA production: only nodes with zd> 52 deg are processed both for training and for test

Short description of the config

Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)

{ "increase_nsb": true, "extra_noise_in_dim_pixels": 2.124, "extra_bias_in_dim_pixels": 0.738, "transition_charge": 8, "extra_noise_in_bright_pixels": 2.766 }

Config generated with:

from lstmcpipe.config import paths_config
import astropy.units as u

config = paths_config.PathConfigAllSkyFullDL1ab('20221025_src4_high_NSB_LZA', '20221027_v0.9.9_base_prod', ['dec_6166'])

mask_train = config.train_configs['dec_6166']._training_pointings['alt'] < 38 *u.deg
mask_test = config.test_configs['dec_6166']._testing_pointings['alt'] < 38 *u.deg

config.test_configs['dec_6166']._testing_pointings = config.test_configs['dec_6166']._testing_pointings[mask_test]
config.train_configs['dec_6166']._training_pointings = config.train_configs['dec_6166']._training_pointings[mask_train]

config.generate()

config.save_yml('lstmcpipe_config_2022-11-02_PathConfigAllSkyFullDL1ab.yaml', overwrite=True)

Plot:

config.plot_pointings()
2022-10-21

20221021_crab_full_lstchain097

PROD 20221021_crab_full_lstchain097

Full pipeline for Crab (dec_2276) with latest lstchain release v0.9.7

Generated with:

lstmcpipe_generate_config PathConfigAllSkyFull --prod_id 20221021_crab_full_lstchain097 --dec_list dec_2276

Added to lstchain config:

"image_modifier": {
    "increase_nsb": true,
    "extra_noise_in_dim_pixels": 1.62,
    "extra_bias_in_dim_pixels": 0.655,
    "transition_charge": 8,
    "extra_noise_in_bright_pixels": 2.08,
    "increase_psf": false,
    "smeared_light_fraction": 0
  },
2022-10-07

20221006_src3_test_nodes

20221006_src3_test_nodes

DL1ab with tuned configuration (DL1ab + merge DL1)

lstchain config taken from 2022-06-01 prod

command-line:

lstmcpipe_generate_config PathConfigAllSkyTestingDL1ab --prod_id 20221006_src3_test_nodes --kwargs source_prod_id=20220902_crab_test_nodes dec=3476  
2022-10-07

20220913_crab_test_nodes_tuned

20220913_crab_test_nodes_tuned

All test nodes analysed for Crab: NSB tuning and models trained at dec_2276

lstmcpipe_generate_config PathConfigAllSkyTestingDL1ab --prod_id 20220902_crab_test_nodes --kwargs target_prod_id=20220913_crab_test_nodes_tuned dec=dec_2276

Then replaced path models with /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276

Error during merging, restarted by hand the following:

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_14.984_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_14.984_az_175.158__merged.h5 --no-image


lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_32.059_az_102.217_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_32.059_az_102.217__merged.h5 --no-image

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_32.059_az_355.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_32.059_az_355.158__merged.h5 --no-image

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_43.197_az_143.441_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_43.197_az_143.441__merged.h5 --no-image

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_43.197_az_230.005_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_43.197_az_230.005__merged.h5 --no-image

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_52.374_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_52.374_az_175.158__merged.h5 --no-image


lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_60.528_az_223.818_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_60.528_az_223.818__merged.h5 --no-image

lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_68.068_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_68.068_az_175.158__merged.h5 --no-image
2022-09-13

20220913_crab_theta23_tuned

20220913_crab_theta23_tuned

Following production 20220902_crab_test_nodes that had no tuning.

Processing of nodes node_theta_23.630_az_100.758 and node_theta_23.630_az_259.265_ only for: - dl1ab - with tuned config from crab tuned prod - merge - dl1_to_dl2 - with trained RF from crab tuned prod: /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276 - dl2_to_irfs

See https://github.com/cta-observatory/lst-sim-config/issues/49#issuecomment-1235392024

2022-09-12

20220902_crab_test_nodes

New Prod config

20220902_crab_test_nodes

Short description of the config

Generated as:

lstmcpipe_generate_config PathConfigAllSkyTesting --prod_id 20220902_crab_test_nodes --kwargs dec=dec_2276

Then edited manually to replace the path model with /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276/

lstchain config copied from /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276/

Why this config is needed

Config to produce the new test nodes using Crab dec training. See https://github.com/cta-observatory/lst-sim-config/issues/49#issuecomment-1235392024

2022-09-06

20220905_src4_high_NSB

Source with dec 6166 and NSB tuning

20220905

Short description of the config

Config for a source src4 with dec 6166 and NSB tuning:

"image_modifier":{ "increase_nsb": true, "extra_noise_in_dim_pixels": 1.82, "extra_bias_in_dim_pixels": 0.815, "transition_charge": 8, "extra_noise_in_bright_pixels": 4.098 }

2022-06-24

20220624_dec_4822_tuned_TestDIffuseGammas

Allsky Test Diffuse Gammas production, with nsb tuning, for the dec_4822 declination band.

Config files: - lstmcpipe_config_2022-06-24_PathConfigAllSky_TestDiffuseGammas.yaml - lstchain_config_2022-06-24.json

The command used for generating the config files is:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 24_05_2022_dec_4822 --kwargs source_prod_id=20220511_allsky_std --dec_list dec_4822 --overwrite

And then I changed it by hand.

PathConfigAllSkyFullDL1ab -> TestDiffuseGammas 24_05_2022_dec_4822 -> 24062022_dec_4822

Plus I changed the file to match the stages and the nodes that need.

The source for which this production is required is "src2"

2022-06-01

20220601_dec3476_tuned

20220601_dec3476_tuned

DL1ab for dec3476 with tuned configuration

lstchain config taken from 2022-05-23 prod

command-line:

lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 20220601_dec3476_tuned --dec_list dec_3476 --kwargs source_prod_id=20220531_dec3476_std
2022-05-31

20220531_dec3476_std

20220531_dec3476_std

Standard production for declination 3476 that was missing Proton simtel files for some nodes.

Config generated with:

lstmcpipe_generate_config  PathConfigAllSkyFull --prod_id 20220531_dec3476_std --dec_list dec_3476
2022-05-31

20220524_dec_4822_tuned

Allsky MC production, with nsb tuning, for the dec_4822 declination band.

Config files: - lstmcpipe_config_2022-05-24_PathConfigAllSkyFullDL1ab.yaml - lstchain_config_2022-05-24.json

The command used for generating the config files is:

"lstmcpipe_generate_config PathConfigAllSkyFullDL1ab --prod_id 24_05_2022_dec_4822 --kwargs source_prod_id=20220511_allsky_std --dec_list dec_4822 --overwrite"

In a second moment I changed the prod_id (everywhere) by hand, from "24_05_2022" to "24_05_2022_dec_4822"

The source for which this production is required is "src2"

2022-05-30

20220527_allsky_std_src2_diffgamma

20220527_src2_diffgamma

Standard production (no tuning) of DL1 testing diffuse gammas for declination 4822, only four nodes along the src2 path.

2022-05-24

20220523_src3_dec3476_4822_tuned_nsb

Source with dec 3476/4822 and NSB tuning

20220523

Short description of the config

Config for a source with dec 3476/4822 and NSB tuning:

"image_modifier": {
    "increase_nsb": true,
    "extra_noise_in_dim_pixels": 0.977,
    "extra_bias_in_dim_pixels": 0.388,
    "transition_charge": 8,
    "extra_noise_in_bright_pixels": 1.197
}

Why this config is needed

See wiki page (src 3) https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions

2022-05-24

20220523_dec_413_tuned_nsb

Galactic source with dec minus 413 and NSB tuning

20220523

Short description of the config

Config for a galactic source with dec min_413 and NSB tuning:

"image_modifier": { "increase_nsb": true, "extra_noise_in_dim_pixels": 0.937 "extra_bias_in_dim_pixels": 0.323 "transition_charge": 8, "extra_noise_in_bright_pixels": 1.041 }

Why this config is needed

Processing of data taken from this galactic source which has a particular NSB level

2022-05-24

20220523_allsky_std

20220523_allsky_std

Standard production (no tuning) for declinations 6676 and min_2924

Paths

/fefs/aswg/data/mc/IRF/AllSky/20220523_allsky_std/TestingDataset/{dec}/{node}/

/fefs/aswg/data/models/AllSky/20220523_allsky_std/{dec}/
2022-05-20

20220518_v0.9.6_allsky_dec2276_tuned

20220518_allsky_dec2276_tuned

  • DL1ab processing from 20220511_allsky_std production from dec_2276
  • workflow stages:

    • dl1ab
    • merge_dl1
    • train_pipe
    • dl1_to_dl2
    • dl2_to_irfs
  • lstchain config provided by Abelardo

  • paths: /fefs/aswg/data/mc/{data_level}/AllSky/20220518_allsky_dec2276_tuned/{train_test}/dec_2276/

2022-05-20

20220511_v0.9.6_allsky_std

20220511_v0.9.6_allsky_std

AllSky production with standard lstchain config (no tuning) for the following declinations:

['dec_2276','dec_3476','dec_4822','dec_931','dec_min_413']

2022-03-16

20220304_v0.9.3_prod5_trans_80_zen40az180_local_tailcut_8_4

Official prod

20220304_v0.9.3_prod5_trans_80_zen40az180_local_tailcut_8_4

2022-03-16

20220218_v0.9.2_prod5_trans_80_dl1ab_tune_MC_to_Crab

Official prod

20220218_v0.9.2_prod5_trans_80_dl1ab_tune_MC_to_Crab

2022-03-16

20220215_v0.9.1_prod5_trans_80_local_tailcut_8_4

Official prod

20220215_v0.9.1_prod5_trans_80_local_tailcut_8_4

2022-03-16

20210923_v0.7.5_prod5_trans_80_dynamic_cleaning

Official prod

20210923_v0.7.5_prod5_trans_80_dynamic_cleaning

2022-03-16

20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4

Official prod

20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4

2022-03-16

20210416_v0.7.3_prod5_trans_80_local_taicut_8_4

Official prod

20210416_v0.7.3_prod5_trans_80_local_taicut_8_4

2022-03-08

nsb_psf_tuned_zen40_src2

Ze40 south pointing Config

zen40az180_dl1ab_tuned_nsb_psf_src2

Short description of the config

Config for ze40 and south pointing with PSF and NSB tuned on data

Why this config is needed

Processing of data for which tuned MC is missing

2022-03-07

nsb_tuned_zen40_scr1

NSB tuned Config

zen40az180_dl1ab_tuned_nsb_src1

Short description of the config

Config for 40zd and 180deg with tuning to the NSB of the required field

Why this config is needed

Processing of data with specific NSB

2022-03-04

psf_tuned_zen40

New Prod Config

zen40az180_dl1ab_tuned_psf

Short description of the config

Modified standard config to tune the PSF and to run the process for zenith 40 deg, south pointing MC

Why this config is needed

For aiding in the source-independent analysis of sources like the AGNs where the NSB is weak and therefore not requiring any change.

2022-03-03

psf_tuned_zen20

New Prod Config

zen20az180_dl1ab_tuned_psf

Short description of the config

Modified standard config to tune the PSF and to run the process for zenith 20 deg, south pointing MC

Why this config is needed

For aiding in the source-independent analysis of sources like the AGNs where the NSB is weak and therefore not requiring any change.

2022-03-03

template_prod

New Prod Config

template_prod

Short description of the config

Modified standard config to add twice the Crab NSB

Why this config is needed

Processing of Crab night 1054-07-15