Production list#
Find below the list of lstmcpipe productions. Real source names are not provided here. To find the actual source name corresponding to its ID used in the prod ID, visit the LST wiki page.
Request date |
Directory name |
Prod ID |
readme |
---|---|---|---|
2024-11-12 |
20240917_v0.10.12_src15_dec_min_2924_tuned |
# PROD 20240917_v0.10.12_src15_dec_min_2924_tuned I need this production to analyse the LST-1 data of src15 (see https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions) with dec 29.24 deg. The median of the NSB standard deviation for this dataset is approximately 2.308 p.e. ‘’’ lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_min_2924 –prod_id 20240917_v0.10.12_src15_dec_min_2924_tuned –kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base ‘’’ Config for the NSB tuning:
Contact: Lisa N |
|
2024-09-06 |
20240906_v0.10.9_GC_dec_min_2924_tuned |
# Prod 20240828_v0.10.9_GC_dec_min_2924_tuned ## Description of the config
## lstchain_tune_nsb command
## lstmcpipe config command
Then used the script below to add time and nice options to each step.
## Why this production is needed? To analyze the Galactic Center data at dec_min_2924. |
|
2024-08-30 |
20240821_v0.10.11_src14_dec2276_tuned |
# New Prod Config ## Prod_ID 20240821_v0.10.11_src14_tuned ## Description full DL1ab production (with NSB tuning for src14) with lstchain v0.10.11 NSB level was checked in the following way: ``` input_mc = /fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/Protons/dec_2276/sim_telarray/node_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run10.simtel.gz input_data = /fefs/aswg/data/real/DL1/20240613/v0.10/tailcut84/dl1_LST-1.Run17799.0016.h5 print(“this config was downloaded (and modified) on %s” % download_config_modified_time) config_file = Path(“./lstchain_standard_config.json”) lstchain_tune_nsb –config standard_lstchain_config.json –input-mc /fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/Protons/dec_2276/sim_telarray/node_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run10.simtel.gz –input-data /fefs/aswg/data/real/DL1/20240613/v0.10/tailcut84/dl1_LST-1.Run17799.0016.h5 -o tuned_lstchain_config.json ## Why this config is needed Analysis of future data taken on src14 ## Config file creation The config file was initially cretaed by using lstmcpipe_generate_config: ‘’’ lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_2276 –prod_id 20240821_v0.10.11_src14_dec2276_tuned –kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base |
|
2024-08-06 |
20240727_v0.10.11_src12_tuned |
# New Prod Config ## Prod_ID 20240727_v0.10.11_src12_tuned ## Short description of the config full DL1ab production (with NSB tuning for src12) with lstchain v0.10.11 NSB level was checked in the following way: ``` input_mc_base = Path(“/fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/GammaDiffuse/”) input_mc = input_mc_base / “dec_min_413/sim_telarray/node_corsika_theta_33.058_az_173.79_/output_v1.4/simtel_corsika_theta_33.058_az_173.79_run1.simtel.gz” input_data_base = Path(“/fefs/aswg/data/real/DL1/”) input_data = input_data_base / “20240701/v0.10/tailcut84/dl1_LST-1.Run17967.0000.h5” print(“this config was downloaded (and modified) on %s” % download_config_modified_time) config_file = Path(“./lstchain_standard_config.json”) !lstchain_tune_nsb –input-mc $input_mc –input-data $input_data –config $config_file ``` The resulting values are the followings: ``` this config was downloaded (and modified) on 2024-07-27 10:21:03
Good and not too bright pixels: 1812
These are pasted on the lstchain_config_2024-07-27.json. contact: Hideaki Katagiri ## Why this config is needed Reprocess the data of src12 with version of lstchain v0.10.11 and with NSB tunning. ## Other information ### command-line:
|
|
2024-07-17 |
20240716_v0.10.7_src10_dec3476_tuned |
# Product Configuration for src10 ## Prod_ID 20240716_v0.10.7_src10_dec3476_tuned ## Description Config for reprocessing of Gamma Diffuse MC at declination line of 34.76 deg, based on 20240430_v0.10.4_src9_dec3476_tuned. NSB tuning adapted to the observed data of src10. ## Objective Need diffuse MC with tuning for new source: src10 ## Config file creation The config file was initially cretaed by using lstmcpipe_generate_config: ‘’’ lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_3476 –prod_id 20240716_v0.10.7_src10_dec3476_tuned –kwargs source_prod_id=20240430_v0.10.4_src9_dec3476_tuned ‘’’ Added image_modifier to tune NSB to src10. Manually edited to split dataset similar as 20240430_v0.10.4_src9_dec3476_tuned. |
|
2024-06-07 |
20240529_v0.10.11_src4_dense_MC_line |
# Source with dec 6166 at LZA and NSB tuning ## 20240529 Production on the full high density line (dec_6166_high_density) with all nodes and with to NSB of the LZA data ## Short description of the config Config for a source src4 with line dec_6166_high_density and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)
} Only test nodes on the declination line are included The config is produced as following: {
} Plot:
|
|
2024-05-17 |
20240430_v0.10.4_src9_dec3476_tuned |
# New Product Configuration for src9 ## Prod_ID 20240430_v0.10.4_src9_dec3476_tuned ## Description Config for training RF splitting Gamma Diffuse MC datasets in halves for the declination line of 34.76 deg. NSB tuning adapted to the observed data of src9. ## Objective Prepare full enclosure IRFs for src9. ## Config file creation
Then, some manually changes were added in order to split the datasets and add the specific NSB tuning configuration parameters. |
|
2024-05-03 |
20240426_v0.10.9_src3_dec3476_4822_tunedNSB |
# Source with dec 3476/4822 and NSB tuning for moon data (x3-4 the previous production, which was made to reproduce the specific dark background of the source due to its proximity to the galactic plane). The mean_diffuse_nsb_std for this dataset is approximately 3 p.e. ## Prod_ID 20240426_v0.10.9_src3_dec3476_4822_tunedNSB ## 20240426 lstmcpipe_generate_config PathConfigAllSkyFull –prod_id 20240426_v0.10.9_src3_dec3476_4822_tunedNSB –dec_list dec_3476 dec_4822 ## Short description of the config Config for a source with dec within 3476/4822 and NSB tuning:
## Why this config is needed See wiki page (src 3) https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions |
|
2024-03-07 |
20240122_v0.10.4_prod5_trans80 |
# 20240122_v0.10.4_prod5_trans80 20 degrees for performance study lstmcpipe_generate_config PathConfigProd5Trans80 –prod_id 20240122_v0.10.4_prod5_trans80 Contact : Mathieu de Bony, Léo Le Moigne, David Sanchez |
|
2024-02-29 |
20240229_dec34_nsb14 |
DL1a=> Production for the dec_3476 line and high NSB conditions, with cleaning levels (14, 7) Command: lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_3476 –prod_id 20240229_dec34_nsb14 –kwargs source_prod_id=20240131_allsky_v0.10.5_all_dec_base Then I modified in the yaml file the versions of lstchain and lstmcpipe to be used |
|
2024-02-26 |
20240126_v0.10.4_src6_dec2276_tuned |
# New Prod Config ## Prod_ID 20240126_v0.10.4_src6_dec2276_tuned ## Short description of the config Config for the processing of MC at dec_2276 with NSB tuning to src6 and src-dependent configuration using a specific NSB tunning for the source. ## Why this config is needed Reprocess the data at declination 22.76 with version of lstchain v0.10.4 and with new tunning for new source: src6. ## Other information ### command-line:
|
|
2024-02-19 |
20240219_allsky_v0.10.7_all_dec_srcdep_base |
# Prod 20240219_allsky_v0.10.7_all_dec_srcdep_base Base production for all declinations lines with lstchain v0.10.7 & source-dependent approach
contact: Seiya N. |
|
2024-02-07 |
20240131_allsky_v0.10.5_all_dec_base |
# Prod 20240131_allsky_v0.10.5_all_dec_base Base production for all declinations lines with lstchain v0.10.5
contact: Thomas V. |
|
2024-02-06 |
20240206_v0.10.5_lst_school_dummy_prod |
# PROD 20240206_v0.10.5_lst_school_dummy_prod I need this production for the LST school
contact: Thomas V. |
|
2024-02-05 |
20240131_allsky_v0.10.5_all_dec_base |
# Prod 20240235_v0.10.5_dec_931_dec_min_2924_dec_3476 Base prod with missing declinations in 20240131_allsky_v0.10.5_all_dec_base
contact: Thomas V. |
|
2023-11-06 |
20231106_v0.9.12_base_dl1_dec_931_min-2924_min-1802_6166 |
# Prod 20231106_v0.9.12_base_dl1_dec_931_min-2924_min-1802_6166 Base DL1 prod for missing declination in 20221215_v0.9.12_base_prod
contact: Thomas Vuillaume |
|
2023-10-27 |
20231017_v0.10.4_seasonal_atmospheres_summer |
# 20231017_v0.10.4_seasonal_atmospheres_summer Full production of a test node simulated with a summer atmospheric profile. Reconstructed with
The goal is to estimate the systematics introduced by using the same average winter atmospheric profile in order to analyse all LST data. The config file was created manually, inspired by the configurations of the production 20230927_v0.10.4_crab_tuned. Contact : Georgios Voutsinas |
|
2023-10-24 |
20231024_v0.10.4_base_dec_min_2924_min_1802_6166 |
# Prod 20231024_v0.10.4_base_dec_min_2924_min_1802_6166 Base prod for missing declination in 20230901_v0.10.4_base_prod
contact: Thomas Vuillaume |
|
2023-09-28 |
20230927_v0.10.4_crab_tuned |
# New Prod Config ## Prod_ID 20230927_v0.10.4_crab_tuned ## Short description of the config full DL1ab production (with NSB tuning for Crab) with lstchain v0.10.4 NSB level was checked in the following way: input_mc = Path(“/fefs/aswg/data/mc/DL0/LSTProd2/TrainingDataset/GammaDiffuse/dec_2276/sim_telarray/node_corsika_theta_6.000_az_180.000_/output_v1.4/simtel_corsika_theta_6.000_az_180.000_run1.simtel.gz”) input_data = Path(“/fefs/aswg/data/real/DL1/20221201/v0.9/tailcut84/dl1_LST-1.Run11282.0000.h5”) print(“this config is commit ac7d379 on Sep 14, 2023 “) config_file = Path(“./lstchain_standard_config.json”) !lstchain_tune_nsb –input-mc $input_mc –input-data $input_data –config $config_file The resulting values are the followings: this config is commit ac7d379 on Sep 14, 2023 Real data: median across camera of good pixels’ pedestal std 2.633 p.e. Number of pixels beyond 3 std dev of median: 34, (above 3.82 p.e.) Good and not too bright pixels: 1811
} These are pasted on the lstchain_config_2023-09-27.json. contact: Hideaki Katagiri ## Why this config is needed Reprocess the data of Crab with version of lstchain v0.10.4 and with tunning. ## Other information ### command-line:
|
|
2023-09-25 |
20230925_v0.10.4_src3_dec3476_4822_tuned |
# New Prod Config ## Prod_ID 20230925_v0.10.4_src3_dec3476_4822_tuned ## Short description of the config full DL1ab production (dec3476 and dec4822 with NSB tuning for src3) with lstchain v0.10.4 contact: Seiya Nozaki ## Why this config is needed Reprocess the data at declination 34.76 and 48.22 with version of lstchain v0.10.4 and with tunning for src3. ## Other information ### command-line:
|
|
2023-09-01 |
20230901_v0.10.4_allsky_base_prod |
# New Prod Config ## 20230901_v0.10.4_base_prod ## Short description of the config Full allsky production with lstchain v0.10.4 standard settings (cta-observatory/cta-lstchain) Only change to the config is the added integration_correction, that is needed for simulations. ## Why this config is needed There have been datamodel-changes in the transition from lstchain 0.9 to 0.10, which is why a new production is in order. Also old lstchain configs dont necessarily work with the new versions (e.g. due to floating point verbose values). This request includes all declination lines and no NSB-tuning in order act as a new baseline. For the same reason all processing steps are included. That should make it possible to directly compare the performance to the older 20230127_v0.9.12_base_prod_az_tel production. For Crab or other high-NSB sources, a dl1ab reprocessing or another podcution will thus be needed. ## Command to produce
|
|
2023-08-30 |
20230829_src5_dec3476_v0.10_tuned |
# New Prod Config ## Prod_ID 20230829_src5_dec3476_v0.10_tuned ## Short description of the config dec_3476 with NSB tuning to src5, src-dependent and lstchain v0.10 configuration. ## Why this config is needed Reprocess the data at declination 34.76 with version of lstchain v0.10 and with tunning for src5. ## Other information ### command-line:
|
|
2023-06-19 |
20230601_v0.9.13_src7_darkNSB |
# New Prod Config ## Prod_ID 20230601_v0.9.13_src7_darkNSB ## Short description of the config Reprocess production of 20230601_v0.9.13_dec_4822_dec_6166 matching the NSB noise to source 7 in dark conditions. ## Why this config is needed Add NSB noise to match the NSB in the FoV of source 7 in the production 20230601_v0.9.13_dec_4822_dec_6166 ## Command used to produce the lstmcpipe config lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_4822 dec_6166 –prod_id 20230601_v0.9.13_src7_darkNSB –kwargs source_prod_id=20230601_v0.9.13_dec_4822_dec_6166 Also, I increased the memory for the DL2 to IRF stage o 100 GB following the fix memory issue in prod. 20230329_v0.9.13_src4_full_line. |
|
2023-06-05 |
20230529_v0.9.13_src4_full_line |
# Source with dec 6166 at LZA and NSB tuning ## 20230529 Production on the full node with all nodes and with to NSB of the LZA data ## Short description of the config Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)
} Only test nodes on the declination line are included The config is produced as following: {
} Plot:
|
|
2023-06-02 |
20230601_v0.9.13_dec_4822_dec_6166 |
# New Prod Config ## Prod_ID 20230601_v0.9.13_dec_4822_dec_6166 ## Short description of the config Create a production with lstchain-v0.9.13 with all testing nodes for dec_4822 and dec_6166. The stage r0_to_dl1 is the only stage used because this production will be used as the base prod. to latter tune the NSB. ## Why this config is needed Processing of source 7 with MC processed with lstchain-v0.9.13 for dec. bands dec_4822 and dec_6166 with all available testing nodes. ## Command used to produce the lstmcpipe config lstmcpipe_generate_config PathConfigAllSkyFull –prod_id 20230601_v0.9.13_dec_4822_dec_6166 –dec_list dec_4822 dec_6166 Also, I removed the stages merge_dl1, train_pipe, dl1_to_dl2 and dl2_to_irfs from the lstmcpipe config file. |
|
2023-05-18 |
20230517_v0.9.13_large_offset_crab_tuned |
# 20230517_v0.9.13_large_offset_crab_tuned DL1ab step to apply NSB tuning for Crab gamma diffuse MC. lstchain config taken from ‘20221027_v0.9.9_crab_tuned’ Contact : Mathieu de Bony, Mathieu de Bony, Léo Le Moigne, David Sanchez |
|
2023-05-17 |
20230517_v0.9.13_large_offset |
# 20230517_v0.9.13_large_offset DL1 production of the test node for IRF using gamma diffuse MC lstchain config taken from ‘20230127_v0.9.12_base_prod_az_tel’ Contact : Mathieu de Bony, Léo Le Moigne, David Sanchez |
|
2023-04-28 |
20230428_src_dec2276_tuned_nsb_az_tel |
# New Prod Config ## 20230428 ## Short description of the config Config for a galactic source with dec 22.47 and NSB tuning. Started from prod 20230315_src_dec2276_tuned_nsb with new lstchain config. ## Why this config is needed The feature az_tel must be used to analyse real data. |
|
2023-04-20 |
20230315_src_dec2276_tuned_nsb |
# New Prod Config ## 20230315 ## Short description of the config Config for a galactic source with dec 22.47 and NSB tuning:
The NSB parameters have been computed by using lstchain script lstchain_tune_nsb with configuration file lstchain_config_v0.9.4_from2022onwards.json. The configuration file for lstchain and lstmcpipe included in this directory have been produced by running ``` source /fefs/aswg/software/conda/etc/profile.d/conda.sh conda activate lstchain-v0.9.13 lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –dec_list dec_2276 –prod_id 20230315_src_dec2276_tuned_nsb –kwargs source_prod_id=20230315_src_dec2276_tuned_nsb ``` ## Why this config is needed Processing of data taken from this galactic source which has a particular NSB level. |
|
2023-04-16 |
20230414_v0.9.13_dec_931_az_tel |
# prod 20230414_v0.9.13_dec_931_az_tel Reprocessing of faulty dec_931. This production should be used instead of 20230127_v0.9.12_base_prod_az_tel for dec_931. See related issues: - cta-observatory/lstmcpipe#371 - cta-observatory/lst-sim-config#55 The config was generated using:
After failure of the merging step, the faulty DL1 files were removed to allow proper merging and the processing was started again, commenting the r0_to_dl1 step. |
|
2023-04-16 |
20230127_v0.9.12_base_prod_az_tel |
# New Prod Config ## template_prod ## Short description of the config Full MC / model dataset with lstchain v0.9.12 standard settings / az instead of sin(az) in training features. ## Why this config is needed Processing standard AGN data (+Crab) with recent lstchain (after the discussion in slack). Last full production with Models date from May 2022. For now requesting a standard ‘un-tuned’ production to evaluate blind reconstruction and to test how a ‘bad NSB setting’ can spoil the SED. Declination tracks needed: dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413 Command to produce this request:
and then replace sin_az_tel with az_tel in lstchain config ## Note on dec_931 16/04/2023, T. Vuillaume. dec_931 from this prod is faulty and thus should not be used! Please use prod 20230414_v0.9.13_dec_931_az_tel instead. |
|
2023-04-16 |
20221215_v0.9.12_base_prod |
# New Prod Config ## template_prod ## Short description of the config Full MC / model dataset with lstchain v0.9.12 standard settings ## Why this config is needed Processing standard AGN data (+Crab) with recent lstchain (after the discussion in slack). Last full production with Models date from May 2022. For now requesting a standard ‘un-tuned’ production to evaluate blind reconstruction and to test how a ‘bad NSB setting’ can spoil the SED. Declination tracks needed: dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413 Command to produce this request: >> lstmcpipe_generate_config PathConfigAllSkyFull –prod_id 20221215_v0.9.12_base_prod –output lstmcpipe_config.yml –overwrite –lstchain_conf lstchain_config.json –dec_list dec_2276 dec_3476 dec_4822 dec_6676 dec_931 dec_min_413 ## Note on dec_931 16/04/2023, T. Vuillaume. dec_931 from this prod is faulty and thus should not be used! Please use prod 20230414_v0.9.13_dec_931_az_tel instead. |
|
2023-04-05 |
20230329_v0.9.13_src4_full_line |
# Source with dec 6166 at LZA and NSB tuning ## 20230329 Production on the full node (but still with some nodes missing) and with to NSB of the LZA data ## Short description of the config Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)
} Only test nodes on the declination line are included Plot:
|
|
2023-01-25 |
20230124_src6_dec2276_tuned |
# New Prod Config ## Prod_ID 20230124_src6_dec2276_tuned ## Short description of the config dec_2276 with NSB tuning to src6 and src-dependent configuration. ## Why this config is needed Reprocess the data at declination 22.76 with version of lstchain v0.9.12 and with new tunning for new source: src6. ## Other information ### command-line:
|
|
2022-12-16 |
20221212_v0.9.6_src4_high_NSB_LZA |
# Source with dec 6166 at LZA and NSB tuning ## 20221212 LZA production as 20221025_src4_high_NSB_LZA but with lstchain release 0.9.6 ## Short description of the config Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)
} Config generated with: ``` from lstmcpipe.config import paths_config import astropy.units as u config = paths_config.PathConfigAllSkyFullDL1ab(‘20221212_v0.9.6_src4_high_NSB_LZA’, ‘20221027_v0.9.9_base_prod’, [‘dec_6166’]) mask_train = config.train_configs[‘dec_6166’]._training_pointings[‘alt’] < 38 *u.deg mask_test = config.test_configs[‘dec_6166’]._testing_pointings[‘alt’] < 38 *u.deg config.test_configs[‘dec_6166’]._testing_pointings = config.test_configs[‘dec_6166’]._testing_pointings[mask_test] config.train_configs[‘dec_6166’]._training_pointings = config.train_configs[‘dec_6166’]._training_pointings[mask_train] config.generate() config.save_yml(‘lstmcpipe_config_2022-11-02_PathConfigAllSkyFullDL1ab.yaml’, overwrite=True) Plot:
|
|
2022-12-08 |
20221025_src4_high_NSB_LZA |
# Source with dec 6166 at LZA and NSB tuning ## 20221025 LZA production: only nodes with zd> 52 deg are processed both for training and for test ## Short description of the config Config for a source src4 with dec 6166 and NSB tuning corresponding or pedestal std 1.9 pe (reference run 8649, zd=65.5, reference MC simtel_corsika_theta_65.796_az_31.344_run1.simtel.gz)
} Config generated with: ``` from lstmcpipe.config import paths_config import astropy.units as u config = paths_config.PathConfigAllSkyFullDL1ab(‘20221025_src4_high_NSB_LZA’, ‘20221027_v0.9.9_base_prod’, [‘dec_6166’]) mask_train = config.train_configs[‘dec_6166’]._training_pointings[‘alt’] < 38 *u.deg mask_test = config.test_configs[‘dec_6166’]._testing_pointings[‘alt’] < 38 *u.deg config.test_configs[‘dec_6166’]._testing_pointings = config.test_configs[‘dec_6166’]._testing_pointings[mask_test] config.train_configs[‘dec_6166’]._training_pointings = config.train_configs[‘dec_6166’]._training_pointings[mask_train] config.generate() config.save_yml(‘lstmcpipe_config_2022-11-02_PathConfigAllSkyFullDL1ab.yaml’, overwrite=True) Plot:
|
|
2022-12-01 |
20221128_src5_dec3476_tuned |
# New Prod Config ## Prod_ID 20221128_src5_dec3476_tuned ## Short description of the config dec_3476 with NSB tuning to src5 and src-dependent configuration. ## Why this config is needed Reprocess the data at declination 34.76 with version of lstchain v0.9.9 and with new tunning for new source: src5. ## Other information ### command-line:
|
|
2022-11-08 |
20221104_src3_dec3476_4822_tuned |
# 20221104_src3_dec3476_4822_tuned full DL1ab production (dec3476 and dec4822 with NSB tuning for src3) with lstchain v0.9.9 ## command-line:
|
|
2022-11-08 |
20221108_galsource_min_413_tuned_nsb |
# New Prod Config ## Prod_ID 20221108_galsource_min_413_tuned_nsb ## Short description of the config dec_min_413 with NSB tuning to galactic source (src1). ## Why this config is needed Reprocess with the latest version of lstchain v0.9.9. Previous prod_id is galsource_min_413_tuned_nsb. ## Other information RF features following issue #369 ### command-line:
|
|
2022-11-02 |
20221027_v0.9.9_base_prod |
# 20221027_v0.9.9_base_prod New full base prod with lstchain v0.9.9 and all declinations and nodes currently available. Commented stages > merge, so only the DL1 will be produced. Training will be done dec wise depending on required tunings / lstchain configs.
|
|
2022-10-27 |
20221027_v0.9.9_crab_tuned |
# 20221027_v0.9.9_crab_tuned DL1ab step to apply NSB tuning for Crab. Generated config:
lstchain config taken from 20221021_crab_full_lstchain097 Contact:Thomas or Abelardo |
|
2022-10-21 |
20221021_crab_full_lstchain097 |
# PROD 20221021_crab_full_lstchain097 Full pipeline for Crab (dec_2276) with latest lstchain release v0.9.7 Generated with:
Added to lstchain config: ``` “image_modifier”: {
|
|
2022-10-10 |
20220913_crab_theta23_tuned |
# 20220913_crab_theta23_tuned Following production 20220902_crab_test_nodes that had no tuning. Processing of nodes node_theta_23.630_az_100.758 and node_theta_23.630_az_259.265_ only for: - dl1ab
|
|
2022-10-08 |
20221006_src3_test_nodes |
# 20221006_src3_test_nodes DL1ab with tuned configuration (DL1ab + merge DL1) lstchain config taken from 2022-06-01 prod ## command-line:
|
|
2022-10-07 |
20220913_crab_test_nodes_tuned |
# 20220913_crab_test_nodes_tuned All test nodes analysed for Crab: NSB tuning and models trained at dec_2276
Then replaced path models with /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276 Error during merging, restarted by hand the following: ``` lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_14.984_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_14.984_az_175.158__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_32.059_az_102.217_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_32.059_az_102.217__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_32.059_az_355.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_32.059_az_355.158__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_43.197_az_143.441_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_43.197_az_143.441__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_43.197_az_230.005_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_43.197_az_230.005__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_52.374_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_52.374_az_175.158__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_60.528_az_223.818_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_60.528_az_223.818__merged.h5 –no-image lstchain_merge_hdf5_files -d /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/node_theta_68.068_az_175.158_/ -o /fefs/aswg/data/mc/DL1/AllSky/20220913_crab_test_nodes_tuned/TestingDataset/dl1_20220913_crab_test_nodes_tuned_node_theta_68.068_az_175.158__merged.h5 –no-image ``` |
|
2022-09-12 |
20220902_crab_test_nodes |
# New Prod config ## 20220902_crab_test_nodes ## Short description of the config Generated as:
Then edited manually to replace the path model with /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276/ lstchain config copied from /fefs/aswg/data/models/AllSky/20220518_allsky_dec2276_tuned/dec_2276/ ## Why this config is needed Config to produce the new test nodes using Crab dec training. See cta-observatory/lst-sim-config#49 |
|
2022-09-06 |
template |
# New Prod Config ## template_prod ## Short description of the config Modified standard config to add twice the Crab NSB ## Why this config is needed Processing of Crab night 1054-07-15 |
|
2022-09-06 |
20220905_src4_high_NSB |
# Source with dec 6166 and NSB tuning ## 20220905 ## Short description of the config Config for a source src4 with dec 6166 and NSB tuning:
} |
|
2022-06-27 |
20220624_dec_4822_tuned |
Allsky Test Diffuse Gammas production, with nsb tuning, for the dec_4822 declination band. Config files: - lstmcpipe_config_2022-06-24_PathConfigAllSky_TestDiffuseGammas.yaml - lstchain_config_2022-06-24.json The command used for generating the config files is:
And then I changed it by hand. PathConfigAllSkyFullDL1ab -> TestDiffuseGammas 24_05_2022_dec_4822 -> 24062022_dec_4822 Plus I changed the file to match the stages and the nodes that need. The source for which this production is required is “src2” |
|
2022-06-01 |
20220601_dec3476_tuned |
# 20220601_dec3476_tuned DL1ab for dec3476 with tuned configuration lstchain config taken from 2022-05-23 prod ## command-line:
|
|
2022-05-31 |
20220531_dec3476_std |
# 20220531_dec3476_std Standard production for declination 3476 that was missing Proton simtel files for some nodes. Config generated with:
|
|
2022-05-31 |
20220524_dec_4822_tuned |
Allsky MC production, with nsb tuning, for the dec_4822 declination band. Config files: - lstmcpipe_config_2022-05-24_PathConfigAllSkyFullDL1ab.yaml - lstchain_config_2022-05-24.json The command used for generating the config files is: “lstmcpipe_generate_config PathConfigAllSkyFullDL1ab –prod_id 24_05_2022_dec_4822 –kwargs source_prod_id=20220511_allsky_std –dec_list dec_4822 –overwrite” In a second moment I changed the prod_id (everywhere) by hand, from “24_05_2022” to “24_05_2022_dec_4822” The source for which this production is required is “src2” |
|
2022-05-30 |
20220527_src2_diffgamma |
# 20220527_src2_diffgamma Standard production (no tuning) of DL1 testing diffuse gammas for declination 4822, only four nodes along the src2 path. |
|
2022-05-25 |
galsource_min_413_tuned_nsb |
# Galactic source with dec minus 413 and NSB tuning ## 20220523 ## Short description of the config Config for a galactic source with dec min_413 and NSB tuning:
## Why this config is needed Processing of data taken from this galactic source which has a particular NSB level |
|
2022-05-24 |
src3_dec3476_4822_tuned_nsb |
# Source with dec 3476/4822 and NSB tuning ## 20220523 ## Short description of the config Config for a source with dec 3476/4822 and NSB tuning:
## Why this config is needed See wiki page (src 3) https://www.lst1.iac.es/wiki/index.php/MC_analysis_and_IRF_production#lstmcpipe_productions |
|
2022-05-24 |
20220523_allsky_std |
# 20220523_allsky_std Standard production (no tuning) for declinations 6676 and min_2924 ## Paths ``` /fefs/aswg/data/mc/IRF/AllSky/20220523_allsky_std/TestingDataset/{dec}/{node}/ /fefs/aswg/data/models/AllSky/20220523_allsky_std/{dec}/ ``` |
|
2022-05-20 |
20220518_allsky_dec2276_tuned |
# 20220518_allsky_dec2276_tuned
|
|
2022-05-20 |
20220511_allsky_std |
# 20220511_v0.9.6_allsky_std AllSky production with standard lstchain config (no tuning) for the following declinations: [‘dec_2276’,’dec_3476’,’dec_4822’,’dec_931’,’dec_min_413’] |
|
2022-03-21 |
local_tailcut_8_4 |
# Official prod ## 20220215_v0.9.1_prod5_trans_80_local_tailcut_8_4 |
|
2022-03-16 |
zen40az180_local_tailcut_8_4 |
#Official prod ##20220304_v0.9.3_prod5_trans_80_zen40az180_local_tailcut_8_4 |
|
2022-03-16 |
dl1ab_tune_MC_to_Crab |
#Official prod ##20220218_v0.9.2_prod5_trans_80_dl1ab_tune_MC_to_Crab |
|
2022-03-16 |
dynamic_cleaning |
#Official prod ##20210923_v0.7.5_prod5_trans_80_dynamic_cleaning |
|
2022-03-16 |
zen40deg_local_tailcut_8_4 |
#Official prod ##20210506_v0.7.3_prod5_trans_80_zen40deg_local_tailcut_8_4 |
|
2022-03-16 |
local_taicut_8_4 |
#Official prod ##20210416_v0.7.3_prod5_trans_80_local_taicut_8_4 |
|
2022-03-08 |
zen40az180_dl1ab_tuned_nsb_psf_src2 |
# Ze40 south pointing Config ## zen40az180_dl1ab_tuned_nsb_psf_src2 ## Short description of the config Config for ze40 and south pointing with PSF and NSB tuned on data ## Why this config is needed Processing of data for which tuned MC is missing |
|
2022-03-07 |
zen40az180_dl1ab_tuned_nsb_src1 |
# NSB tuned Config ## zen40az180_dl1ab_tuned_nsb_src1 ## Short description of the config Config for 40zd and 180deg with tuning to the NSB of the required field ## Why this config is needed Processing of data with specific NSB |
|
2022-03-04 |
zen40az180_dl1ab_tuned_psf |
# New Prod Config ## zen40az180_dl1ab_tuned_psf ## Short description of the config Modified standard config to tune the PSF and to run the process for zenith 40 deg, south pointing MC ## Why this config is needed For aiding in the source-independent analysis of sources like the AGNs where the NSB is weak and therefore not requiring any change. |
|
2022-03-04 |
zen20az180_dl1ab_tuned_psf |
# New Prod Config ## zen20az180_dl1ab_tuned_psf ## Short description of the config Modified standard config to tune the PSF and to run the process for zenith 20 deg, south pointing MC ## Why this config is needed For aiding in the source-independent analysis of sources like the AGNs where the NSB is weak and therefore not requiring any change. |