2016-07-14 10:40:27 (info) Logger: Start session log file: 2016-07-14-10:40:27-log.txt 2016-07-14 10:40:27 (info) ConfigParametersForApp: Read configuration parameters from file: confpars-calibman.txt 2016-07-14 10:40:27 (warning) ConfigParametersForApp: The file confpars-calibman.txt is not found, use default parameters. 2016-07-14 10:40:28 (info) CalibManager.GUIMainTabs: makeTabBarr - set tab: Status 2016-07-14 10:40:28 (info) CalibManager.GlobalUtils: Directory exists: ./work 2016-07-14 10:40:42 (info) CalibManager.GUIInsExpDirDet: Instrument selected: MFX 2016-07-14 10:40:42 (info) CalibManager.GUIInsExpDirDet: Experiment selected: Select 2016-07-14 10:40:42 (info) CalibManager.GUIInsExpDirDet: Set calibration directory: Select 2016-07-14 10:40:42 (info) CalibManager.GUIInsExpDirDet: Selected detector(s): 2016-07-14 10:40:46 (info) CalibManager.GUIInsExpDirDet: Experiment selected: mfxm5116 2016-07-14 10:40:46 (info) CalibManager.GUIInsExpDirDet: Set calibration directory: /reg/d/psdm/MFX/mfxm5116/calib 2016-07-14 10:40:46 (info) CalibManager.GUIInsExpDirDet: Selected detector(s): 2016-07-14 10:40:46 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 10:40:46 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.099 2016-07-14 10:40:53 (info) CalibManager.GUIRange: Set the range up to "100" 2016-07-14 10:40:53 (info) CalibManager.GUIDarkControlBar: updateRunRange to:100 2016-07-14 10:40:53 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 10:40:53 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.126 2016-07-14 10:41:35 (info) CalibManager.GUIInsExpDirDet: Selected detector(s): Epix100a 2016-07-14 10:41:35 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 10:41:35 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.131 2016-07-14 10:41:42 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 10:41:42 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.100 2016-07-14 10:41:48 (info) CalibManager.GUIDarkListItemRun: onButGo for run 0026 2016-07-14 10:41:48 (info) CalibManager.BatchJobPedestals: on_auto_processing_start() 2016-07-14 10:41:48 (info) CalibManager.BatchJobPedestals: Scan xtc file(s) using command: event_keys -d exp=mfxm5116:run=26:stream=0-79:xtc -n 10 -s 0 -m 1 -p EventKey and save results in the log-file: ./work/clb-mfxm5116-r0026-peds-scan-batch-log.txt 2016-07-14 10:41:49 (info) CalibManager.BatchJobPedestals: Scan for run 0026 is completed 2016-07-14 10:41:49 (info) CalibManager.BatchJobPedestals: LSF status is ok for queue: psnehhiprioq on farm: psnehfarm 2016-07-14 10:41:49 (info) CalibManager.BatchJobPedestals: Avereging xtc file(s) using command: det_ndarr_raw_proc -d exp=mfxm5116:run=26:stream=0-79:xtc -s MfxEndstation.0:Epix100a.0 -n 1000 -m 0 -f ./work/clb-#exp-#run-peds-#type-#src.txt -b 0.100 -t 16000.000 -B 0.100 -T 10000.000 -F 0.1 -p 0 -S 0377 -v 511 -L 5.000 -H 5.000 -D 5.000 -U 5.000 and save results in the log-file: ./work/clb-mfxm5116-r0026-peds-aver-batch-log.txt 2016-07-14 10:41:49 (warning) CalibManager.GlobalUtils: Warning: job being submitted without an AFS token. This warning does not matter for jobs on LCLS NFS, continue 2016-07-14 10:41:49 (info) CalibManager.GlobalUtils: Job <302677> is submitted to queue . 2016-07-14 10:41:53 (warning) CalibManager.GlobalUtils: batch_job_status: Job <302677> is not found in queue 2016-07-14 10:41:53 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0026, Job Id: 302677 submitted on 2016-07-14 10:41:48 status: None 2016-07-14 10:41:58 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0026, Job Id: 302677 submitted on 2016-07-14 10:41:48 status: RUN 2016-07-14 10:42:03 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0026, Job Id: 302677 submitted on 2016-07-14 10:41:48 status: RUN 2016-07-14 10:42:08 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0026, Job Id: 302677 submitted on 2016-07-14 10:41:48 status: RUN 2016-07-14 10:42:13 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0026, Job Id: 302677 submitted on 2016-07-14 10:41:48 status: DONE 2016-07-14 10:42:13 (info) CalibManager.BatchJobPedestals: on_auto_processing_status: Averaging is completed, stop processing for run 0026. 2016-07-14 10:42:13 (info) CalibManager.BatchJob: Auto-processing for run 0026 IS STOPPED 2016-07-14 10:42:13 (info) CalibManager.GUIDarkListItemRun: onStop - buttons status should be updated now for 0026 2016-07-14 10:42:22 (info) CalibManager.GUIRange: Set the range from "0023" 2016-07-14 10:42:26 (info) CalibManager.FileDeployer: Tentative deployment commands: cp ./work/clb-mfxm5116-r0026-peds-ave-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/23-end.data cp ./work/clb-mfxm5116-r0026-peds-rms-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/23-end.data cp ./work/clb-mfxm5116-r0026-peds-sta-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/23-end.data 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0026-peds-ave-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/23-end.data 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Add record: file:23-end.data copy_of:./work/clb-mfxm5116-r0026-peds-ave-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0026 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T10:42:29 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/HISTORY 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0026-peds-rms-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/23-end.data 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Add record: file:23-end.data copy_of:./work/clb-mfxm5116-r0026-peds-rms-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0026 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T10:42:29 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/HISTORY 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0026-peds-sta-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/23-end.data 2016-07-14 10:42:29 (info) CalibManager.FileDeployer: Add record: file:23-end.data copy_of:./work/clb-mfxm5116-r0026-peds-sta-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0026 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T10:42:29 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/HISTORY 2016-07-14 12:32:29 (info) CalibManager.GUIDarkList: Signal received: new xtc file is available, msg: thread_id:0.600461 counter:113 last_run:27 2016-07-14 12:32:29 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 12:32:29 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.199 2016-07-14 12:40:29 (info) CalibManager.GUIDarkList: Signal received: new xtc file is available, msg: thread_id:0.600461 counter:121 last_run:28 2016-07-14 12:40:29 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 12:40:29 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.149 2016-07-14 16:11:03 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 16:11:04 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.249 2016-07-14 16:11:06 (info) CalibManager.GUIDarkListItemRun: onButGo for run 0029 2016-07-14 16:11:06 (info) CalibManager.BatchJobPedestals: on_auto_processing_start() 2016-07-14 16:11:06 (info) CalibManager.BatchJobPedestals: Scan xtc file(s) using command: event_keys -d exp=mfxm5116:run=29:stream=0-79:xtc -n 10 -s 0 -m 1 -p EventKey and save results in the log-file: ./work/clb-mfxm5116-r0029-peds-scan-batch-log.txt 2016-07-14 16:11:07 (info) CalibManager.BatchJobPedestals: Scan for run 0029 is completed 2016-07-14 16:11:07 (info) CalibManager.BatchJobPedestals: LSF status for queue: psnehhiprioq on farm: psnehfarm Command: bhosts psnehfarm HOST_NAME STATUS JL/U MAX NJOBS RUN SSUSP USUSP RSV psana1501 closed - 16 32 16 16 0 0 psana1502 closed - 16 16 16 0 0 0 psana1503 closed - 16 16 16 0 0 0 psana1504 closed - 16 16 16 0 0 0 psana1505 closed - 16 16 16 0 0 0 psana1506 closed - 16 16 16 0 0 0 psana1507 closed - 16 16 16 0 0 0 psana1508 closed - 16 16 16 0 0 0 psana1509 closed - 16 16 16 0 0 0 psana1510 closed - 16 16 16 0 0 0 psana1511 closed - 16 16 16 0 0 0 psana1512 closed - 16 16 16 0 0 0 psana1513 closed - 16 16 16 0 0 0 psana1514 closed - 16 16 16 0 0 0 psana1515 closed - 16 16 16 0 0 0 psana1516 closed - 16 16 16 0 0 0 psana1517 closed - 16 16 16 0 0 0 psana1518 closed - 16 16 16 0 0 0 psana1519 closed - 16 16 16 0 0 0 psana1520 closed - 16 16 16 0 0 0 Number of nodes:20, ok:0, closed:20, unavail:0, status:False 2016-07-14 16:11:07 (warning) CalibManager.BatchJobPedestals: LSF farm for queue psnehhiprioq IS BUSY OR DOES NOT WORK !!! 2016-07-14 16:11:08 (info) CalibManager.BatchJobPedestals: Avereging xtc file(s) using command: det_ndarr_raw_proc -d exp=mfxm5116:run=29:stream=0-79:xtc -s MfxEndstation.0:Epix100a.0 -n 1000 -m 0 -f ./work/clb-#exp-#run-peds-#type-#src.txt -b 0.100 -t 16000.000 -B 0.100 -T 10000.000 -F 0.1 -p 0 -S 0377 -v 511 -L 5.000 -H 5.000 -D 5.000 -U 5.000 and save results in the log-file: ./work/clb-mfxm5116-r0029-peds-aver-batch-log.txt 2016-07-14 16:11:08 (warning) CalibManager.GlobalUtils: Warning: job being submitted without an AFS token. This warning does not matter for jobs on LCLS NFS, continue 2016-07-14 16:11:08 (info) CalibManager.GlobalUtils: Job <403555> is submitted to queue . 2016-07-14 16:11:09 (warning) CalibManager.GlobalUtils: batch_job_status: Job <403555> is not found in queue 2016-07-14 16:11:09 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0029, Job Id: 403555 submitted on 2016-07-14 16:11:06 status: None 2016-07-14 16:11:14 (warning) CalibManager.GlobalUtils: batch_job_status: Job <403555> is not found in queue 2016-07-14 16:11:14 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0029, Job Id: 403555 submitted on 2016-07-14 16:11:06 status: None 2016-07-14 16:11:19 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0029, Job Id: 403555 submitted on 2016-07-14 16:11:06 status: RUN 2016-07-14 16:11:24 (info) CalibManager.BatchJobPedestals: Stage 2 for run 0029, Job Id: 403555 submitted on 2016-07-14 16:11:06 status: RUN 2016-07-14 16:11:24 (info) CalibManager.BatchJobPedestals: on_auto_processing_status: Averaging is completed, stop processing for run 0029. 2016-07-14 16:11:24 (info) CalibManager.BatchJob: Auto-processing for run 0029 IS STOPPED 2016-07-14 16:11:24 (info) CalibManager.GUIDarkListItemRun: onStop - buttons status should be updated now for 0029 2016-07-14 16:11:30 (info) CalibManager.GUIDarkList: Signal received: new xtc file is available, msg: thread_id:0.600461 counter:332 last_run:29 2016-07-14 16:11:30 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 16:11:30 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.156 2016-07-14 16:11:35 (info) CalibManager.FileDeployer: Tentative deployment commands: cp ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/29-end.data cp ./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/29-end.data cp ./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/29-end.data 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/29-end.data 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:11:37 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/HISTORY 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/29-end.data 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:11:37 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/HISTORY 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/29-end.data 2016-07-14 16:11:37 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:11:37 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/HISTORY 2016-07-14 16:12:29 (info) CalibManager.FileDeployer: Tentative deployment commands: cp ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/29-end.data cp ./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/29-end.data cp ./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/29-end.data 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/29-end.data 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:12:32 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/HISTORY 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/29-end.data 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-rms-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:12:32 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/HISTORY 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/29-end.data 2016-07-14 16:12:32 (info) CalibManager.FileDeployer: Add record: file:29-end.data copy_of:./work/clb-mfxm5116-r0029-peds-sta-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0029 comment:calibman-dark user:weninc host:psanaphi101.pcdsn cptime:2016-07-14T16:12:32 zone:PDT to history file: /reg/d/psdm/MFX/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/HISTORY 2016-07-14 16:13:24 (info) CalibManager.GUIDarkList: Begin to update the list of runs. It is slow procedure that takes ~0.1s/run, stay calm and wait. 2016-07-14 16:13:24 (info) CalibManager.GUIDarkList: Consumed time to generate list of files (sec) = 0.144 2016-07-14 16:13:31 (info) CalibManager.GUIFileBrowser: onBox - selected file: ./work/clb-mfxm5116-r0029-peds-scan-batch-log.txt 2016-07-14 16:13:44 (info) CalibManager.GUIDarkMoreOpts: Selected file to plot: ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt 2016-07-14 16:13:44 (info) CalibManager.GlobalUtils: Get array from file: ./work/clb-mfxm5116-r0029-peds-ave-MfxEndstation.0:Epix100a.0.txt 2016-07-14 16:15:19 (info) GUIMain: closeEvent 2016-07-14 16:15:19 (info) CalibManager.GUIInsExpDirDet: closeEvent 2016-07-14 16:15:19 (info) GUIMainTabs: closeEvent 2016-07-14 16:15:19 (info) GUIMain: Save main window x,y,w,h : 128, 361, 2026, 1294 2016-07-14 16:15:19 (info) CalibManager.ConfigParametersForApp: save configuration parameters in file: confpars-calibman.txt 2016-07-14 16:15:19 (info) ConfigParametersForApp: Save configuration parameters in file: confpars-calibman.txt