2016-07-14 09:15:59 (info) Logger: Start session log file: 2016-07-14-09:15:59-log.txt 2016-07-14 09:15:59 (info) ConfigParametersForApp: Read configuration parameters from file: confpars-calibman.txt 2016-07-14 09:15:59 (warning) ConfigParametersForApp: The file confpars-calibman.txt is not found, use default parameters. 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: Command line for book-keeping: /reg/g/psdm/sw/releases/ana-current/arch/x86_64-rhel7-gcc48-opt/bin/calibrun --exp=mfxm5116 --run=18 --detector=EPIX100A --process --deploy --calibdir=/reg/d/psdm/mfx/mfxm5116/calib 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ print_local_pars(): Combination of command line parameters and configuration parameters from file confpars-calibman.txt (if available after "calibman") str_run_number: 0018 runrange : 18-end exp_name : mfxm5116 instr_name : mfx workdir : ./work calibdir : /reg/d/psdm/mfx/mfxm5116/calib xtcdir : det_name : EPIX100A queue : None num_events : 999 skip_events : 1 scan_events : 10 timeout_sec : 2000 thr_int_min : 0.100000 thr_int_max : 16000.000000 thr_rms_min : 0.100000 thr_rms_max : 10000.000000 intnlo : 5.000000 intnhi : 5.000000 rmsnlo : 5.000000 rmsnhi : 5.000000 process : True deploy : True loadcfg : False print_bits : 30 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ List of detectors: cspad False cspad2x2 False princeton False pnccd False tm6740 False opal1000 False opal2000 False opal4000 False opal8000 False orcafl40 False epix100a True fccd960 False rayonix False andor False dualandor False acqiris False 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ List of xtc files for exp=mfxm5116:run=0018 : e789-r0018-s00-c00.xtc e789-r0018-s01-c00.xtc e789-r0018-s02-c00.xtc e789-r0018-s03-c00.xtc e789-r0018-s04-c00.xtc e789-r0018-s80-c00.xtc 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ Sources from DB: List of detectors for inst: mfx exp: mfxm5116 run 18 BldEb.0:NoDevice.0 EpicsArch.0:NoDevice.0 MfxEndstation.0:Epix100a.0 MfxEndstation.0:Opal4000.0 MfxEndstation.0:Rayonix.0 MfxEndstation.0:Wave8.0 NoDetector.0:Evr.0 2016-07-14 09:16:00 (info) CalibManager.GlobalUtils: Directory exists: ./work 2016-07-14 09:16:00 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ Begin dark run data processing interactively 2016-07-14 09:16:00 (info) CalibManager.BatchJobPedestals: Scan xtc file(s) using command: event_keys -d exp=mfxm5116:run=18:stream=0-79:xtc -n 10 -s 0 -m 1 -p EventKey and save results in the log-file: ./work/clb-mfxm5116-r0018-peds-scan-batch-log.txt 2016-07-14 09:16:01 (info) CalibManager.BatchJobPedestals: Scan for run 0018 is completed 2016-07-14 09:16:01 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ Data Types and Sources from xtc scan of the log file: ./work/clb-mfxm5116-r0018-peds-scan-batch-log.txt Expecting data for detector(s): EPIX100A EvrData::DataV4 : NoDetector.0:Evr.0 Camera::FrameV1 : MfxEndstation.0:Opal4000.0 Camera::FrameV1 : MfxEndstation.0:Rayonix.0 Epix::ElementV3 : MfxEndstation.0:Epix100a.0 Generic1D::DataV0 : MfxEndstation.0:Wave8.0 Bld::BldDataEBeamV7 : EBeam Bld::BldDataPhaseCavity : PhaseCavity Bld::BldDataFEEGasDetEnergyV1 : FEEGasDetEnergy 2016-07-14 09:16:01 (info) CalibManager.BatchJobPedestals: Avereging xtc file(s) using command: det_ndarr_raw_proc -d exp=mfxm5116:run=18:stream=0-79:xtc -s MfxEndstation.0:Epix100a.0 -n 1000 -m 0 -f ./work/clb-#exp-#run-peds-#type-#src.txt -b 0.100 -t 16000.000 -B 0.100 -T 10000.000 -F 0.1 -p 0 -S 0377 -v 511 -L 5.000 -H 5.000 -D 5.000 -U 5.000 and save results in the log-file: ./work/clb-mfxm5116-r0018-peds-aver-batch-log.txt 2016-07-14 09:16:30 (info) CalibManager.BatchJobPedestals: Avereging for run 0018 is completed 2016-07-14 09:16:30 (critical) CalibManager.CommandLineCalib: ------------------------------------------------------------ Subprocess for averaging is completed with warning/error message(s); see details in the logfile(s). 2016-07-14 09:16:30 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ psana log file ./work/clb-mfxm5116-r0018-peds-aver-batch-log.txt: Command: /reg/g/psdm/sw/releases/ana-current/arch/x86_64-rhel7-gcc48-opt/bin/det_ndarr_raw_proc -d exp=mfxm5116:run=18:stream=0-79:xtc -s MfxEndstation.0:Epix100a.0 -n 1000 -m 0 -f ./work/clb-#exp-#run-peds-#type-#src.txt -b 0.100 -t 16000.000 -B 0.100 -T 10000.000 -F 0.1 -p 0 -S 0377 -v 511 -L 5.000 -H 5.000 -D 5.000 -U 5.000 Options: intnhi : 5.0 savebw : 255 rmslow : 0.1 rmshig : 10000.0 intlow : 0.1 intnlo : 5.0 verbos : 511 dsname : exp=mfxm5116:run=18:stream=0-79:xtc nsigma : 6.0 fraclm : 0.1 source : MfxEndstation.0:Epix100a.0 rmsnlo : 5.0 evskip : 0 inthig : 16000.0 ofname : ./work/clb-#exp-#run-peds-#type-#src.txt plotim : 0 events : 1000 rmsnhi : 5.0 Arguments: [] Raw data processing of dataset: exp=mfxm5116:run=18:stream=0-79:xtc __________________________________________________ Attributes of the DetNDArrRawProc object dataset name : exp=mfxm5116:run=18:stream=0-79:xtc source name : MfxEndstation.0:Epix100a.0 output file name template : ./work/clb-#exp-#run-peds-#type-#src.txt number of events to collect : 1000 number of events to skip : 0 number of events for stage 1 : 50 number of sigma intensity range : 6.000 control bit-word to plot images : 0 control bit-word for verbosity : 511 control bit-word to save arrays : 255 INTENSITY low limit (ADU) : 0.1 INTENSITY high limit (ADU) : 16000.0 RMS low limit (ADU) : 0.1 RMS high limit (ADU) : 10000.0 allowed low/high fraction limit : 0.100 Parameters for auto-evaluation of limits: number of sigma from mean for INTENSITY low limit : 5.0 number of sigma from mean for INTENSITY high limit : 5.0 number of sigma from mean for RMS low limit : 5.0 number of sigma from mean for RMS high limit : 5.0 __________________________________________________ Begin processing Begin stage 1 for MfxEndstation.0:Epix100a.0, raw.shape = (704, 768), intensity limits low: 0.1 high: 16000.0 Event: 0, time= 1.109 sec, dt=1.109 sec Event: 1, time= 1.128 sec, dt=0.019 sec Event: 2, time= 2.512 sec, dt=1.384 sec Event: 3, time= 2.528 sec, dt=0.016 sec Event: 4, time= 2.543 sec, dt=0.015 sec Event: 5, time= 2.558 sec, dt=0.015 sec Event: 10, time= 2.639 sec, dt=0.080 sec Event: 20, time= 3.582 sec, dt=0.944 sec Event: 30, time= 3.794 sec, dt=0.212 sec Event: 40, time= 4.042 sec, dt=0.248 sec ________________________________________________________________________________ Begin stage 2 for MfxEndstation.0:Epix100a.0 after 50 events mean rms=2.860 x 6.0 = intensity gate= +/- 17.160 around pixel average intensity Stage 2 initialization for MfxEndstation.0:Epix100a.0 consumes dt= 0.028 sec Event: 50, time= 4.319 sec, dt=0.277 sec Event: 100, time= 5.532 sec, dt=1.213 sec Event: 200, time= 8.580 sec, dt=3.048 sec Event: 300, time= 10.497 sec, dt=1.916 sec Event: 400, time= 13.095 sec, dt=2.599 sec Event: 500, time= 15.577 sec, dt=2.482 sec Event: 600, time= 17.463 sec, dt=1.887 sec Event: 700, time= 19.395 sec, dt=1.932 sec Event: 800, time= 22.101 sec, dt=2.706 sec Event: 900, time= 24.653 sec, dt=2.552 sec ________________________________________________________________________________ Raw data for MfxEndstation.0:Epix100a.0 found in 1000 events, begin data summary stage evaluate_limits: RMS ave, std = 2.962, 0.382 low, high limits = 1.050, 4.873 evaluate_limits: AVE ave, std = 4040.427, 268.560 low, high limits = 2697.628, 5383.225 Bad pixel status: status 1: 1695 pixel rms > 4.873 status 8: 19 pixel rms < 1.050 status 2: 3 pixel intensity > 16000 in more than 0.1 fraction of events status 4: 0 pixel intensity < 0.1 in more than 0.1 fraction of events status 16: 17 pixel average > 5383.23 status 32: 16 pixel average < 2697.63 Evaluate common mode for source: MfxEndstation.0:Epix100a.0 det: Epix100a, estimated intensity ave: 4040.214 rms: 2.953 File ./work/clb-mfxm5116-r0018-peds-ave-MfxEndstation.0:Epix100a.0.txt is saved File ./work/clb-mfxm5116-r0018-peds-rms-MfxEndstation.0:Epix100a.0.txt is saved File ./work/clb-mfxm5116-r0018-peds-sta-MfxEndstation.0:Epix100a.0.txt is saved File ./work/clb-mfxm5116-r0018-peds-msk-MfxEndstation.0:Epix100a.0.txt is saved File ./work/clb-mfxm5116-r0018-peds-max-MfxEndstation.0:Epix100a.0.txt is saved File ./work/clb-mfxm5116-r0018-peds-min-MfxEndstation.0:Epix100a.0.txt is saved Data summary for MfxEndstation.0:Epix100a.0 is completed, dt= 1.234 sec ________________________________________________________________________________ Total consumed time = 27.949880 sec. End of psana log file ./work/clb-mfxm5116-r0018-peds-aver-batch-log.txt 2016-07-14 09:16:30 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ List of files in work directory for command "ls ./work/clb-mfxm5116-r0018-*": ./work/clb-mfxm5116-r0018-peds-ave-MfxEndstation.0:Epix100a.0.txt ./work/clb-mfxm5116-r0018-peds-aver-batch-log.txt ./work/clb-mfxm5116-r0018-peds-max-MfxEndstation.0:Epix100a.0.txt ./work/clb-mfxm5116-r0018-peds-min-MfxEndstation.0:Epix100a.0.txt ./work/clb-mfxm5116-r0018-peds-msk-MfxEndstation.0:Epix100a.0.txt ./work/clb-mfxm5116-r0018-peds-rms-MfxEndstation.0:Epix100a.0.txt ./work/clb-mfxm5116-r0018-peds-scan-batch-log.txt ./work/clb-mfxm5116-r0018-peds-sta-MfxEndstation.0:Epix100a.0.txt 2016-07-14 09:16:30 (info) CalibManager.CommandLineCalib: ------------------------------------------------------------ Begin deployment of calibration files 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Tentative deployment commands: cp ./work/clb-mfxm5116-r0018-peds-ave-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/18-end.data cp ./work/clb-mfxm5116-r0018-peds-rms-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/18-end.data cp ./work/clb-mfxm5116-r0018-peds-sta-MfxEndstation.0:Epix100a.0.txt /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/18-end.data 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0018-peds-ave-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/18-end.data 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Add record: file:18-end.data copy_of:./work/clb-mfxm5116-r0018-peds-ave-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0018 comment:calibrun-dark user:tjlane host:psanagpu102 cptime:2016-07-14T09:16:30 zone:PDT to history file: /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pedestals/HISTORY 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0018-peds-rms-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/18-end.data 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Add record: file:18-end.data copy_of:./work/clb-mfxm5116-r0018-peds-rms-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0018 comment:calibrun-dark user:tjlane host:psanagpu102 cptime:2016-07-14T09:16:30 zone:PDT to history file: /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_rms/HISTORY 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Command: cat ./work/clb-mfxm5116-r0018-peds-sta-MfxEndstation.0:Epix100a.0.txt > /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/18-end.data 2016-07-14 09:16:30 (info) CalibManager.FileDeployer: Add record: file:18-end.data copy_of:./work/clb-mfxm5116-r0018-peds-sta-MfxEndstation.0:Epix100a.0.txt exp:mfxm5116 run:0018 comment:calibrun-dark user:tjlane host:psanagpu102 cptime:2016-07-14T09:16:30 zone:PDT to history file: /reg/d/psdm/mfx/mfxm5116/calib/Epix100a::CalibV1/MfxEndstation.0:Epix100a.0/pixel_status/HISTORY 2016-07-14 09:16:30 (info) CalibManager.CommandLineCalib: Deployment of calibration files is completed See details in log-file: ./work/2016-07-14-09:15:59-log.txt