03/12/2020 12:00:28.38 03/12/2020 12:00:30.19 C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty dist /MIR /COPYALL 1>nul ) & rmdir /S /Q dist\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tests /MIR /COPYALL 1>nul ) & rmdir /S /Q tests\ & ) C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty doc /MIR /COPYALL 1>nul ) & rmdir /S /Q doc\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tmp /MIR /COPYALL 1>nul ) & rmdir /S /Q tmp\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty base /MIR /COPYALL 1>nul ) & rmdir /S /Q base\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty base_tmp /MIR /COPYALL 1>nul ) & rmdir /S /Q base_tmp\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty build /MIR /COPYALL 1>nul ) & rmdir /S /Q build\ & ) C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty conda_base /MIR /COPYALL 1>nul ) & rmdir /S /Q conda_base\ & ) Already up to date. Current branch master is up to date. From https://github.com/cctbx/cctbx_project cd76789348..93f2169338 master -> origin/master 92ac2b4bb7..2a29266f8c NGL_HKLviewer2 -> origin/NGL_HKLviewer2 * [new branch] config_shifter_image -> origin/config_shifter_image 435c1f9745..89fa493e30 gpumonolithic -> origin/gpumonolithic + 97d168a563...7b0899c265 shifter-fixes-3 -> origin/shifter-fixes-3 (forced update) Updating cd76789348..93f2169338 Fast-forward .azure-pipelines/base-linux.yml | 10 + .azure-pipelines/conda-linux.yml | 10 + .azure-pipelines/xfel/conda-linux.yml | 10 + cctbx/development/create_models_or_maps.py | 2 +- cctbx/maptbx/segment_and_split_map.py | 13 ++ iotbx/map_model_manager.py | 8 +- .../add_from_future_import_division.py | 4 +- mmtbx/hydrogens/reduce_hydrogen.py | 2 +- mmtbx/pdbtools.py | 5 + mmtbx/programs/atom_selection.py | 3 +- mmtbx/programs/rama_z.py | 2 +- mmtbx/secondary_structure/find_ss_from_ca.py | 9 +- xfel/command_line/cxi_mpi_submit.py | 19 +- .../application/filter/reflection_filter.py | 12 +- xfel/ui/command_line/print_run_stats.py | 3 +- xfel/ui/components/submission_tracker.py | 22 ++- xfel/ui/components/xfel_gui_dialogs.py | 209 ++++++++++++++++++--- xfel/ui/db/cfgs/__init__.py | 0 xfel/ui/db/cfgs/shifter_templates.py | 45 +++++ xfel/ui/db/cfgs/submit_xfel_merge.phil | 12 ++ xfel/ui/db/cfgs/submit_xfel_process.phil | 12 ++ xfel/ui/db/job.py | 22 ++- xfel/ui/db/merging_log_scraper.py | 2 + xfel/util/mp.py | 156 ++++++++++----- 24 files changed, 491 insertions(+), 101 deletions(-) create mode 100644 xfel/ui/db/cfgs/__init__.py create mode 100644 xfel/ui/db/cfgs/shifter_templates.py Current branch master is up to date. Already up to date. Current branch master is up to date. Already up to date. Current branch master is up to date. From https://github.com/dials/dxtbx 6b50090..8659093 master -> origin/master Already up to date. Current branch dials-2.2 is up to date. Your branch is up to date with 'origin/dials-2.2'. Already on 'dials-2.2' Branch 'dials-2.2' set up to track remote branch 'dials-2.2' from 'origin'. Already up to date. Current branch master is up to date. Performing actions: cleanup hot update ===== Running in .: deleting dist, tests, doc, tmp, base, base_tmp, build, conda_base Existing non-git directory -- don't know what to do. skipping: scons Existing non-git directory -- don't know what to do. skipping: annlib Existing non-git directory -- don't know what to do. skipping: clipper ===== Running in modules\cbflib: git pull --rebase ===== Running in modules\cctbx_project: git pull --rebase Existing non-git directory -- don't know what to do. skipping: eigen ===== Running in modules\annlib_adaptbx: git pull --rebase ===== Running in modules\reduce: git pull --rebase Existing non-git directory -- don't know what to do. skipping: ccp4io Existing non-git directory -- don't know what to do. skipping: tntbx ===== Running in modules\dxtbx: git pull --rebase ===== Running in modules\dxtbx: git remote set-url origin https://github.com/dials/dxtbx.git ===== Running in modules\dxtbx: git fetch origin ===== Running in modules\dxtbx: git checkout dials-2.2 ===== Running in modules\dxtbx: git branch --set-upstream-to=origin/dials-2.2 dials-2.2 Existing non-git directory -- don't know what to do. skipping: ccp4io_adaptbx ===== Running in modules\boost: git pull --rebase Existing non-git directory -- don't know what to do. skipping: gui_resources removing .pyc files in C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules, walk? True removed 212 files Bootstrap success: cleanup, hot, update 03/12/2020 12:13:21.92 03/12/2020 12:13:26.40 C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty dist /MIR /COPYALL 1>nul ) & rmdir /S /Q dist\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tests /MIR /COPYALL 1>nul ) & rmdir /S /Q tests\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tmp /MIR /COPYALL 1>nul ) & rmdir /S /Q tmp\ & ) The system cannot find the file specified. Base conda installation: C:\Users\phaserbuilder\NightlyBuilds\PhaserVC2015\Current\mc3 Installing cctbx environment with: C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\auto_build\conda_envs\cctbx_py27_win-64.txt Completed installation into: C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base Python: 2.7.15 "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\python.exe" Compiler: default Build mode: release Warning level: 0 Precompiled Headers: False Static libraries: False Static exe: False Scan Boost headers: False Write full flex_fwd.h files: False Build Boost.Python extensions: True Define BOOST_PYTHON_NO_PY_SIGNATURES: False Define BOOST_PYTHON_BOOL_INT_STRICT: True Enable OpenMP if possible: False Boost threads enabled: True Enable CUDA: False Use conda: True Use opt_resources if available: False Use environment flags: False Enable C++11: False command_version_suffix: None Relocatable paths anchored at: c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\build Top-down list of all modules involved: wxtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\wxtbx" gltbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\gltbx" crys3d "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\crys3d" cctbx_website "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cctbx_website" mmtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\mmtbx" reduce "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\reduce" iotbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\iotbx" dxtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\dxtbx" cbflib+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cbflib" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cbflib_adaptbx" ccp4io+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\ccp4io" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\ccp4io_adaptbx" smtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\smtbx" ucif "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\ucif" cctbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cctbx" scitbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\scitbx" fable "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\fable" omptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\omptbx" boost+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\boost" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\boost_adaptbx" tbxx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\tbxx" chiltbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\chiltbx" libtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\libtbx" Creating files in build directory: "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\build" dispatcher_include_template.bat setpaths.bat setpaths_all.bat setpaths_debug.bat unsetpaths.bat SConstruct Processing: "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\libtbx\command_line" Traceback (most recent call last): File "..\modules\cctbx_project\libtbx\configure.py", line 34, in if not run(): File "..\modules\cctbx_project\libtbx\configure.py", line 29, in run libtbx.env_config.cold_start(sys.argv) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 3000, in cold_start env.refresh() File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2227, in refresh module.process_command_line_directories() File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2540, in process_command_line_directories scan_for_libtbx_set_dispatcher_name=True) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2437, in write_dispatcher try: import IPython File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\__init__.py", line 49, in from .terminal.embed import embed File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\terminal\embed.py", line 17, in from IPython.core.interactiveshell import DummyMod, InteractiveShell File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\core\interactiveshell.py", line 199, in class InteractiveShell(SingletonConfigurable): File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\core\interactiveshell.py", line 261, in InteractiveShell help="Set the color scheme (NoColor, Neutral, Linux, or LightBG)." File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\traitlets\traitlets.py", line 2151, in __init__ values = [cast_unicode_py2(value) for value in values] File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\ipython_genutils\py3compat.py", line 26, in cast_unicode return decode(s, encoding) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\ipython_genutils\py3compat.py", line 17, in decode return s.decode(encoding, "replace") LookupError: unknown encoding: cp65001 Performing actions: base build Installing base packages using: python modules\cctbx_project\libtbx\auto_build\install_conda.py --builder=cctbx --install_conda --python=27 ===== Running in .: deleting dist, tests, tmp removing .pyc files in C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules, walk? True removed 2 files ===== Running in .: base ===== Running in build: run configure.py Process failed with return code 1 C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\auto_build\install_conda.py:355: RuntimeWarning: There is a mismatch between the conda settings in your home directory and what "conda info" is reporting. This is not a fatal error, but if an error is encountered, please check that your conda installation and environments exist and are working. warnings.warn(message, RuntimeWarning) 03/12/2020 12:17:29.63 C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty dist /MIR /COPYALL 1>nul ) & rmdir /S /Q dist\ & ) The system cannot find the file specified. C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tests /MIR /COPYALL 1>nul ) & rmdir /S /Q tests\ & ) C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current>((ROBOCOPY empty tmp /MIR /COPYALL 1>nul ) & rmdir /S /Q tmp\ & ) The system cannot find the file specified. Python: 2.7.15 "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\python.exe" Compiler: default Build mode: release Warning level: 0 Precompiled Headers: False Static libraries: False Static exe: False Scan Boost headers: False Write full flex_fwd.h files: False Build Boost.Python extensions: True Define BOOST_PYTHON_NO_PY_SIGNATURES: False Define BOOST_PYTHON_BOOL_INT_STRICT: True Enable OpenMP if possible: False Boost threads enabled: True Enable CUDA: False Use conda: True Use opt_resources if available: False Use environment flags: False Enable C++11: False command_version_suffix: None Relocatable paths anchored at: c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\build Top-down list of all modules involved: wxtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\wxtbx" gltbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\gltbx" crys3d "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\crys3d" cctbx_website "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cctbx_website" mmtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\mmtbx" reduce "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\reduce" iotbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\iotbx" dxtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\dxtbx" cbflib+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cbflib" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cbflib_adaptbx" ccp4io+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\ccp4io" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\ccp4io_adaptbx" smtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\smtbx" ucif "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\ucif" cctbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\cctbx" scitbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\scitbx" fable "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\fable" omptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\omptbx" boost+adaptbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\boost" "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\boost_adaptbx" tbxx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\tbxx" chiltbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\chiltbx" libtbx "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\libtbx" Creating files in build directory: "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\build" dispatcher_include_template.bat setpaths.bat setpaths_all.bat setpaths_debug.bat unsetpaths.bat SConstruct Processing: "c:\users\phaserbuilder\nightlybuilds\cctbxvc2008\x64\current\modules\cctbx_project\libtbx\command_line" Traceback (most recent call last): File "..\modules\cctbx_project\libtbx\configure.py", line 34, in if not run(): File "..\modules\cctbx_project\libtbx\configure.py", line 29, in run libtbx.env_config.cold_start(sys.argv) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 3000, in cold_start env.refresh() File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2227, in refresh module.process_command_line_directories() File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2540, in process_command_line_directories scan_for_libtbx_set_dispatcher_name=True) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules\cctbx_project\libtbx\env_config.py", line 2437, in write_dispatcher try: import IPython File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\__init__.py", line 49, in from .terminal.embed import embed File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\terminal\embed.py", line 17, in from IPython.core.interactiveshell import DummyMod, InteractiveShell File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\core\interactiveshell.py", line 199, in class InteractiveShell(SingletonConfigurable): File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\IPython\core\interactiveshell.py", line 261, in InteractiveShell help="Set the color scheme (NoColor, Neutral, Linux, or LightBG)." File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\traitlets\traitlets.py", line 2151, in __init__ values = [cast_unicode_py2(value) for value in values] File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\ipython_genutils\py3compat.py", line 26, in cast_unicode return decode(s, encoding) File "C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\conda_base\lib\site-packages\ipython_genutils\py3compat.py", line 17, in decode return s.decode(encoding, "replace") LookupError: unknown encoding: cp65001 Performing actions: build ===== Running in .: deleting dist, tests, tmp removing .pyc files in C:\Users\phaserbuilder\NightlyBuilds\CCTBXVC2008\x64\Current\modules, walk? True removed 2 files ===== Running in build: run configure.py Process failed with return code 1 03/12/2020 12:21:22.08