<core_client_version>8.2.8</core_client_version> <![CDATA[ <stderr_txt> 2026-03-12 08:34:29 (1073670): wrapper (8.3.26019): starting 2026-03-12 08:34:29 (1073670): unexpected tag in job.xml: multi_process/ 2026-03-12 08:34:29 (1073670): wrapper: running ../../projects/axiom.heliex.net/axiom_experiment_626_gpu (wu.json result.json) 2026-03-12 08:34:29 (1073670): wrapper: created child process 1073672 [GPU] CuPy CUDA: 7841MB total, 6386MB free [BOINC] Starting BOINC mode [BOINC] GPU detected: 7841MB VRAM, 6386MB free [BOINC] Work unit: wu.json [BOINC] Result file: result.json [BOINC] Current directory: /opt/boinc/instance_homes/boinc_31418/slots/1 [BOINC] Directory contents: ['stderr.txt', 'streaming_wrapper_302_x86_64-pc-linux-gnu', 'boinc_lockfile', 'boinc_mmap_file', 'boinc_setup_complete', 'wrapper_checkpoint.txt', 'axiom_experiment_626_gpu', 'result.json', 'init_data.xml', 'wu.json', '.cupy_cache', 'job.xml'] [BOINC] Resolved soft link: ../../projects/axiom.heliex.net/exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8.json [BOINC] Resolved soft link: ../../projects/axiom.heliex.net/exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8_0_r1543813204_0 [BOINC] Actual WU file: ../../projects/axiom.heliex.net/exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8.json [BOINC] Successfully loaded work unit [BOINC] Experiment container mode detected [EXP] Experiment mode: exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8 [EXP] Script URL: https://axiom.heliex.net/experiments/schnakenberg_chirped_crossdiffusion_gpu.py [EXP] Run duration: 900s [EXP] Downloading script... [EXP] Downloaded 19231 bytes [EXP] Executing experiment 'exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8'... [EXP] GPU available: NVIDIA GeForce RTX 3070 (7841MB) [GPU] Running on NVIDIA GeForce RTX 3070 with 7841MB VRAM [GPU] Measured 1.0 TFLOPS [GPU] CuPy CUDA: 7841MB total, 6044MB free [GPU] CuPy CUDA: 7841MB total, 6044MB free [EXP] Execution error: CompileException: /tmp/_MEIncFnsO/cupy/_core/include/cupy/_cccl/libcudacxx/cuda/std/__cccl/cuda_toolkit.h(39): catastrophic error: #error directive: "CUDA compiler and CUDA toolkit headers are incompatible, please check your include paths" # error "CUDA compiler and CUDA toolkit headers are incompatible, please check your include paths" ^ 1 catastrophic error detected in the compilation of "/tmp/tmph_4hy0u_/124160d5bc578c105d7a4fcecd3bbb0bf47f7e02.cubin.cu". Compilation terminated. Traceback (most recent call last): File "cupy/cuda/compiler.py", line 786, in compile nvrtc.compileProgram(self.ptr, options) File "cupy_backends/cuda/libs/nvrtc.pyx", line 125, in cupy_backends.cuda.libs.nvrtc.compileProgram File "cupy_backends/cuda/libs/nvrtc.pyx", line 138, in cupy_backends.cuda.libs.nvrtc.compileProgram File "cupy_backends/cuda/libs/nvrtc.pyx", line 53, in cupy_backends.cuda.libs.nvrtc.check_status cupy_backends.cuda.libs.nvrtc.NVRTCError: NVRTC_ERROR_COMPILATION (6) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "axiom_streaming_client.py", line 2711, in _run_experiment_mode File "experiment_script.py", line 516, in <module> main() File "experiment_script.py", line 491, in main trials.append(run_trial(trial_seed)) File "experiment_script.py", line 410, in run_trial labels, a_field, dv_field = prepare_conditions() File "experiment_script.py", line 329, in prepare_conditions iid_fields = smoothed_noise(batch) File "experiment_script.py", line 298, in smoothed_noise 0.44 * field File "cupy/_core/core.pyx", line 1505, in cupy._core.core._ndarray_base.__mul__ File "cupy/_core/_kernel.pyx", line 1380, in cupy._core._kernel.ufunc.__call__ File "cupy/_core/_kernel.pyx", line 1407, in cupy._core._kernel.ufunc._get_ufunc_kernel File "cupy/_core/_kernel.pyx", line 1077, in cupy._core._kernel._get_ufunc_kernel File "cupy/_core/_kernel.pyx", line 103, in cupy._core._kernel._get_simple_elementwise_kernel File "cupy/_core/_kernel.pyx", line 91, in cupy._core._kernel._get_simple_elementwise_kernel_from_code File "cupy/_core/core.pyx", line 2552, in cupy._core.core.compile_with_cache File "cupy/cuda/compiler.py", line 566, in _compile_module_with_cache return _compile_with_cache_cuda( File "cupy/cuda/compiler.py", line 660, in _compile_with_cache_cuda ptx, mapping = _compile_using_nvrtc_no_warning( File "cupy/cuda/compiler.py", line 391, in _compile_using_nvrtc_no_warning return _compile(source, options, cu_path, name_expressions, File "cupy/cuda/compiler.py", line 373, in _compile compiled_obj, mapping = prog.compile(options, log_stream) File "cupy/cuda/compiler.py", line 805, in compile raise CompileException(log, self.src, self.name, options, cupy.cuda.compiler.CompileException: /tmp/_MEIncFnsO/cupy/_core/include/cupy/_cccl/libcudacxx/cuda/std/__cccl/cuda_toolkit.h(39): catastrophic error: #error directive: "CUDA compiler and CUDA toolkit headers are incompatible, please check your include paths" # error "CUDA compiler and CUDA toolkit headers are incompatible, please check your include paths" ^ 1 catastrophic error detected in the compilation of "/tmp/tmph_4hy0u_/124160d5bc578c105d7a4fcecd3bbb0bf47f7e02.cubin.cu". Compilation terminated. [EXP] Experiment 'exp_schnakenberg_chirped_crossdiffusion_gpu_gpu_7e69d8' finished in 4.5s [EXP] Status: error 2026-03-12 08:36:02 (1073670): axiom_experiment_626_gpu exited; CPU time 17.913973 2026-03-12 08:36:02 (1073670): called boinc_finish(0) </stderr_txt> ]]>