Stderr Output ▾
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
2026-03-21 20:37:30 (9768): Streaming wrapper: running ../../projects/axiom.heliex.net/axiom_experiment_639_gpu.exe (wu.json result.json)
2026-03-21 20:37:30 (9768): Streaming wrapper: created child process 16848
[GPU] CuPy CUDA: 12287MB total, 11068MB free
[BOINC] Starting BOINC mode
[BOINC] init_data.xml gpu_device_num=0
[BOINC] Set CUDA device to GPU 0
[BOINC] GPU detected: 12287MB VRAM, 11068MB free
[BOINC] Work unit: wu.json
[BOINC] Result file: result.json
[BOINC] Current directory: C:\ProgramData\BOINC\slots\5
[BOINC] Directory contents: ['.cupy_cache', 'axiom_experiment_639_gpu.exe', 'boinc_lockfile', 'init_data.xml', 'job.xml', 'result.json', 'stderr.txt', 'streaming_wrapper_259_windows_x86_64.exe', 'streaming_wrapper_checkpoint.txt', 'wu.json', '_MEI168482']
[BOINC] Resolved soft link: ../../projects/axiom.heliex.net/exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546.json
[BOINC] Resolved soft link: ../../projects/axiom.heliex.net/exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546_0_r2118164672_0
[BOINC] Actual WU file: ../../projects/axiom.heliex.net/exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546.json
[BOINC] Successfully loaded work unit
[BOINC] Experiment container mode detected
[EXP] Experiment mode: exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546
[EXP] Script URL: https://axiom.heliex.net/experiments/exp_synaptonemal_complex_central_element_bridge_threshold_gpu.py
[EXP] Run duration: 1800s
[EXP] Downloading script...
[EXP] Downloaded 19076 bytes
[EXP] Executing experiment 'exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546'...
[EXP] GPU available: NVIDIA GeForce RTX 3080 Ti (12287MB)
[GPU] Running on NVIDIA GeForce RTX 3080 Ti with 12287MB VRAM
[GPU] Measured 1.0 TFLOPS
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Traceback (most recent call last):
File "experiment_script.py", line 260, in _safe_eigh
evals, evecs = xp.linalg.eigh(matrix)
^^^^^^^^^^^^^^^^^^^^^^
File "cupy\linalg\_eigenvalue.py", line 141, in eigh
File "cupy\linalg\_eigenvalue.py", line 53, in _syevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3475, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 3489, in cupy_backends.cuda.libs.cusolver.xsyevd
File "cupy_backends\\cuda\\libs\\cusolver.pyx", line 1079, in cupy_backends.cuda.libs.cusolver.check_status
cupy_backends.cuda.libs.cusolver.CUSOLVERError: CUSOLVER_STATUS_EXECUTION_FAILED
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
Exception ignored in: 'cupy.cuda.memory.Memory.__dealloc__'
Traceback (most recent call last):
File "cupy_backends\\cuda\\api\\runtime.pyx", line 600, in cupy_backends.cuda.api.runtime.free
File "cupy_backends\\cuda\\api\\runtime.pyx", line 146, in cupy_backends.cuda.api.runtime.check_status
cupy_backends.cuda.api.runtime.CUDARuntimeError: cudaErrorIllegalAddress: an illegal memory access was encountered
[EXP] Execution error: CURANDError: CURAND_STATUS_INITIALIZATION_FAILED
Traceback (most recent call last):
File "axiom_streaming_client.py", line 2754, in _run_experiment_mode
File "experiment_script.py", line 497, in <module>
main()
File "experiment_script.py", line 456, in main
metrics = measure_sc_mode(current_n, mid, sample_seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "experiment_script.py", line 335, in measure_sc_mode
hessian, masks = build_sc_hessian(n_sites, sigma_ce, sample_seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "experiment_script.py", line 268, in build_sc_hessian
rng = _xp_rng(sample_seed)
^^^^^^^^^^^^^^^^^^^^
File "experiment_script.py", line 254, in _xp_rng
return cp.random.RandomState(int(seed))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "cupy\random\_generator.py", line 61, in __init__
self._generator = curand.createGenerator(method)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "cupy_backends\\cuda\\libs\\curand.pyx", line 95, in cupy_backends.cuda.libs.curand.createGenerator
File "cupy_backends\\cuda\\libs\\curand.pyx", line 99, in cupy_backends.cuda.libs.curand.createGenerator
File "cupy_backends\\cuda\\libs\\curand.pyx", line 88, in cupy_backends.cuda.libs.curand.check_status
cupy_backends.cuda.libs.curand.CURANDError: CURAND_STATUS_INITIALIZATION_FAILED
[TELEMETRY] Error reported
[EXP] Read experiment_result.json successfully
[EXP] Experiment 'exp_exp_synaptonemal_complex_central_element_bridge_threshold_gpu_d54546' finished in 962.9s
[EXP] Status: error
2026-03-21 20:53:57 (9768): axiom_experiment_639_gpu.exe exited; CPU time 843.859375
2026-03-21 20:53:57 (9768): called boinc_finish(0)
</stderr_txt>
]]>