Job instance 264476

Stderr output

<core_client_version>8.0.4</core_client_version>
<![CDATA[
<stderr_txt>
02:46:40 (16768): wrapper (7.7.26016): starting
02:46:41 (16768): wrapper: running ../../projects/axiom.heliex.net/axiom_worker_2.17_windows_x86_64.exe (wu.json result.json)
[CPU] Using NumPy
[Worker] Saved 5 gradient files to contribute folder (gradient sharing)
INFO: Downloading model: https://axiom.heliex.net/pyhelix/model/expert_242_v2.0.bin
INFO: Downloaded and cached model: expert_242_v2.0.bin (42580994 params)
[Worker] Running 30 batches for expert 242...
[Worker] FATAL ERROR: MemoryError: Unable to allocate 12.0 MiB for an array with shape (64, 64, 768) and data type float32
Traceback (most recent call last):
  File "worker_boinc_app.py", line 1699, in main
  File "worker_boinc_app.py", line 1320, in step
  File "simple_ml.py", line 1172, in forward
    return self.expert.forward(x)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "simple_ml.py", line 513, in forward
    logits, ctx = self._forward_chunk(x)
                  ^^^^^^^^^^^^^^^^^^^^^^
  File "simple_ml.py", line 538, in _forward_chunk
    ln1_out, ln1_xhat, ln1_mean, ln1_inv = _layernorm_forward(h, L['ln1_g'], L['ln1_b'])
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "simple_ml.py", line 323, in _layernorm_forward
    x_hat = (x - mean) * inv_std
            ~~~~~~~~~^~~~~~~~~~~
numpy._core._exceptions._ArrayMemoryError: Unable to allocate 12.0 MiB for an array with shape (64, 64, 768) and data type float32

03:02:29 (16768): axiom_worker_2.17_windows_x86_64.exe exited; CPU time 612.578125
03:02:29 (16768): called boinc_finish(0)

</stderr_txt>
]]>