Skip to content

RuntimeError: Server failed to start within the 10 seconds. #395

@onebula

Description

@onebula

Hi, the following is the log after I run python room_selector_apo.py with agentlightning==0.2.2. Could you help me fix it?

2025-12-10 13:13:12,763 [INFO] (Process-543975 agentlightning.instrumentation.agentops) AgentOpsServerManager initialized.
2025-12-10 13:13:12,766 [INFO] (Process-543975 agentlightning.execution.client_server) Starting client-server execution with 8 runner(s) [role=both, main_process=algorithm]
2025-12-10 13:13:12,769 [INFO] (Process-543975 agentlightning.execution.client_server) Spawning runner processes...
2025-12-10 13:13:12,779 [INFO] (Process-544321 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 36785...
2025-12-10 13:13:12,781 [INFO] (Process-544321 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544323) started, targeting port 36785.
2025-12-10 13:13:12,783 [INFO] (Process-544322 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 33413...
2025-12-10 13:13:12,784 [INFO] (Process-544324 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 41745...
2025-12-10 13:13:12,786 [INFO] (Process-544325 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 40327...
2025-12-10 13:13:12,789 [INFO] (Process-544322 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544326) started, targeting port 33413.
2025-12-10 13:13:12,790 [INFO] (Process-544324 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544328) started, targeting port 41745.
2025-12-10 13:13:12,791 [INFO] (Process-544327 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 33715...
2025-12-10 13:13:12,792 [INFO] (Process-544325 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544329) started, targeting port 40327.

  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
    2025-12-10 13:13:12,797 [INFO] (Process-544327 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544331) started, targeting port 33715.
    2025-12-10 13:13:12,797 [INFO] (Process-544330 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 38589...
    2025-12-10 13:13:12,802 [INFO] (Process-544332 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 42673...
    2025-12-10 13:13:12,803 [INFO] (Process-544330 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544333) started, targeting port 38589.
    2025-12-10 13:13:12,806 [INFO] (Process-544332 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544335) started, targeting port 42673.
    2025-12-10 13:13:12,806 [INFO] (Process-543975 agentlightning.execution.client_server) Running algorithm...
    2025-12-10 13:13:12,807 [INFO] (Process-543975 agentlightning.execution.client_server) Starting LightningStore server on localhost:4747
    2025-12-10 13:13:12,807 [INFO] (Process-544334 agentlightning.instrumentation.agentops) Starting AgentOps local server on port 57169...
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:36785
    Press CTRL+C to quit
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
    2025-12-10 13:13:12,814 [INFO] (Process-544334 agentlightning.instrumentation.agentops) AgentOps local server process (PID: 544336) started, targeting port 57169.
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:41745
    Press CTRL+C to quit
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:33413
    Press CTRL+C to quit
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:40327
    Press CTRL+C to quit
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:33715
    Press CTRL+C to quit
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:38589
    Press CTRL+C to quit
  • Serving Flask app 'agentlightning.instrumentation.agentops'
  • Debug mode: off
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:42673
    Press CTRL+C to quit
    WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
  • Running on http://127.0.0.1:57169
    Press CTRL+C to quit
    2025-12-10 13:13:12,841 [INFO] (Process-543975 agentlightning.store.client_server) Starting server at http://localhost:4747
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,289 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,297 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Setting up tracer...
    2025-12-10 13:13:13,298 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,300 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,305 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,311 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,313 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Setting up tracer...
    127.0.0.1 - - [10/Dec/2025 13:13:13] "GET / HTTP/1.1" 200 -
    2025-12-10 13:13:13,322 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Setting up tracer...
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Instrumentation applied.
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:33413
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Env var set: AGENTOPS_APP_URL=http://localhost:33413/notavailable
    2025-12-10 13:13:13,441 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:33413/traces
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,442 [INFO] (Process-544327 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Instrumentation applied.
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:36785
    2025-12-10 13:13:13,442 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Instrumentation applied.
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Env var set: AGENTOPS_APP_URL=http://localhost:36785/notavailable
    2025-12-10 13:13:13,442 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:36785/traces
    2025-12-10 13:13:13,442 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,442 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:33715
    2025-12-10 13:13:13,443 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Env var set: AGENTOPS_APP_URL=http://localhost:33715/notavailable
    2025-12-10 13:13:13,443 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:33715/traces
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Instrumentation applied.
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:40327
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Env var set: AGENTOPS_APP_URL=http://localhost:40327/notavailable
    2025-12-10 13:13:13,443 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:40327/traces
    2025-12-10 13:13:13,443 [INFO] (Process-544332 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,444 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Instrumentation applied.
    2025-12-10 13:13:13,444 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,444 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:42673
    2025-12-10 13:13:13,444 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Env var set: AGENTOPS_APP_URL=http://localhost:42673/notavailable
    2025-12-10 13:13:13,444 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:42673/traces
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Instrumentation applied.
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:57169
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Env var set: AGENTOPS_APP_URL=http://localhost:57169/notavailable
    2025-12-10 13:13:13,444 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:57169/traces
    2025-12-10 13:13:13,444 [INFO] (Process-544330 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,445 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Instrumentation applied.
    2025-12-10 13:13:13,445 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,445 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:38589
    2025-12-10 13:13:13,445 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Env var set: AGENTOPS_APP_URL=http://localhost:38589/notavailable
    2025-12-10 13:13:13,445 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:38589/traces
    2025-12-10 13:13:13,445 [INFO] (Process-544324 agentlightning.instrumentation.agentops) Patched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:13,445 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Instrumentation applied.
    2025-12-10 13:13:13,445 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Env var set: AGENTOPS_API_KEY=dummy
    2025-12-10 13:13:13,446 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Env var set: AGENTOPS_API_ENDPOINT=http://localhost:41745
    2025-12-10 13:13:13,446 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Env var set: AGENTOPS_APP_URL=http://localhost:41745/notavailable
    2025-12-10 13:13:13,446 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Env var set: AGENTOPS_EXPORTER_ENDPOINT=http://localhost:41745/traces
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: [OPENAI INSTRUMENTOR] Error setting up OpenAI streaming wrappers: No module named 'openai.resources.beta.chat'
    🖇 AgentOps: Session Replay for default trace: http://localhost:36785/notavailable/sessions?trace_id=f01b5704be55a1e42c456ecce231ec58
    2025-12-10 13:13:15,197 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] AgentOps client initialized.
    🖇 AgentOps: Session Replay for default trace: http://localhost:57169/notavailable/sessions?trace_id=fc5f3524e863839fd0df5029ac5a672d
    2025-12-10 13:13:15,198 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] AgentOps client initialized.
    🖇 AgentOps: Session Replay for default trace: http://localhost:38589/notavailable/sessions?trace_id=0193e8f04db4be6942735f5eaaf5c8bc
    2025-12-10 13:13:15,198 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] AgentOps client initialized.
    🖇 AgentOps: Session Replay for default trace: http://localhost:41745/notavailable/sessions?trace_id=c2133e209ffd9f1ab06d483f306dd7be
    2025-12-10 13:13:15,198 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] AgentOps client initialized.
    2025-12-10 13:13:15,201 [INFO] (Process-544334 agentlightning.runner.agent) [Worker 7] Started async rollouts (max: unlimited).
    2025-12-10 13:13:15,201 [INFO] (Process-544321 agentlightning.runner.agent) [Worker 0] Started async rollouts (max: unlimited).
    2025-12-10 13:13:15,201 [INFO] (Process-544324 agentlightning.runner.agent) [Worker 2] Started async rollouts (max: unlimited).
    2025-12-10 13:13:15,201 [INFO] (Process-544330 agentlightning.runner.agent) [Worker 5] Started async rollouts (max: unlimited).
    🖇 AgentOps: Session Replay for default trace: http://localhost:33413/notavailable/sessions?trace_id=b5f44c0785961b9c12c2a60dad4aad3a
    🖇 AgentOps: Session Replay for default trace: http://localhost:42673/notavailable/sessions?trace_id=d1d06239ec67ac6a3dd3211f0b094700
    2025-12-10 13:13:15,202 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] AgentOps client initialized.
    2025-12-10 13:13:15,202 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] AgentOps client initialized.
    🖇 AgentOps: Session Replay for default trace: http://localhost:40327/notavailable/sessions?trace_id=a474d6aff8b5179a7a38ede7fb75d72a
    2025-12-10 13:13:15,202 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] AgentOps client initialized.
    2025-12-10 13:13:15,204 [INFO] (Process-544325 agentlightning.runner.agent) [Worker 3] Started async rollouts (max: unlimited).
    2025-12-10 13:13:15,204 [INFO] (Process-544332 agentlightning.runner.agent) [Worker 6] Started async rollouts (max: unlimited).
    2025-12-10 13:13:15,205 [INFO] (Process-544322 agentlightning.runner.agent) [Worker 1] Started async rollouts (max: unlimited).
    🖇 AgentOps: Session Replay for default trace: http://localhost:33715/notavailable/sessions?trace_id=027b40d237bc9551a044bcda20cf4440
    2025-12-10 13:13:15,206 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] AgentOps client initialized.
    2025-12-10 13:13:15,207 [INFO] (Process-544327 agentlightning.runner.agent) [Worker 4] Started async rollouts (max: unlimited).
    2025-12-10 13:13:23,129 [ERROR] (Process-543975 agentlightning.execution.client_server) Algorithm bundle crashed; signaling stop event
    Traceback (most recent call last):
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/execution/client_server.py", line 151, in _execute_algorithm
    await wrapper_store.start()
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/store/client_server.py", line 200, in start
    raise RuntimeError("Server failed to start within the 10 seconds.")
    RuntimeError: Server failed to start within the 10 seconds.
    2025-12-10 13:13:23,148 [INFO] (Process-544324 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,141 [ERROR] (Process-543975 agentlightning.execution.client_server) Unhandled exception in execute method
    Traceback (most recent call last):
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/execution/client_server.py", line 386, in execute
    asyncio.run(self._execute_algorithm(algorithm, store, stop_evt))
    File "/mnt/bn/chenkuang/pyenv/versions/3.10.16/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
    File "/mnt/bn/chenkuang/pyenv/versions/3.10.16/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/execution/client_server.py", line 151, in _execute_algorithm
    await wrapper_store.start()
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/store/client_server.py", line 200, in start
    raise RuntimeError("Server failed to start within the 10 seconds.")
    RuntimeError: Server failed to start within the 10 seconds.
    2025-12-10 13:13:23,149 [INFO] (Process-543975 agentlightning.execution.client_server) Shutting down subprocesses
    2025-12-10 13:13:23,153 [INFO] (Process-544325 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,154 [INFO] (Process-544330 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,156 [INFO] (Process-544334 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,158 [INFO] (Process-544324 agentlightning.tracer.agentops) [Worker 2] Instrumentation removed.
    2025-12-10 13:13:23,158 [INFO] (Process-544324 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544328)...
    2025-12-10 13:13:23,161 [INFO] (Process-544332 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,162 [INFO] (Process-544325 agentlightning.tracer.agentops) [Worker 3] Instrumentation removed.
    2025-12-10 13:13:23,162 [INFO] (Process-544325 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544329)...
    2025-12-10 13:13:23,162 [INFO] (Process-544327 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,162 [INFO] (Process-544321 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,163 [INFO] (Process-544330 agentlightning.tracer.agentops) [Worker 5] Instrumentation removed.
    2025-12-10 13:13:23,163 [INFO] (Process-544330 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544333)...
    2025-12-10 13:13:23,164 [INFO] (Process-544334 agentlightning.tracer.agentops) [Worker 7] Instrumentation removed.
    2025-12-10 13:13:23,164 [INFO] (Process-544334 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544336)...
    2025-12-10 13:13:23,167 [INFO] (Process-544324 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,167 [INFO] (Process-544322 agentlightning.instrumentation.agentops) Unpatched newer version of agentops using handle_chat_attributes
    2025-12-10 13:13:23,167 [INFO] (Process-544324 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,169 [INFO] (Process-544332 agentlightning.tracer.agentops) [Worker 6] Instrumentation removed.
    2025-12-10 13:13:23,170 [INFO] (Process-544327 agentlightning.tracer.agentops) [Worker 4] Instrumentation removed.
    2025-12-10 13:13:23,171 [INFO] (Process-544321 agentlightning.tracer.agentops) [Worker 0] Instrumentation removed.
    2025-12-10 13:13:23,172 [INFO] (Process-544321 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544323)...
    2025-12-10 13:13:23,172 [INFO] (Process-544327 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544331)...
    2025-12-10 13:13:23,172 [INFO] (Process-544332 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544335)...
    2025-12-10 13:13:23,172 [INFO] (Process-544325 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,172 [INFO] (Process-544325 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,175 [INFO] (Process-544322 agentlightning.tracer.agentops) [Worker 1] Instrumentation removed.
    2025-12-10 13:13:23,177 [INFO] (Process-544322 agentlightning.instrumentation.agentops) Stopping AgentOps local server (PID: 544326)...
    2025-12-10 13:13:23,177 [INFO] (Process-544334 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,177 [INFO] (Process-544330 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,177 [INFO] (Process-544334 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,177 [INFO] (Process-544330 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544321 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544321 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544327 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544332 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544327 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,184 [INFO] (Process-544332 agentlightning.tracer.agentops) AgentOps server stopped.
    2025-12-10 13:13:23,191 [INFO] (Process-544322 agentlightning.instrumentation.agentops) AgentOps local server stopped.
    2025-12-10 13:13:23,191 [INFO] (Process-544322 agentlightning.tracer.agentops) AgentOps server stopped.
    Traceback (most recent call last):
    File "/mnt/bn/chenkuang/trending_graph/scripts/APO/room_selector_apo.py", line 71, in
    main()
    File "/mnt/bn/chenkuang/trending_graph/scripts/APO/room_selector_apo.py", line 67, in main
    trainer.fit(agent=room_selector, train_dataset=dataset_train, val_dataset=dataset_val)
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/trainer/trainer.py", line 424, in fit
    self.strategy.execute(algorithm_bundle, runner_bundle, self.store)
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/execution/client_server.py", line 386, in execute
    asyncio.run(self._execute_algorithm(algorithm, store, stop_evt))
    File "/mnt/bn/chenkuang/pyenv/versions/3.10.16/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
    File "/mnt/bn/chenkuang/pyenv/versions/3.10.16/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/execution/client_server.py", line 151, in _execute_algorithm
    await wrapper_store.start()
    File "/mnt/bn/chenkuang/pyenv/versions/agentlightning/lib/python3.10/site-packages/agentlightning/store/client_server.py", line 200, in start
    raise RuntimeError("Server failed to start within the 10 seconds.")
    RuntimeError: Server failed to start within the 10 seconds.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions