Skip to content

[CI] Fix llama-cli hanging in conversation mode during benchmark#2228

Merged
mhalk merged 1 commit into
ROCm:aomp-devfrom
mhalk:amd/dev/mhalkenh/fix/ci-llama-conversation-hang
May 20, 2026
Merged

[CI] Fix llama-cli hanging in conversation mode during benchmark#2228
mhalk merged 1 commit into
ROCm:aomp-devfrom
mhalk:amd/dev/mhalkenh/fix/ci-llama-conversation-hang

Conversation

@mhalk

@mhalk mhalk commented May 20, 2026

Copy link
Copy Markdown
Contributor

Use -st (single-turn) and redirect stdin from /dev/null to prevent llama-cli from blocking indefinitely in auto-enabled conversation mode.

Motivation

Observed possible hangs of llama-cli processes.

Technical Details

The argument single-turn should force-exit the llama-cli process after the very first response.

Test Plan

Test Result

Submission Checklist

Use -st (single-turn) and redirect stdin from /dev/null to prevent
llama-cli from blocking indefinitely in auto-enabled conversation mode.

Co-authored-by: Cursor <cursoragent@cursor.com>

@jplehr jplehr left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting that it does not respect /exit from what I get from this PR.

@mhalk mhalk merged commit 1360cbf into ROCm:aomp-dev May 20, 2026
1 check failed
@mhalk mhalk deleted the amd/dev/mhalkenh/fix/ci-llama-conversation-hang branch May 20, 2026 15:36
@mhalk

mhalk commented May 20, 2026

Copy link
Copy Markdown
Contributor Author

It was described as auto conversation mode, but I agree that this is unexpected.
Anyways: I guess we'll see if this solves the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants