Add Performance tools by pan-x-c · Pull Request #532 · agentscope-ai/Trinity-RFT

pan-x-c · 2026-04-29T02:32:32Z

Description

As the title says

Checklist

Please check the following items before code is ready to be reviewed.

Code has passed all tests
Docstrings have been added/updated in Google Style
Documentation has been updated
Code is ready for review

pan-x-c · 2026-04-30T08:47:23Z

/unittest-diff

github-actions · 2026-04-30T08:50:08Z

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
0	0	0	0	0	0	3ms

Tests

Test Name	Status	Flaky	Duration

Github Test Reporter by CTRF 💚

pan-x-c · 2026-04-30T08:54:10Z

/unittest-diff

github-actions · 2026-04-30T09:37:06Z

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
198	193	3	2	0	0	40m 6s

Failed Tests

Failed Tests ❌	Fail Message
❌ tests/cli/launcher_test.py::TestLauncherMain::test_log_mode	The test failed in the call phase due to an assertion error
❌ tests/common/vllm_test.py::TestTinkerAPI::test_tinker_api	The test failed in the call phase
❌ tests/perf/resource_backends_test.py::SystemResourceBackendTest::test_sample_keeps_peak_gpu_utilization_within_one_outer_sample	The test failed in the call phase

Skipped

Tests	Status
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	skipped ⏭️
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	skipped ⏭️

Tests

Test Name	Status	Duration
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline	✅	11.9s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation	✅	11.1s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer	✅	3.6s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft	✅	4.6s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo	✅	5.0s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader	✅	412ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer	✅	1.8s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter	✅	925ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter	✅	854ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter	✅	1.2s
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter	✅	1.8s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter	✅	1.4s
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter	✅	277ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse	✅	6.3s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity	✅	2.2s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control	✅	4.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue	✅	3.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue	✅	3.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity	✅	3.7s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration	✅	1.1s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage	✅	8ms
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_default_sample_strategy	✅	2.0s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_staleness_control_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_default_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_staleness_control_sample_strategy	✅	1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_sql_staleness_control_sample_strategy	✅	4.8s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_default_sample_strategy	✅	2.0s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_staleness_control_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_default_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_staleness_control_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_sql_staleness_control_sample_strategy	✅	3.8s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_0	✅	5.8s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_1	✅	2.5s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write	✅	2.9s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0	✅	79ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1	✅	62ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2	✅	96ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3	✅	97ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4	✅	97ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5	✅	100ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6	✅	114ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple	✅	51ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file	✅	334ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql	✅	3.2s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file	✅	45ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql	✅	3.0s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file	✅	46ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql	✅	3.6s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode	✅	1m 9s
tests/cli/launcher_test.py::TestLauncherMain::test_log_mode	❌	190ms
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command	✅	7.5s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc	✅	1.3s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command	✅	668ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run	✅	6.4s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid	✅	21.8s
tests/common/config_test.py::TestConfig::test_chat_template_path	✅	96ms
tests/common/config_test.py::TestConfig::test_config_flatten	✅	36ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid	✅	208ms
tests/common/config_test.py::TestConfig::test_default_workflow	✅	96ms
tests/common/config_test.py::TestConfig::test_load_default_config	✅	1.3s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly	✅	97ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation	✅	97ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster	✅	426ms
tests/common/experience_test.py::TestEID::test_eid_properties	✅	1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type	✅	1ms
tests/common/experience_test.py::TestExperience::test_assertions	✅	1ms
tests/common/experience_test.py::TestExperience::test_build_experience_token_view_aligns_prompt_action_mask_and_logprobs	✅	1ms
tests/common/experience_test.py::TestExperience::test_deserialize_legacy_pickle_payload	✅	1ms
tests/common/experience_test.py::TestExperience::test_deserialize_single_rejects_batch_payload	✅	1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_action_mask	✅	1ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_decoded_token_text	✅	1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion	✅	14ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_print_colored_tokens_writes_to_file	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_deserialize_many	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_with_shared_multimodal_tensor	✅	1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_to_dict	✅	1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion	✅	1ms
tests/common/external_model_test.py::TestExternalModel::test_external_model	✅	51.0s
tests/common/external_model_test.py::TestExternalModelLoad::test_external_model_load	✅	2.3s
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_first_message_is_assistant	✅	281ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_messages_empty	✅	796ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_no_assistant_messages	✅	252ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_normal_conversation_data	✅	256ms
tests/common/sudoku_test.py::test_9x9_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_9x9_generator_creates_holes	✅	1ms
tests/common/sudoku_test.py::test_9x9_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_judge_allows_incomplete_board	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_column_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_block_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_4x4_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_block_violation	✅	1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate	✅	1m 7s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate	✅	56.3s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate	✅	38.8s
tests/common/vllm_test.py::TestModelLen_0::test_model_len	✅	42.5s
tests/common/vllm_test.py::TestModelLen_1::test_model_len	✅	23.3s
tests/common/vllm_test.py::TestModelLen_2::test_model_len	✅	42.2s
tests/common/vllm_test.py::TestModelLenWithoutPromptTruncation::test_model_len	✅	42.3s
tests/common/vllm_test.py::TestMessageProcess::test_no_prompt_truncation	✅	48.9s
tests/common/vllm_test.py::TestMessageProcess::test_truncation_status	✅	40.8s
tests/common/vllm_test.py::TestAPIServer::test_api	✅	24.7s
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	⏭️	528ms
tests/common/vllm_test.py::TestLogprobs::test_logprobs_api	✅	28.9s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async	✅	25.7s
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	⏭️	1ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask	✅	296ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools	✅	697ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls	✅	2m 8s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls	✅	2m 8s
tests/common/vllm_test.py::TestSuperLongGeneration::test_generate	✅	4m 28s
tests/common/vllm_test.py::TestTinkerAPI::test_tinker_api	❌	58.4s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer	✅	1m 51s
tests/explorer/explorer_test.py::TestExplorerEvalDetailedStats::test_explorer	✅	1m 23s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer	✅	2m 41s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer	✅	3m 31s
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_explore_step_submits_train_batch_to_rollout_coordinator	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_finish_current_steps_uses_rollout_coordinator_finalize	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_finish_eval_step_uses_rollout_coordinator_finalize	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPolicies::test_over_rollout_submits_partial_finalize_policy_to_rollout_coordinator	✅	1ms
tests/explorer/explorer_test.py::ServeTest::test_serve	✅	1m 28s
tests/explorer/proxy_test.py::RecorderTest::test_recorder	✅	85ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_abort_batch_marks_batch_aborted_and_evicts_it	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_eval_batch_aggregates_eval_metrics	✅	2ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_processes_scheduler_payloads	✅	3ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_rejects_eval_batches_before_waiting	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_supports_partial_finalize	✅	2ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_times_out_without_any_results	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_shutdown_closes_internal_dependencies	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_terminal_batches_are_not_reusable_after_finalize	✅	3ms
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_collect_results_reads_payloads_returned_by_workflow_runner	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_dynamic_timeout	✅	13.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_dynamic_timeout_warmup_min_steps_uses_completed_steps	✅	7.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_eval_tasks_do_not_return_training_experiences	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_payload_results	✅	30.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_payload_results_keeps_payloads_serialized	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_statuses_skips_payload_deserialization	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_non_repeatable_workflow_0	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_non_repeatable_workflow_1	✅	5.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_repeatable_workflow_0	✅	5.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_repeatable_workflow_1	✅	5.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution	✅	5.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow	✅	6.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_async_cancelled_runner_accepts_next_batch	✅	5.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_min_wait	✅	9.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_return_partial_tasks	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_sync_cancel_does_not_imply_immediate_runner_reuse	✅	7.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods	✅	15.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop	✅	9.9s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks	✅	9.0s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid	✅	25.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_timeout_cleanup_keeps_completed_payloads_local	✅	11.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_timeout_cleanup_still_restarts_runner	✅	6.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_unexpected_task_exception_restarts_runner	✅	5.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all	✅	8.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch	✅	15.1s
tests/explorer/scheduler_test.py::TestRunnerStateCollection::test_runner_state_collection	✅	10.6s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1	✅	603ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1	✅	1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps	✅	1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow	✅	13ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow	✅	18ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow	✅	135ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow	✅	4ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow	✅	11ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow	✅	9ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0	✅	1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1	✅	101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0	✅	2ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1	✅	201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow	✅	21.5s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow	✅	21.9s
tests/explorer/workflow_test.py::TestWorkflowStateRecording::test_workflow_state_recording	✅	4.0s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter_v1	✅	2.8s
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner	✅	143ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_0_sequential	✅	69ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_1_asynchronous	✅	59ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_2_multi_threading	✅	539ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_get_state	✅	8.1s
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_0_sequential	✅	40ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_1_asynchronous	✅	38ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_2_multi_threading	✅	40ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_with_openai	✅	23.9s
tests/explorer/workflow_test.py::TestConcurrentWorkflowRunner::test_concurrent_workflow_runner	✅	44.5s
tests/perf/resource_backends_test.py::SystemResourceBackendTest::test_sample_keeps_peak_gpu_utilization_within_one_outer_sample	❌	6ms
tests/perf/resource_sampler_test.py::ResourceSamplerTest::test_build_resource_timeline_payload_keeps_cpu_single_line_and_gpu_per_device	✅	1ms
tests/perf/resource_sampler_test.py::ResourceSamplerTest::test_resource_sampler_collects_samples	✅	31ms

Github Test Reporter by CTRF 💚

pan-x-c · 2026-04-30T11:16:35Z

/unittest-diff

pan-x-c · 2026-04-30T11:16:47Z

/unittest-module-trainer

github-actions · 2026-04-30T11:59:46Z

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
198	196	0	2	0	0	40m 14s

Skipped

Tests	Status
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	skipped ⏭️
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	skipped ⏭️

Tests

Test Name	Status	Duration
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline	✅	11.4s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation	✅	9.3s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer	✅	2.7s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft	✅	5.2s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo	✅	5.1s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader	✅	401ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer	✅	1.7s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter	✅	884ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter	✅	826ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter	✅	1.1s
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter	✅	1.7s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter	✅	1.4s
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter	✅	265ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse	✅	6.5s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity	✅	2.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control	✅	4.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue	✅	3.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue	✅	3.2s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity	✅	4.0s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration	✅	1.1s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage	✅	8ms
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_default_sample_strategy	✅	1.8s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_staleness_control_sample_strategy	✅	1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_default_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_staleness_control_sample_strategy	✅	1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_sql_staleness_control_sample_strategy	✅	4.6s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_default_sample_strategy	✅	2.0s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_staleness_control_sample_strategy	✅	1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_default_sample_strategy	✅	1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_staleness_control_sample_strategy	✅	1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_sql_staleness_control_sample_strategy	✅	3.7s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_0	✅	5.9s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_1	✅	2.4s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write	✅	3.3s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0	✅	77ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1	✅	61ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2	✅	95ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3	✅	96ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4	✅	96ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5	✅	101ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6	✅	114ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple	✅	51ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file	✅	327ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql	✅	2.8s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file	✅	45ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql	✅	2.8s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file	✅	46ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql	✅	3.2s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode	✅	1m 7s
tests/cli/launcher_test.py::TestLauncherMain::test_log_mode	✅	167ms
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command	✅	7.4s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc	✅	1.3s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command	✅	651ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run	✅	4.0s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid	✅	21.8s
tests/common/config_test.py::TestConfig::test_chat_template_path	✅	96ms
tests/common/config_test.py::TestConfig::test_config_flatten	✅	36ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid	✅	209ms
tests/common/config_test.py::TestConfig::test_default_workflow	✅	95ms
tests/common/config_test.py::TestConfig::test_load_default_config	✅	1.6s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly	✅	98ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation	✅	96ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster	✅	444ms
tests/common/experience_test.py::TestEID::test_eid_properties	✅	1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type	✅	1ms
tests/common/experience_test.py::TestExperience::test_assertions	✅	1ms
tests/common/experience_test.py::TestExperience::test_build_experience_token_view_aligns_prompt_action_mask_and_logprobs	✅	1ms
tests/common/experience_test.py::TestExperience::test_deserialize_legacy_pickle_payload	✅	1ms
tests/common/experience_test.py::TestExperience::test_deserialize_single_rejects_batch_payload	✅	1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_action_mask	✅	1ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_decoded_token_text	✅	1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion	✅	14ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_print_colored_tokens_writes_to_file	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_deserialize_many	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_with_shared_multimodal_tensor	✅	1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_to_dict	✅	1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion	✅	1ms
tests/common/external_model_test.py::TestExternalModel::test_external_model	✅	28.3s
tests/common/external_model_test.py::TestExternalModelLoad::test_external_model_load	✅	2.3s
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_first_message_is_assistant	✅	259ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_messages_empty	✅	653ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_no_assistant_messages	✅	248ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_normal_conversation_data	✅	252ms
tests/common/sudoku_test.py::test_9x9_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_9x9_generator_creates_holes	✅	1ms
tests/common/sudoku_test.py::test_9x9_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_judge_allows_incomplete_board	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_column_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_block_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_4x4_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_block_violation	✅	1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate	✅	1m 10s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate	✅	54.9s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate	✅	1m 5s
tests/common/vllm_test.py::TestModelLen_0::test_model_len	✅	41.5s
tests/common/vllm_test.py::TestModelLen_1::test_model_len	✅	23.1s
tests/common/vllm_test.py::TestModelLen_2::test_model_len	✅	42.2s
tests/common/vllm_test.py::TestModelLenWithoutPromptTruncation::test_model_len	✅	41.2s
tests/common/vllm_test.py::TestMessageProcess::test_no_prompt_truncation	✅	49.3s
tests/common/vllm_test.py::TestMessageProcess::test_truncation_status	✅	41.5s
tests/common/vllm_test.py::TestAPIServer::test_api	✅	24.5s
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	⏭️	526ms
tests/common/vllm_test.py::TestLogprobs::test_logprobs_api	✅	23.0s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async	✅	42.8s
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	⏭️	1ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask	✅	297ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools	✅	693ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls	✅	2m 6s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls	✅	2m 7s
tests/common/vllm_test.py::TestSuperLongGeneration::test_generate	✅	4m 27s
tests/common/vllm_test.py::TestTinkerAPI::test_tinker_api	✅	58.9s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer	✅	2m 9s
tests/explorer/explorer_test.py::TestExplorerEvalDetailedStats::test_explorer	✅	1m 23s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer	✅	2m 37s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer	✅	3m 28s
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_explore_step_submits_train_batch_to_rollout_coordinator	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_finish_current_steps_uses_rollout_coordinator_finalize	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPath::test_finish_eval_step_uses_rollout_coordinator_finalize	✅	2ms
tests/explorer/explorer_test.py::TestExplorerCoordinatorPolicies::test_over_rollout_submits_partial_finalize_policy_to_rollout_coordinator	✅	1ms
tests/explorer/explorer_test.py::ServeTest::test_serve	✅	1m 24s
tests/explorer/proxy_test.py::RecorderTest::test_recorder	✅	82ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_abort_batch_marks_batch_aborted_and_evicts_it	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_eval_batch_aggregates_eval_metrics	✅	3ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_processes_scheduler_payloads	✅	3ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_rejects_eval_batches_before_waiting	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_supports_partial_finalize	✅	3ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_finalize_train_batch_times_out_without_any_results	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_shutdown_closes_internal_dependencies	✅	1ms
tests/explorer/rollout_coordinator_test.py::TestRolloutCoordinator::test_terminal_batches_are_not_reusable_after_finalize	✅	2ms
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_collect_results_reads_payloads_returned_by_workflow_runner	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_dynamic_timeout	✅	13.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_dynamic_timeout_warmup_min_steps_uses_completed_steps	✅	7.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_eval_tasks_do_not_return_training_experiences	✅	5.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_payload_results	✅	31.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_payload_results_keeps_payloads_serialized	✅	5.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_statuses_skips_payload_deserialization	✅	5.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_non_repeatable_workflow_0	✅	5.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_non_repeatable_workflow_1	✅	5.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_repeatable_workflow_0	✅	5.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_metric_calculation_with_repeatable_workflow_1	✅	5.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution	✅	5.9s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow	✅	6.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_async_cancelled_runner_accepts_next_batch	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_min_wait	✅	9.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_return_partial_tasks	✅	5.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_over_rollout_sync_cancel_does_not_imply_immediate_runner_reuse	✅	7.0s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods	✅	15.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop	✅	10.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks	✅	8.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid	✅	25.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_timeout_cleanup_keeps_completed_payloads_local	✅	10.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_timeout_cleanup_still_restarts_runner	✅	6.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_unexpected_task_exception_restarts_runner	✅	5.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all	✅	8.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch	✅	14.9s
tests/explorer/scheduler_test.py::TestRunnerStateCollection::test_runner_state_collection	✅	10.5s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1	✅	602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1	✅	1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error	✅	1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps	✅	1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow	✅	12ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow	✅	17ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow	✅	133ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow	✅	4ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow	✅	11ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow	✅	9ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0	✅	1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1	✅	101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0	✅	1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1	✅	201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow	✅	21.3s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow	✅	21.4s
tests/explorer/workflow_test.py::TestWorkflowStateRecording::test_workflow_state_recording	✅	4.0s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter_v1	✅	2.8s
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner	✅	144ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_0_sequential	✅	69ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_1_asynchronous	✅	59ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_fail_fast_without_partial_collection_2_multi_threading	✅	540ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_get_state	✅	8.1s
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_0_sequential	✅	40ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_1_asynchronous	✅	39ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner_partial_success_non_repeatable_2_multi_threading	✅	39ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_with_openai	✅	23.3s
tests/explorer/workflow_test.py::TestConcurrentWorkflowRunner::test_concurrent_workflow_runner	✅	45.6s
tests/perf/resource_backends_test.py::SystemResourceBackendTest::test_sample_keeps_peak_gpu_utilization_within_one_outer_sample	✅	1ms
tests/perf/resource_sampler_test.py::ResourceSamplerTest::test_build_resource_timeline_payload_keeps_cpu_single_line_and_gpu_per_device	✅	1ms
tests/perf/resource_sampler_test.py::ResourceSamplerTest::test_resource_sampler_collects_samples	✅	31ms

Github Test Reporter by CTRF 💚

github-actions · 2026-04-30T13:06:35Z

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
27	24	0	3	0	0	53m 42s

Skipped

Tests	Status
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer	skipped ⏭️
tests/trainer/trainer_test.py::TestTinkerTrainer::test_trainer	skipped ⏭️
tests/trainer/trainer_test.py::TestTinkerTrainer::test_trainer_class	skipped ⏭️

Tests

Test Name	Status	Duration
tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer	✅	4m 52s
tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer	✅	5m 12s
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer	✅	2m
tests/trainer/trainer_test.py::TestTrainerGSM8K_0_fsdp::test_trainer	✅	1m 29s
tests/trainer/trainer_test.py::TestTrainerGSM8K_1_fsdp2::test_trainer	✅	1m 7s
tests/trainer/trainer_test.py::TestTrainerGSM8K_2_fsdp::test_trainer	✅	1m 11s
tests/trainer/trainer_test.py::TestTrainerGSM8K_3_fsdp2::test_trainer	✅	1m 18s
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer	⏭️	1ms
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer	✅	35.5s
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer	✅	33.3s
tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools	✅	31.6s
tests/trainer/trainer_test.py::TestFullyAsyncMode_0_fsdp::test_fully_async_mode	✅	1m 50s
tests/trainer/trainer_test.py::TestFullyAsyncMode_1_fsdp::test_fully_async_mode	✅	1m 46s
tests/trainer/trainer_test.py::TestFullyAsyncMode_2_megatron::test_fully_async_mode	✅	2m 36s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_0_fsdp::test_trainer	✅	2m 53s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_1_megatron::test_trainer	✅	5m 42s
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer	✅	2m 8s
tests/trainer/trainer_test.py::TestServeWithTrainer::test_serve_with_trainer	✅	1m 48s
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer	✅	3m 55s
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer	✅	1m 34s
tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer	✅	3m 52s
tests/trainer/trainer_test.py::TestOverRollout::test_trainer	✅	1m 11s
tests/trainer/trainer_test.py::TestTrainerPromptTruncation::test_trainer	✅	1m 6s
tests/trainer/trainer_test.py::TestTinkerTrainer::test_trainer	⏭️	1ms
tests/trainer/trainer_test.py::TestTinkerTrainer::test_trainer_class	⏭️	1ms
tests/trainer/trainer_test.py::AgentScopeTunerTest::test_agentscope_tuner	✅	1m 47s
tests/trainer/trainer_test.py::ColocateModeTest::test_trainer	✅	2m 31s

Github Test Reporter by CTRF 💚

pan-x-c · 2026-05-06T02:05:25Z

/unittest-module-common

github-actions · 2026-05-06T02:27:32Z

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
64	62	0	2	0	0	19m 23s

Skipped

Tests	Status
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	skipped ⏭️
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	skipped ⏭️

Tests

Test Name	Status	Duration
tests/common/config_test.py::TestConfig::test_all_examples_are_valid	✅	24.6s
tests/common/config_test.py::TestConfig::test_chat_template_path	✅	96ms
tests/common/config_test.py::TestConfig::test_config_flatten	✅	35ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid	✅	206ms
tests/common/config_test.py::TestConfig::test_default_workflow	✅	94ms
tests/common/config_test.py::TestConfig::test_load_default_config	✅	1.4s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly	✅	94ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation	✅	406ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster	✅	1.7s
tests/common/experience_test.py::TestEID::test_eid_properties	✅	1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type	✅	1ms
tests/common/experience_test.py::TestExperience::test_assertions	✅	1ms
tests/common/experience_test.py::TestExperience::test_build_experience_token_view_aligns_prompt_action_mask_and_logprobs	✅	1ms
tests/common/experience_test.py::TestExperience::test_deserialize_legacy_pickle_payload	✅	2ms
tests/common/experience_test.py::TestExperience::test_deserialize_single_rejects_batch_payload	✅	1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_action_mask	✅	2ms
tests/common/experience_test.py::TestExperience::test_format_colored_tokens_uses_decoded_token_text	✅	1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion	✅	14ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_print_colored_tokens_writes_to_file	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_deserialize_many	✅	1ms
tests/common/experience_test.py::TestExperience::test_serialize_many_with_shared_multimodal_tensor	✅	1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience	✅	1ms
tests/common/experience_test.py::TestExperience::test_to_dict	✅	1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion	✅	1ms
tests/common/external_model_test.py::TestExternalModel::test_external_model	✅	51.6s
tests/common/external_model_test.py::TestExternalModelLoad::test_external_model_load	✅	2.2s
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_first_message_is_assistant	✅	566ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_messages_empty	✅	256ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_no_assistant_messages	✅	532ms
tests/common/models/utils_test.py::TestTokenizeAndMaskMessagesDefault::test_normal_conversation_data	✅	254ms
tests/common/sudoku_test.py::test_9x9_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_9x9_generator_creates_holes	✅	1ms
tests/common/sudoku_test.py::test_9x9_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_judge_allows_incomplete_board	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_column_violation	✅	1ms
tests/common/sudoku_test.py::test_judge_detects_block_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_generator_produces_valid_solution	✅	1ms
tests/common/sudoku_test.py::test_4x4_solution_is_fully_filled	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_row_violation	✅	1ms
tests/common/sudoku_test.py::test_4x4_judge_detects_block_violation	✅	1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate	✅	1m 14s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate	✅	56.2s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate	✅	38.0s
tests/common/vllm_test.py::TestModelLen_0::test_model_len	✅	49.3s
tests/common/vllm_test.py::TestModelLen_1::test_model_len	✅	29.1s
tests/common/vllm_test.py::TestModelLen_2::test_model_len	✅	41.5s
tests/common/vllm_test.py::TestModelLenWithoutPromptTruncation::test_model_len	✅	42.0s
tests/common/vllm_test.py::TestMessageProcess::test_no_prompt_truncation	✅	41.0s
tests/common/vllm_test.py::TestMessageProcess::test_truncation_status	✅	42.2s
tests/common/vllm_test.py::TestAPIServer::test_api	✅	24.6s
tests/common/vllm_test.py::TestAPIServer::test_reasoning_content	⏭️	524ms
tests/common/vllm_test.py::TestLogprobs::test_logprobs_api	✅	23.0s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async	✅	24.7s
tests/common/vllm_test.py::TestTinkerAsyncAPIServer::test_api_async	⏭️	1ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask	✅	315ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools	✅	609ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls	✅	2m 8s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls	✅	2m 7s
tests/common/vllm_test.py::TestSuperLongGeneration::test_generate	✅	4m 28s
tests/common/vllm_test.py::TestTinkerAPI::test_tinker_api	✅	1m

Github Test Reporter by CTRF 💚

pan-x-c added 16 commits April 27, 2026 21:49

add explorer perf suite

9ccd4f5

update example

f8993a7

add perf command

93e2df1

add perf suite

958c7d6

fix metrics

60e6743

add viewer

7f65490

fix pre-commit

027aad9

add viewer

e6d9817

add and

6a8bf16

fix pre-commit

33a44e0

split launcher

78af069

merge main

17c4ad8

support vllm 0.20.0

0328023

fix doc

591d943

fix docker file

1836a3d

fix dockerfile

9c90f8d

add perf tests

1d9506b

fix tests

f7245d6

pan-x-c added 2 commits May 3, 2026 17:44

update vllm to 0.20.1

66dfad7

update docker compose

4818f8a

simplify perf

bdd0114

chenyushuo approved these changes May 6, 2026

View reviewed changes

pan-x-c merged commit 27d1ba4 into agentscope-ai:main May 6, 2026
2 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Performance tools#532

Add Performance tools#532
pan-x-c merged 21 commits intoagentscope-ai:mainfrom
pan-x-c:feature/perf_suite

pan-x-c commented Apr 29, 2026

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Uh oh!

pan-x-c commented May 6, 2026

Uh oh!

github-actions Bot commented May 6, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

pan-x-c commented Apr 29, 2026

Description

Checklist

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Summary

Tests

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Summary

Failed Tests

Skipped

Tests

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

pan-x-c commented Apr 30, 2026

Uh oh!

github-actions Bot commented Apr 30, 2026

Summary

Skipped

Tests

Uh oh!

github-actions Bot commented Apr 30, 2026

Summary

Skipped

Tests

Uh oh!

pan-x-c commented May 6, 2026

Uh oh!

github-actions Bot commented May 6, 2026

Summary

Skipped

Tests

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants