Skip to content

Migrate benchmark workflow from BenchmarkCI to AirspeedVelocity#56

Merged
Krastanov merged 1 commit into
QuantumSavory:mainfrom
Krastanov-agent:migrate-benchmark-to-airspeedvelocity
Feb 20, 2026
Merged

Migrate benchmark workflow from BenchmarkCI to AirspeedVelocity#56
Krastanov merged 1 commit into
QuantumSavory:mainfrom
Krastanov-agent:migrate-benchmark-to-airspeedvelocity

Conversation

@Krastanov-agent

Copy link
Copy Markdown
Contributor

Summary

Migrates the benchmark workflow from manual BenchmarkCI implementation to the modern AirspeedVelocity action.

Changes

  • Replaces 50+ line manual workflow with 3-line action
  • Uses MilesCranmer/AirspeedVelocity.jl@action-v1
  • Maintains same functionality: benchmark PRs and post results as comments

Benefits

Much simpler - Reduces workflow from 50+ lines to just 3 lines
Easier to maintain - No manual artifact handling or complex scripts
Consistent - Matches other repos in the organization
Modern - Uses the recommended Julia benchmarking action
Same functionality - Automatic PR comments with benchmark comparisons

Migration Details

Before (BenchmarkCI):

  • Manual setup of Julia, dependencies, and BenchmarkCI
  • Custom scripts to run benchmarks and format output
  • Manual artifact upload/download
  • Requires maintenance of custom workflow logic

After (AirspeedVelocity):

- uses: MilesCranmer/AirspeedVelocity.jl@action-v1
  with:
    julia-version: '1'
    tune: 'false'

The action handles everything automatically:

  • Checks out both base and PR branches
  • Runs benchmark suite on both
  • Compares results
  • Posts formatted comment to PR

Test Plan

  • Verify benchmark.yml has been replaced with AirspeedVelocity action
  • Create a test PR to verify benchmarks run correctly
  • Confirm benchmark results are posted as PR comments

Reference

🤖 Generated with Claude Code

Replaces the manual BenchmarkCI workflow (50+ lines) with the modern
AirspeedVelocity action (3 lines).

Changes:
- Replaced benchmark.yml with AirspeedVelocity action
- Deleted benchmark-comment.yml (no longer needed)

Benefits:
- Much simpler and easier to maintain
- Consistent with other repos in the organization
- Automatic PR comments with benchmark results
- Better integration with GitHub Actions

The AirspeedVelocity action handles all the complexity internally:
- Running benchmarks on base and PR branches
- Comparing results and generating reports
- Posting formatted comments to PRs

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@Krastanov-agent Krastanov-agent force-pushed the migrate-benchmark-to-airspeedvelocity branch from b9ff153 to 76513d3 Compare February 20, 2026 20:37
@Krastanov

Copy link
Copy Markdown
Member

the package server is having an outage, hence all these failures

this changes a workflow that we do not actually use, but it simplifies its potential use in the future and standardizes things across the github org

@Krastanov Krastanov merged commit a696995 into QuantumSavory:main Feb 20, 2026
1 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants