Skip to content

[feat] add CI performance regression test for graph creation#141

Open
yuvraajnarula wants to merge 6 commits into
mllam:mainfrom
yuvraajnarula:feature/ci-performance-regression
Open

[feat] add CI performance regression test for graph creation#141
yuvraajnarula wants to merge 6 commits into
mllam:mainfrom
yuvraajnarula:feature/ci-performance-regression

Conversation

@yuvraajnarula

@yuvraajnarula yuvraajnarula commented Apr 22, 2026

Copy link
Copy Markdown

Describe your changes

This PR adds an automated performance regression test to the CI pipeline. It runs the graph creation benchmark on a fixed grid size (200×200) and compares runtime and peak memory against predefined thresholds. The test is triggered on every pull request that modifies src/ or tests/benchmarks/.

Changes include:

Thresholds (based on local runs with safety margin):

  • Runtime: 25 seconds
  • Peak memory: 500 MB

Why this is needed:

  • Prevents performance regressions from being merged unnoticed.
  • Provides an objective, automated check for graph creation efficiency.
  • Complements the scaling benchmarks with a fixed‑point test suitable for CI.

Issue Link

Related to #137 (second part – automated regression testing)

Type of change

  • 🐛 Bug fix
  • ✨ New feature
  • 💥 Breaking change
  • 📖 Documentation

Checklist before requesting a review

  • My branch is up-to-date with the target branch (main after [Feat] Memory Profiling and Automated Performance Regression Testing #137 is merged).
  • I have performed a self-review of my code.
  • For any new/modified functions/classes I have added docstrings (for check_regression.py).
  • I have placed in-line comments where needed.
  • I have updated the documentation (README.md – will add a note about the CI test).
  • I have added tests that prove my fix is effective (the CI test itself is the test).
  • I have given the PR a name that clearly describes the change, written in imperative form: "feat: add CI performance regression test for graph creation".
  • I have requested a reviewer and an assignee.

Checklist for reviewers

  • the code is readable
  • the code is well tested
  • the code is documented
  • the code is easy to maintain

Author checklist after completed review

  • I have added a line to the CHANGELOG describing this change, in the [Unreleased] section under added.

Checklist for assignee

  • PR is up to date with the base branch
  • the tests pass
  • author has added an entry to the changelog
  • Once the PR is ready to be merged, squash commits and merge the PR.

@yuvraajnarula yuvraajnarula changed the title [feat] ci performance regression [feat] add CI performance regression test for graph creation Apr 22, 2026
@yuvraajnarula yuvraajnarula marked this pull request as ready for review April 23, 2026 05:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants