REQUEST: Enable coderabbit github integration for jobset and kueue

[kannon92]

Organization or Repo

kubernetes-sigs/jobset, kubernetes-sigs/kueue

Name of integration

CodeRabbit

Link to integration website

https://github.com/marketplace/coderabbitai

Describe what is attempting to be accomplished

The company link is coderabbit.

I would like to explore PR reviews on open source projects I maintain. CodeRabbit is free for open source projects.

Additional context for request

It would be good to leverage AI tools for PR reviews and experiment with these tools in k and kubernetes-sigs.

My hope is to pilot this for jobset and I'd like to bring this up as an option for Kueue and kubernetes/kubernetes if we are happy with this.

[kannon92]

cc @GiuseppeTT @andreyvelich @tenzen-y @mimowo

[GiuseppeTT]

I like the idea of using AI tools to help review PRs. Is there a way to enable this by PR with a comment like /review? This would be helpful to get an idea of how good the tool is.

[kannon92]

I like the idea of using AI tools to help review PRs. Is there a way to enable this by PR with a comment like /review? This would be helpful to get an idea of how good the tool is.

The '/' commands come from prow and may require some coding work.

I was playing around with Copilot for JobSet as I can request a review from Copilot. So I was playing around with a few reviews on the jobset repo where I have admin access.

I can't seem to cc copilot on other repos probably because copilot is not a member of the k8s organization.

[tenzen-y]

Why not leverage GitHub Copilot review? It seems that we can just enable it in the settings.

[kannon92]

Yea, As a maintainer I can manually request Copilot to review (ie kubernetes-sigs/jobset#1066 (review)).

I'll try enabling that ruleset and see. It sounds like it may depend on if the author itself has copilot though. Not sure if its free for every user.

Though I have not heard great things about Copilot from the internet. It seems to be lagging behind other AI review tools now.

[kannon92]

I did go ahead and enable Copilot on JobSet but I am interested in trying out a few different tools before I pick one.

I would still like to go forward with this.

It would be great to iterate on a few tools before we decide which one to pick. It would also be ideal to let people try a few ones.

[GiuseppeTT]

I did go ahead and enable Copilot on JobSet but I am interested in trying out a few different tools before I pick one.

I would still like to go forward with this.

It would be great to iterate on a few tools before we decide which one to pick. It would also be ideal to let people try a few ones.

+1

[kannon92]

Why not leverage GitHub Copilot review? It seems that we can just enable it in the settings.

Copilot has an annoying feature where the setup is via github account. So if you have a copilot account a review can be added.

But for external users who don't there is no automated review.

I don't think copilot would really work that well for general usage.

[jackfrancis]

I'd be happy to volunteer to share feedback as a kubernetes/autoscaler reviewer if you're looking for projects to act as a pilot.

cc @towca @x13n @elmiko @adrianmoisey @omerap12 (other SIG Autoscaling reviewers)

[elmiko]

I'd be happy to volunteer to share feedback as a kubernetes/autoscaler reviewer if you're looking for projects to act as a pilot.

i don't have a strong feeling either way. @kannon92 do you have a notion of how much traffic this will generate on the repository?

my experiences with these tools has not been great so far, i don't mind adding it if we know the quality will be high, but otherwise i'm hesitant unless the traffic will be low.

[kannon92]

I think it's about the same as many involved PR review. I can dig some examples from opendatahub where I saw that they use code rabbit.