Hi, I'm piloting Graphite for the company I work for TTD (S&P500). Unfortunately there has been no PR reviews triggered, although Graphite says that it's reviewed the code, but there are some pretty blatant issues, so I believe it didn't run at all

(If applicable) To help us repro, please send the following if you haven't already: - PR links, screenshots, and/or debug output if applicable - Repro steps - Does this happen consistently? Just to you or others on your team also? - Is this a regression? Is the problem new? - If you're having an issue with the CLI, please send us debug logs using

gt feedback --with-debug-context <any message>

Here is the PR: https://github.com/ai-codereview-testing-ttd/teamhub-api-graphite/pull/15

Hey Diego, thanks for the shout on this. You are correct in your analysis here, the logs seem to indicate LLM usage was exceeded and unfortunately in that case we fall back to "no error found". The limit resets hourly.

oh i see, I'm running a pilot for TTD my company, would it be possible to get extra credits just for these PRs?

At this time i cannot do that unfortunatelty

I've just tried this yet again, by opening new PRs and nothing happened, but there's no information about why it's not running?

I will reach out to Fernando, could you share a new PR link?

I can see it there

ah i see, different org

I'm glad you've found the right page, any updates on why this is not working?

the latest PR you sent also shows token limit exceeded.

Well I'm not sure what to tell you, I haven't used Graphite in this organization at all, and I've turned the repos of the other org off, haven't used it in a few hours, so not sure why this could be happening, seems like an error with graphite?

I am looking into how this could be that you continue to hit this error with such a small scope.

Hey, just checking, any updates?

Good Morning Diego, i will bump the internal thread on how to track down how your PRs continue to go over the limit. Could you please send over the latest test of yours?

Thank you! Sure, the PRs that I have currently open are here: https://github.com/ai-codereview-testing-ttd/teamhub-frontend-graphite/pulls

I notice too that you turned off your other repo which should help. Could you try pushing a single new PR to test on one of these repos? these are all stale and wont rerun without a change to them.

if i push any change, would that trigger a whole PR review? even if unrelated to that file?

yea you could try that too

Ok so I've tried this yet one more time, Graphite reviewed the branch/code but didn't seem to find any issues? I've deliberately introduced issues in this code but Graphite doesn't seems to have found any?

Hey Diego, this time around i can see the reviewer ran and did generate a comment but the critic (what determine the validity) returned false so nothing was posted. Seems like it has to do with missing context.

So what should we do, I've spent a lot of time getting this setup, it's clearly not working but I've tried everything on my end, can we escalate this? Otherwise we are going to have to go ahead without piloting Graphite

Hey Diego — at this point, it seems this is working as expected on our end. Our AI reviewer scans the change, but we also run a check on our confidence and validity before Graphite leaves any comment. In this specific example the AI reviewer wasn't confident in its comment due to lack of context, so it didn't leave one. We’re trying to optimize for useful comments over noise, and prefer to leave fewer useful comments that we're confident of. In any case, agree that it's a bad look to catch an intentional issue you created. I've escalated that to our team for more investigation. To be candid, we're doing a ton of work here after being acquired by Cursor to improve this experience. In the meantime, I don't want to block you on piloting Graphite. I'd recommend continuing to test it with other PRs. If you continue to get poor results, feel free to flag the urls here and I'll continue escalating.

This is very strange, Graphite is not really doing what is supposed to be doing in this case, despite quite blatant bugs. Can we try something, can you please delete my account? I'll try to set it up again from the start and see if it works, i can see graphite still reviewing code in my other org which I've removed, leading me to think is using the credits there

I can delete your account though not sure how much it will help. I would also maybe suggest removing the graphite app from the integrations in github for your other account to ensure we are not interfering.

I've tried yet again, I've disconnected the account and reconnected, created new repos, with new PRs and no luck at all