summarize_job_log_failures and summarize_run_log_failures tools

[harupy]

I noticed the GitHub MCP server used in a Copilot Agent session has summarize_job_log_failures and summarize_run_log_failures tools. They are extremely useful. Is it possible to use them in vscode with Copilot?

[omgitsads]

Hey @harupy! Good eye!

Yes, we're playing around with some experimental tooling in CCA. We're looking at opening this up outside of CCA, but in it's current form it would be remote only, and a Copilot Pro only feature due to the LLM call within the tool for the summarization, and not being able to surface that to a user.

We're also looking at sampling, that would allow a user to perform those LLM calls on behalf of the MCP server, but support for Sampling is not that great, both in clients and in the Go SDKs that would work in a distributed nature.

[harupy]

@omgitsads Thanks for the comment :)

We're looking at opening this up outside of CCA, but in it's current form it would be remote only, and a Copilot Pro only feature due to the LLM call within the tool for the summarization, and not being able to surface that to a user.

Awesome! This does help save token usage when analyzing CI failures.

[harupy]

I've figured out how to use them :)