[Feature]: Support GitHub Actions annotations

[antoyo]

🚀 Feature Request

The Node.js version supports GitHub Actions annotations.
It would be nice if this was also supported in the Python version.

Example

No response

Motivation

It will make it more convenient to see the errors and failures from the GitHub UI.

[mxschmitt]

In Node.js we have our own test-runner which allows us to add features like this. In Python we don't have a own test-runner, we usually recommend Pytest, for which you can use e.g. https://github.com/pytest-dev/pytest-github-actions-annotate-failures

[antoyo]

I already tried this project and it doesn't report annotations for Playwright errors.
It might at least require handling multiline error strings and the ability to recognize a different error format (the one used by Playwright).
Do you suggest I open an issue there to support the error format of Playwright?
Thanks.

[mxschmitt]

Playwright error format should not be special - it just throws regular Exceptions. So yes, I recommend filing an issue in their repository. Ideally you also give them a repro in a small repository that e.g. something like this doesn't work:

def test_example(page):
    page.locator("does-not-exist").click()