PHPUnit 12.2.0

Added

Experimental Support for Open Test Reporting XML

PHPUnit has supported reporting test results in the JUnit XML format for a long time. Unfortunately, there has never been a standard schema for the JUnit XML format. Common consumers of Clover XML log files interpret these files differently, which has led to frequent problems.

To address this, the JUnit team started the Open Test Reporting project, creating and maintaining language-agnostic XML and HTML test reporting formats. Unlike JUnit XML, Open Test Reporting's XML formats are extensible.

Logging in the Open Test Reporting XML format is controlled by the new --log-otr CLI option and the new <otr> XML configuration element.

This feature is experimental and the generated XML may change in order to enhance compliance with the Open Test Reporting project's XML schema definitions. The same applies to the XML schema definitions for information that is specific for PHP and PHPUnit. Please note that such changes may occur in bugfix or minor releases and could potentially break backwards compatibility.

Experimental Support for OpenClover XML

PHPUnit has supported reporting code coverage information in the Clover XML format for a long time. Unfortunately, there has never been a standard schema for the Clover XML format. Common consumers of Clover XML log files interpret these files differently, which leads to frequent problems.

The original commercial Clover project has been superseded by the Open Source OpenClover project, which provides an XML schema for its OpenClover XML format. Rather than modifying the existing Clover XML reporter to comply with the OpenClover XML schema, thereby breaking backward compatibility, a new OpenClover XML reporter has been introduced.

This new reporter is controlled by the new CLI option, --coverage-openclover, and the new XML configuration element, <openclover>. This code coverage reporter generates XML documents that validate against the OpenClover project's XML schema definition, with one exception: the <testproject> element is not generated.

The existing Clover XML reporter, controlled by the --coverage-clover CLI option and the <clover> XML configuration element, remains unchanged.

This feature is experimental and the generated XML may change to enhance compliance with the OpenClover XML schema definition. Please note that such changes may occur in bugfix or minor releases and could potentially break backwards compatibility.

Miscellaneous

• --with-telemetry CLI option that can be used together with --debug to print debugging information that includes telemetry information
• The TestCase::provideAdditionalInformation() method can now be used to emit a Test\AdditionalInformationProvided event
• The new Test\AfterLastTestMethodFailed, Test\AfterTestMethodFailed, Test\BeforeFirstTestMethodFailed, Test\BeforeTestMethodFailed, Test\PostConditionFailed, Test\PreConditionFailed events are now emitted instead of Test\AfterLastTestMethodErrored, Test\AfterTestMethodErrored, Test\BeforeFirstTestMethodErrored, Test\BeforeTestMethodErrored, Test\PostConditionErrored, Test\PreConditionErrored when the Throwable extends AssertionFailedError to distinguish between errors and failures triggered in hook methods
• The new Test\PreparationErrored event is now emitted instead of Test\PreparationFailed when the Throwable does not extend AssertionFailedError to distinguish between errors and failures triggered during test preparation
• Test\PreparationFailed::throwable()

Changed

• #6165: Collect deprecations triggered by autoloading while loading/building the test suite
• Do not treat warnings differently than other issues in summary section of default output
• A warning is now emitted when both #[CoversNothing] and #[Covers*] (or #[Uses*]) are used on a test class
• A warning is now emitted when the same #[Covers*] (or #[Uses*]) attribute is used multiple times on a test class
• A warning is now emitted when the same code is targeted by both #[Covers*] and #[Uses*] attributes
• A warning is now emitted when a hook method such as setUp(), for example has a #[Test] attribute
• A warning is now emitted when more than one of #[Small], #[Medium], or #[Large] is used on a test class
• A warning is now emitted when a data provider provides data sets that have more values than the test method consumes using arguments

---

How to install or update PHPUnit

PHPUnit 11.5.22

Changed

• Do not treat warnings differently than other issues in summary section of default output

---

How to install or update PHPUnit

PHPUnit 12.1.6

Changed

• #6210: Set default Clover coverage project name
• #6217: Improve the error message when createStubForIntersectionOfInterfaces() is called with a class

---

How to install or update PHPUnit

PHPUnit 11.5.21

Changed

• #6210: Set default Clover coverage project name
• #6217: Improve the error message when createStubForIntersectionOfInterfaces() is called with a class

---

How to install or update PHPUnit

PHPUnit 12.1.5

Fixed

• #6192: Reverted change made in PHPUnit 11.5.19 due to regression
• #6199: assertEmpty() and assertNotEmpty() use overly restrictive phpstan-assert empty directives

---

How to install or update PHPUnit

PHPUnit 11.5.20

Fixed

• #6199: assertEmpty() and assertNotEmpty() use overly restrictive phpstan-assert empty directives
• #6192: Reverted change made in PHPUnit 11.5.19 due to regression

---

How to install or update PHPUnit

PHPUnit 12.1.4

Added

• displayDetailsOnAllIssues attribute on the <phpunit> element of the XML configuration file and --display-all-issues CLI option for controlling whether PHPUnit should display details on all issues that are triggered (default: false)
• failOnAllIssues attribute on the <phpunit> element of the XML configuration file and --fail-on-all-issues CLI option for controlling whether PHPUnit should fail on all issues that are triggered (default: false)

Changed

• #5956: Improved handling of deprecated E_STRICT constant

Fixed

• #6192: Positive %a and %A matches are not ignored from diff when EXPECTF fails

---

How to install or update PHPUnit

PHPUnit 11.5.19

Added

• displayDetailsOnAllIssues attribute on the <phpunit> element of the XML configuration file and --display-all-issues CLI option for controlling whether PHPUnit should display details on all issues that are triggered (default: false)
• failOnAllIssues attribute on the <phpunit> element of the XML configuration file and --fail-on-all-issues CLI option for controlling whether PHPUnit should fail on all issues that are triggered (default: false)

Changed

• #5956: Improved handling of deprecated E_STRICT constant

Fixed

• #6192: Positive %a and %A matches are not ignored from diff when EXPECTF fails

---

How to install or update PHPUnit

PHPUnit 10.5.46

Added

• displayDetailsOnAllIssues attribute on the <phpunit> element of the XML configuration file and --display-all-issues CLI option for controlling whether PHPUnit should display details on all issues that are triggered (default: false)
• failOnAllIssues attribute on the <phpunit> element of the XML configuration file and --fail-on-all-issues CLI option for controlling whether PHPUnit should fail on all issues that are triggered (default: false)

Changed

• #5956: Improved handling of deprecated E_STRICT constant
• Improved message when test is considered risky for printing unexpected output

---

How to install or update PHPUnit

PHPUnit 9.6.23

Changed

• #5956: Improved handling of deprecated E_STRICT constant
• Improved message when test is considered risky for printing unexpected output

---

How to install or update PHPUnit