Skip to content

Commit 0b414d0

Browse files
Manjusha.SManjusha.S
Manjusha.S
authored and
Manjusha.S
committed
Categorized the commits into Enhancements and Fixes
1 parent ac5b5cf commit 0b414d0

File tree

1 file changed

+58
-54
lines changed

1 file changed

+58
-54
lines changed

‎CHANGELOG.md

Lines changed: 58 additions & 54 deletions
Original file line numberDiff line numberDiff line change
@@ -3,22 +3,26 @@ Magento Functional Testing Framework Changelog
33
3.9.0
44
---------
55

6-
### GitHub Pull Requests:
7-
* [#175](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/175) -- Fixed invalid UTF-8 chars returned from magentoCLI that breaks allure reporting
8-
* [#172](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/172) -- MQE-2342 : Provide MFTF group summary file
9-
* [#173](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/173) -- MQE-2328 : Detect unused entities
10-
* [#164](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/164) -- MQE-1693 | Ability To Run MFTF JSON Configuration From File
11-
* [#171](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/171) --MQE-2088 : Test generation error on invalid entities
12-
* [#161](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/161) --MQE-3228: Update MFTF to not pass NULL into non-nullable arguments
13-
* [#162](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/162) --MQE-2668: Some MFTF tests fail without access to S3
14-
* [#159](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/159) --MQE-1677 : Static check for created data outside action group
15-
* [#168](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/168) -- Deleted docs/img/issue.png , docs/img/pull-request.png ,docs/img/switching-the-base.png and docs/img/trouble-chrome232.png files
16-
* [#157](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/157) -- MQE-2021 : Added new attribute unique
17-
* [#156](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/156) -- MQE-3205: Set proper weight for action <startMessageQueue> for config parallel generation
18-
* [#152](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/152) -- MQE-1545: Test before/after comments in test/allure
19-
* [#154](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/154) -- MQE-1190: Do not truncate parameters when using MFTF run:test
20-
* [#142](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/142) -- MQE-3092 throw error message if key value pair is not mapped properly in .credentials file
21-
* [#144](https://github.com/magento-commerce/magento2-functional-testing-framework/pull/144) -- MQE-1794 : Removed Parameters from allure report
6+
### Fixes
7+
8+
* Fixed invalid UTF-8 chars returned from magentoCLI that breaks allure reporting
9+
* Fixed MFTF tests failure without access to S3
10+
11+
12+
### Enhancements
13+
* MFTF group summary file
14+
* Static check to detect unused entities
15+
* Ability To Run MFTF JSON Configuration From File
16+
* Test generation error on invalid entities
17+
* Update MFTF to not pass NULL into non-nullable arguments
18+
* Static check for created data outside action group
19+
* Deleted the unused images
20+
* CreateData's <field> to allow uniqueness attribute
21+
* Set proper weight for action <startMessageQueue> for config parallel generation
22+
* Test before/after comments in test/allure
23+
* Removed truncation of parameters on running MFTF run:test
24+
* Throw error message if key value pair is not mapped properly in .credentials file
25+
* Removed sub heading Parameters from allure report
2226

2327
3.8.0
2428
---------
@@ -90,7 +94,7 @@ Magento Functional Testing Framework Changelog
9094
* [#870](https://github.com/magento/magento2-functional-testing-framework/pull/870) -- Removing the csharpru/vault-php-guzzle6-transport not needed dependency
9195
* [#871](https://github.com/magento/magento2-functional-testing-framework/pull/871) -- Changed loose comparisons into strict
9296
* [#872](https://github.com/magento/magento2-functional-testing-framework/pull/872) -- Fix broken MFTF tests
93-
97+
9498
3.6.1
9599
---------
96100

@@ -106,7 +110,7 @@ Magento Functional Testing Framework Changelog
106110

107111
* Maintainability
108112
* Updated composer dependencies to be PHP 8 compatible with the except of codeception/aspect-mock.
109-
113+
110114
### GitHub Pull Requests:
111115

112116
* [#830](https://github.com/magento/magento2-functional-testing-framework/pull/830) -- Add ability to configure multiple OTPs
@@ -130,7 +134,7 @@ Magento Functional Testing Framework Changelog
130134
### Enhancements
131135

132136
* Customizability
133-
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
137+
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
134138

135139
### Fixes
136140

@@ -149,19 +153,19 @@ Magento Functional Testing Framework Changelog
149153

150154
* Maintainability
151155
* Added support for composer 2.
152-
156+
153157
3.3.0
154158
---------
155159

156160
### Enhancements
157161

158162
* Usability
159163
* [#817](https://github.com/magento/magento2-functional-testing-framework/pull/817) -- Add support for admin WebAPI token refresh.
160-
164+
161165
* Maintainability
162166
* [#814](https://github.com/magento/magento2-functional-testing-framework/pull/814) -- Update dependencies in order to make mftf php8 compatible, fix running phpcpd
163-
* [#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
164-
167+
* [#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
168+
165169
### Fixes
166170

167171
* Fixed test generation error in a split suite group (--config=parallel) to allow generation of subsequent groups.
@@ -187,8 +191,8 @@ Magento Functional Testing Framework Changelog
187191
* Usability
188192
* Introduced error tolerance during test and suite generation. See the [command page](./docs/commands/mftf.md#error-tolerance-during-generation) for details.
189193
Addressed github issue [#276](https://github.com/magento/magento2-functional-testing-framework/issues/276).
190-
191-
* Maintainability
194+
195+
* Maintainability
192196
* Updated annotation static-check to check all required annotations.
193197

194198
### Fixes
@@ -203,7 +207,7 @@ Magento Functional Testing Framework Changelog
203207
* Removed `travis.yml` and replaced with `.github/workflows/main.yml`
204208

205209
### Fixes
206-
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
210+
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
207211

208212
3.1.0
209213
---------
@@ -217,13 +221,13 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
217221
* Usability
218222
* Introduced new action `pause`, to invoke codeception interactive pause for debugging during test execution. See the [Interactive Pause](./docs/interactive-pause.md) page for details.
219223
* Introduced a new `.env` configuration option `ENABLE_PAUSE`, to enable the new pause feature.
220-
221-
* Maintainability
224+
225+
* Maintainability
222226
* Added a new static check that checks for the usage of the `pause` action. See the [command page](./docs/commands/mftf.md#static-checks) for details.
223-
224-
* Modularity
227+
228+
* Modularity
225229
* MFTF now supports the use of actions from multiple modules within suites.
226-
230+
227231
* Traceability
228232
* A deprecation notice is now added at test execution time for deprecated metadata usage.
229233

@@ -239,7 +243,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
239243
* [#683](https://github.com/magento/magento2-functional-testing-framework/pull/683) -- Docs: Renamed sample test name with the correct one
240244
* [#691](https://github.com/magento/magento2-functional-testing-framework/pull/691) -- Docs: Branch name updates
241245
* [#678](https://github.com/magento/magento2-functional-testing-framework/pull/678) -- Docs: Command added to modify the web server rewrites configuration
242-
* [#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
246+
* [#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
243247

244248
3.0.0
245249
---------
@@ -250,22 +254,22 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
250254
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.[See custom-helpers page for details](./docs/custom-helpers.md)
251255
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
252256
* `<group value="skip"/>` no longer skips a test. Instead, the test is added to the `skip` group.
253-
257+
254258
* Maintainability
255259
* Added support for PHP 7.4.
256260
* Added support for PHPUnit 9.
257261
* Dropped support for PHP 7.0, 7.1, 7.2.
258262
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
259263
* Support for sub-folders in test modules.
260-
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
264+
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
261265
* Removed file attribute for `<module>` in suiteSchema.
262266
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
263-
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
264-
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
267+
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
268+
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
265269
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
266270
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
267271
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
268-
* Removed delta option from `assertEquals` and `assertNotEquals`.
272+
* Removed delta option from `assertEquals` and `assertNotEquals`.
269273
* Added static check `deprecatedEntityUsage` that checks and reports references to deprecated test entities.
270274
* Added static check `annotations` that checks and reports missing annotations in tests.
271275
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
@@ -274,19 +278,19 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
274278
* `mftf.log` no longer includes notices and warnings at test execution time.
275279
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
276280
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
277-
281+
278282
* Traceability
279283
* Removed `--debug` option `NONE` to disallow ability to turn off schema validation.
280284
* Notices added for test entity naming convention violations.
281285
* Metadata file names changed to `*Meta.xml`.
282-
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
286+
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
283287
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
284-
288+
285289
* Readability
286-
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
290+
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
287291
* Documented [3.0.0 Backward Incompatible Changes](./docs/backward-incompatible-changes.md).
288-
* Removed blacklist/whitelist terminology in MFTF.
289-
292+
* Removed blacklist/whitelist terminology in MFTF.
293+
290294
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
291295
* Bumped dependencies to support PHP/PHPUnit upgrade.
292296

@@ -374,7 +378,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
374378
* Page
375379
* Section
376380
* Section Element
377-
* See DevDocs for details
381+
* See DevDocs for details
378382
* Improved `mftf static-checks` command to allow executing all or specific static checks.
379383
* Added a new static check that checks and reports unused arguments in action groups.
380384
* Customizability
@@ -426,12 +430,12 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
426430
-----
427431

428432
* Traceability
429-
* Allure report enhanced to display file path of tests.
433+
* Allure report enhanced to display file path of tests.
430434
* Maintainability
431435
* Added support to read MFTF test entities from `<magento>dev/tests/acceptance/tests/functional/<vendor_name>/<module_name>/*`
432436
* Removed path deprecation warning from `ModuleResolver`.
433437
* Refactored problem methods to reduce cyclomatic complexity.
434-
438+
435439
### Fixes
436440
* Fixed issue with builds due to absence of AcceptanceTester class.
437441

@@ -498,7 +502,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
498502
* Customizability
499503
* Use of `_CREDS` has been extended to `<magentoCLI>` and `<createData>` actions
500504
* Traceability
501-
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
505+
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
502506

503507
### Fixes
504508
* `static-checks` command now properly returns `1` if any static check failed.
@@ -600,7 +604,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
600604
### Enhancements
601605
* Maintainability
602606
* Added new `mftf run:failed` commands, which reruns all failed tests from last run configuration.
603-
607+
604608
### Fixes
605609
* Fixed an issue where mftf would fail to parse test materials for extensions installed under `vendor`.
606610
* Fixed a Windows compatibility issue around the use of Magento's `ComponentRegistrar` to aggregate paths.
@@ -689,15 +693,15 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
689693

690694
2.3.1
691695
-----
692-
### Enhancements
696+
### Enhancements
693697
* Maintainability
694698
* `mftf build:project` now copies over the `command.php` file into the parent Magento installation, if detected.
695699

696700
2.3.0
697701
-----
698-
### Enhancements
702+
### Enhancements
699703
* Traceability
700-
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
704+
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
701705
* Overall error messages for various generation errors have been improved. Usage of the `--debug` flag provides file-specific errors for all XML-related errors.
702706
* Allure Reports now require a unique `story` and `title` combination, to prevent collisions in Allure Report generation.
703707
* The `features` annotation now ignores user input and defaults to the module the test lives under (for clear Allure organization).
@@ -748,7 +752,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
748752

749753
2.2.0
750754
-----
751-
### Enhancements
755+
### Enhancements
752756
* Traceability
753757
* Javascript errors are now logged and reported in test output.
754758
* Test failures are no longer overwritten by failures in an `<after>` hook.
@@ -825,7 +829,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
825829
-----
826830
### Enhancements
827831
* Traceability
828-
* Severity in `<annotation>` tags now properly reflect Magento severity values.
832+
* Severity in `<annotation>` tags now properly reflect Magento severity values.
829833
* Modularity
830834
* Added ability to pass in simple values to actionGroups via addition of `type` attribute in actionGroup `<argument>` declaration.
831835
* For examples, see devdocs article on actionGroups.
@@ -861,7 +865,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
861865
* Added the ability to refer to `custom_attribute` data in persisted entities via `key` instead of index.
862866
* ex. `url_key` in category entity: `$category.custom_attributes[3][value]$` and `$category.custom_attributes[url_key]$` are both valid.
863867
* Maintainability
864-
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
868+
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
865869

866870
### Fixes
867871
* Fixed inability to use `<actionGroup>` with `<arguments>` in test hooks.

0 commit comments

Comments
 (0)