[CI] GenerativeIT test failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #11300 / rocky-8_platform-support-unix
• elasticsearch-periodic-platform-support #11300 / windows-2025_checkpart3_platform-support-windows
• elasticsearch-pull-request #99800 / part-3
• elasticsearch-pull-request #99109 / part-3
• elasticsearch-intake #30082 / part3
• elasticsearch-pull-request #98900 / part-3-fips

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.GenerativeIT.test" -Dtests.seed=8BE9BCB6C821B214 -Dtests.locale=kea-Latn-CV -Dtests.timezone=Africa/Monrovia -Druntime.java=25

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: query: from countries_bbox_web | limit 307 | drop `id` | drop name | inline stats  `shape` = count(*), UKmoYKgHt = count(*), jEHxaMcLul = count(*), VRjIowfF = count(*) | drop UKmoYKgHt, UKmoYKgH*, shape | FORK  (where  NOT true) (where  NOT false) (where  NOT VRjIowfF >= 50) (where jEHxaMcLul > 50 AND true | where  NOT false AND jEHxaMcLul == 50  | where false OR false OR  NOT false AND  NOT false) (where false AND  NOT false) | WHERE _fork == "fork3" | DROP _fork | stats  oYhFLywK = avg(VRjIowfF) + count(VRjIowfF) + max(VRjIowfF), sygFReMcRSnf = count(*), WmxejCVu = count(*), REnkUKYklmVO = absent(VRjIowfF + VRjIowfF), `VRjIowfF` = values(VRjIowfF + jEHxaMcLul + VRjIowfF) by VRjIowfF
exception: method [POST], host [http://[::1]:40725], URI [/_query?pretty=true&error_trace=true], status line [HTTP/1.1 500 Internal Server Error]
Warnings: [Line 1:622: Field 'VRjIowfF' shadowed by field at line 1:679]
{
  "error" : {
    "root_cause" : [
      {
        "type" :
[truncated]

Issue Reasons:

• [main] 6 failures in test test (0.6% fail rate in 967 executions)
• [main] 2 failures in step part-3 (0.5% fail rate in 401 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (0.8% fail rate in 400 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 5 failures in test test (0.5% fail rate in 966 executions)
• [main] 2 failures in step part-3 (0.5% fail rate in 401 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (0.8% fail rate in 400 executions)

Build Scans:

• elasticsearch-periodic-platform-support #11300 / windows-2025_checkpart3_platform-support-windows
• elasticsearch-pull-request #99800 / part-3
• elasticsearch-pull-request #99109 / part-3
• elasticsearch-intake #30082 / part3
• elasticsearch-pull-request #98900 / part-3-fips

[elasticsearchmachine]

Pinging @elastic/es-analytical-engine (Team:Analytics)

[luigidellaquila]

elasticsearch-periodic-platform-support #11300 / windows-2025_checkpart3_platform-support-windows

Two things here:

• the first one is an OOM (the heap dump is not ready yet apparently, Buildkite says uploading..., I'll come back to this later). Unfortunately we don't log the queries in case of node crash
• but there is also ES|QL: ArrayIndexOutOfBoundsException: Index 0 out of bounds for length 0 #136851

elasticsearch-pull-request #99800 / part-3

Connection refused, but it's an open PR that still needs to be worked out, so it could be a side effect of something else.

elasticsearch-pull-request #99109 / part-3
elasticsearch-intake #30082 / part3
elasticsearch-pull-request #98900 / part-3-fips

These are old PRs, these failures are already fixed.