[CI] TSDBPassthroughIndexingIT class failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #11788 / openjdk21_checkpart1_java-matrix
• elasticsearch-periodic #11788 / openjdk21_checkpart1_java-fips-140-3-matrix
• elasticsearch-pull-request #116409 / part-1
• elasticsearch-periodic #11778 / concurrent-search-tests

Reproduction Line:

undefined

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

undefined

Issue Reasons:

• [main] 2 consecutive failures in class org.elasticsearch.datastreams.TSDBPassthroughIndexingIT
• [main] 4 failures in class org.elasticsearch.datastreams.TSDBPassthroughIndexingIT (3.9% fail rate in 103 executions)
• [main] 2 failures in pipeline elasticsearch-periodic (66.7% fail rate in 3 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-storage-engine (Team:StorageEngine)

[kkrik-es]

Error from log:

Caused by:
        java.lang.Exception
            at org.apache.lucene.tests.mockfile.LeakFS.onOpen(LeakFS.java:46)
            at org.apache.lucene.tests.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:82)
            at org.apache.lucene.tests.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:163)
            at org.apache.lucene.tests.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:132)
            at org.apache.lucene.tests.mockfile.FilterFileSystemProvider.newOutputStream(FilterFileSystemProvider.java:200)
            at java.base/java.nio.file.Files.newOutputStream(Files.java:215)
            at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:390)
            at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:383)
            at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:216)
            at org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:75)
            at org.elasticsearch.index.store.ByteSizeCachingDirectory.createOutput(ByteSizeCachingDirectory.java:107)
            at org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:75)
            at org.apache.lucene.store.LockValidatingDirectoryWrapper.createOutput(LockValidatingDirectoryWrapper.java:43)
            at org.elasticsearch.index.engine.ThreadPoolMergeScheduler$1.createOutput(ThreadPoolMergeScheduler.java:516)
            at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:41)
            at org.elasticsearch.index.codec.bloomfilter.ES94BloomFilterDocValuesFormat$Writer.<init>(ES94BloomFilterDocValuesFormat.java:196)
            at org.elasticsearch.index.codec.bloomfilter.ES94BloomFilterDocValuesFormat.fieldsConsumer(ES94BloomFilterDocValuesFormat.java:129)
            at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.getInstance(PerFieldDocValuesFormat.java:224)
            at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:139)
            at org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:188)
            at org.apache.lucene.index.SegmentMerger.mergeWithLogging(SegmentMerger.java:314)
            at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:149)
            at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5317)
            at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4778)
            at org.apache.lucene.index.IndexWriter$IndexWriterMergeSource.merge(IndexWriter.java:6601)
            at org.elasticsearch.index.engine.ThreadPoolMergeScheduler.doMerge(ThreadPoolMergeScheduler.java:479)
            at org.elasticsearch.index.engine.ThreadPoolMergeScheduler$MergeTask.run(ThreadPoolMergeScheduler.java:598)
            at org.elasticsearch.index.engine.ThreadPoolMergeExecutorService.runMergeTask(ThreadPoolMergeExecutorService.java:370)
            at org.elasticsearch.index.engine.ThreadPoolMergeExecutorService.lambda$enqueueMergeTaskExecution$11(ThreadPoolMergeExecutorService.java:338)
            at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:1046)
            at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1090)
            at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:614)
            ... 1 more

Tanguy, I wonder if this is related to synthetic id.

[tlrx]

Thanks @kkrik-es, I'm looking into this.