Discussion on MultiFileConverter, SentenceTransformersDocumentIndexer, and DocumentPreprocessor

[bilgeyucel]

This is the discussion board for super components MultiFileConverter, SentenceTransformersDocumentIndexer, DocumentPreprocessor that implemented with SuperComponent class

We introduced SuperComponent class that allows to wrap any pipeline into a component interface and to create your own super component in a reusable and serializable form. Visit the discussion on SuperComponent to learn more.

MultiFileConverter, SentenceTransformersDocumentIndexer, and DocumentPreprocessor ready-made super components that encapsulate commonly used components and logic for indexing pipelines

Try them out and let us know what you think in the comments 👇

Note: Experimental features live in this repository for a fixed period of time. We don't guarantee that we will continue maintaining experimental features. But if they are successful, stable and if you like it, we will move the feature to the core Haystack package.

[julian-risch]

MultiFileConverter and DocumentPreprocessor were released in Haystack 2.13.0 https://github.com/deepset-ai/haystack/releases/tag/v2.13.0