Install Haystack With a Dockerfile

[ghost]

hi im trying to install haystack on docker with a Dockerfile like that

# Python version on the development machine
FROM python:3.9.12

# Create an app directory
RUN mkdir /app

# Copy the app to the app directory
COPY . /app

# set the working directory to the app directory
WORKDIR /app

# Install requirements
RUN pip install -r requirements.txt
RUN pip install farm-haystack -f https://download.pytorch.org/whl/torch_stable.html

# Run the app
CMD ["python", "run.py"]

and build it with that command
docker build -t project:1.0 .

but when i try to run the container this error appear

ERROR - root -  `libsndfile` not found, it's probably not installed. The node will most likely crash. Please install soundfile's dependencies (https://python-soundfile.readthedocs.io/en/latest/)
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/haystack/nodes/audio/_text_to_speech.py", line 11, in <module>
    import soundfile as sf
  File "/usr/local/lib/python3.9/site-packages/soundfile.py", line 142, in <module>
    raise OSError('sndfile library not found')
OSError: sndfile library not found
/usr/local/lib/python3.9/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
  warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
Traceback (most recent call last):
  File "/app/run.py", line 62, in <module>
    main()
  File "/app/run.py", line 11, in main
    document_store = FAISSDocumentStore.load(index_path="data/" + language_data + "_data.faiss",
AttributeError: type object 'MissingDependency' has no attribute 'load'

but the soundfile lib is in my requirment.txt which i run in the docker file SoundFile~=0.10.3.post1 i even tried to install it directly

# Install requirements
RUN pip install -r requirements.txt
RUN pip install SoundFile
RUN pip install farm-haystack -f https://download.pytorch.org/whl/torch_stable.html

but the error is still the same i have haystack installed on my computer (windows) and it work perfectly.

[danielbichuetti]

Hi @azetoy!

You need to install the Linux library, not just the Python wrapper to soundfile.

Please add this to your Dockerfile.
RUN apt-get install libsndfile1 -yqq

There are other system dependencies that you may need to install, it depends on which part of haystack you are making usage of.

[ghost]

Hi @danielbichuetti !

Thanks for your reply as you told me i installed the package successfully but now i have this strange erro code just telling me that MissingDependency has no attribute load

here the full error

Traceback (most recent call last):
  File "/app/run.py", line 62, in <module>
    main()
  File "/app/run.py", line 11, in main
    document_store = FAISSDocumentStore.load(index_path="data/" + language_data + "_data.faiss",
AttributeError: type object 'MissingDependency' has no attribute 'load'

and my dockerfile

# Python version on the development machine
FROM python:3.9.12
FROM ubuntu:latest
# Create an app directory
RUN mkdir /app

# Copy the app to the app directory
COPY . /app

# set the working directory to the app directory
WORKDIR /app

# Install requirements
RUN apt-get update
# install python 3.9.12
#RUN apt-get install -y python3.9

# install pip version 22.0.4
RUN apt-get install -y python3-pip && pip3 install --upgrade pip==22.0.4
RUN apt-get install libsndfile1 -yqq
RUN pip install -r requirements.txt
RUN pip install farm-haystack -f https://download.pytorch.org/whl/torch_stable.html

# Run the app
CMD ["python3", "run.py"]

i may need other Linux lib to install but the error dont tell me which one.

[danielbichuetti]

@azetoy May you add FAISS dependencies using egg "faiss" ?

RUN pip install farm-haystack[faiss]

[ghost]

@danielbichuetti thanks everything work i thought hat by installing farm-haystack it will also install the dependencies.

[danielbichuetti]

@azetoy You are welcome. To install everything, please use:

RUN pip install farm-haystack[all]

But, this just install the python deps. OS libs and softwares need to be manually installed. Like sndfile, xpdf..