How to install mssqlodbc18 on default Prefect image

[Daniel-Ross]

Hi all-

I'm new to Prefect and testing to see if it will fit my needs.

I'm currently stuck trying to get mssqlodbc18 installed by using my prefect.yaml file.

I've tried using the directions from Microsoft for installing on Ubuntu (which I'm not even sure the Prefect image is based on). Here they are:

# Download the package to configure the Microsoft repo
curl -sSL -O https://packages.microsoft.com/config/ubuntu/$(grep VERSION_ID /etc/os-release | cut -d '"' -f 2)/packages-microsoft-prod.deb
# Install the package
sudo dpkg -i packages-microsoft-prod.deb
# Delete the file
rm packages-microsoft-prod.deb

# Install the driver
sudo apt-get update
sudo ACCEPT_EULA=Y apt-get install -y msodbcsql18
# optional: for bcp and sqlcmd
sudo ACCEPT_EULA=Y apt-get install -y mssql-tools18
echo 'export PATH="$PATH:/opt/mssql-tools18/bin"' >> ~/.bashrc
source ~/.bashrc

I've put the above in the pull and then a prefect.deployments.steps.run_shell_script section of my prefect.yaml file.

Here is the error I generally get:

`run_shell_script` failed with error code 100: debconf: delaying package configuration, since apt-utils is not installed
debconf: delaying package configuration, since apt-utils is not installed
debconf: delaying package configuration, since apt-utils is not installed
E: Unable to locate package msodbcsql18

If I try to install apt-utils, the error log just grows in size and complains about no terminal.

Any help or advice would be appreciated.

Thanks,
Dan

[zzstoatzz]

hi @Daniel-Ross - I'm not immediately sure about compatibility with mssqlodbc18 and the python slim images, but commonly slim images omit some OS level deps so it might be worth building your own image from one you know has things you need or instead hunting down the missing OS deps

[Daniel-Ross]

Thanks @zzstoatzz . If I build my own image, can I still use Prefect Cloud to manage it? I interpret this as "no".

[Daniel-Ross]

I've gotten a little further on this. I'm now stuck at the actual installation of msodbsql18 because a EULA has to be accepted. Is there a way to do this in the prefect.yaml file?

Full yaml:

pull:
    - prefect.deployments.steps.run_shell_script:
        id: initial-apt-get
        script: |
            apt-get update
            apt-get install -y --no-install-recommends curl gnupg2 apt-transport-https software-properties-common unixodbc unixodbc-dev lsb-release
    - prefect.deployments.steps.run_shell_script:
        id: install-msodbcsql18
        script: |
            curl -sSL -O https://packages.microsoft.com/config/debian/12/packages-microsoft-prod.deb
            dpkg -i packages-microsoft-prod.deb
            rm packages-microsoft-prod.deb
            apt-get update
            ACCEPT_EULA=Y apt-get install -y msodbcsql18 <-- THIS THROWS A FILE NOT FOUND ERROR FOR ACCEPT_EULA
    - prefect.deployments.steps.run_shell_script:
        id: get-github-token-sqlconnector
        script: uv tool run prefect-cloud github token Daniel-Ross/sql_connector
    - prefect.deployments.steps.git_clone:
        id: git-clone-sql-connector
        repository: https://x-access-token:{{ get-github-token-sqlconnector.stdout }}@github.com/Daniel-Ross/sql_connector.git
    - prefect.deployments.steps.run_shell_script:
        id: pip-install-sqlconnector
        script: |
                echo $CWD
                uv run pip install ./sql_connector
        stream_output: True
    - prefect.deployments.steps.run_shell_script:
        id: get-github-token
        script: uv tool run prefect-cloud github token Daniel-Ross/prefect_test_private
    - prefect.deployments.steps.git_clone:
        id: git-clone-main-repo
        repository: https://x-access-token:{{ get-github-token.stdout }}@github.com/Daniel-Ross/prefect_test_private.git
    - prefect.deployments.steps.pip_install_requirements:
        directory: "{{ git-clone-main-repo.directory }}" # `clone-step` is a user-provided `id` field
        requirements_file: requirements.txt
        stream_output: True