Skip to content

health check for gRPC containers #488

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ganesh-dataminr opened this issue Feb 7, 2025 · 1 comment
Open

health check for gRPC containers #488

ganesh-dataminr opened this issue Feb 7, 2025 · 1 comment

Comments

@ganesh-dataminr
Copy link

Feature request

Currently it looks like there is no equivalent for /health in the gRPC containers. Could a kubernetes compatible health probe be added?

Motivation

Currently, I am writing custom commands to enable the gRPC container within kubernetes. Enabling this makes the gRPC docker container more complete with ootb kubernetes deployment capabilities.

Your contribution

I am not a rust developer but happy to make a PR with some guidance.

@happysansam
Copy link

Check this out
https://github.com/grpc-ecosystem/grpc-health-probe

FROM ghcr.io/huggingface/text-embeddings-inference:v1.6

# Install the required packages
RUN apt-get update && \
    apt-get install -y --no-install-recommends \
    wget && \
    rm -rf /var/lib/apt/lists/*

# Install the grpc_health_probe tool
RUN GRPC_HEALTH_PROBE_VERSION=v0.4.13 && \
    wget -qO/bin/grpc_health_probe https://github.com/grpc-ecosystem/grpc-health-probe/releases/download/${GRPC_HEALTH_PROBE_VERSION}/grpc_health_probe-linux-amd64 && \
    chmod +x /bin/grpc_health_probe
readinessProbe:
  exec:
    command: ["/bin/grpc-health-probe", "-addr=:80"]
  initialDelaySeconds: 3
  periodSeconds: 5

livenessProbe:
  exec:
    command: ["/bin/grpc-health-probe", "-addr=:80"]
  initialDelaySeconds: 10
  periodSeconds: 10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants