Repo - [langchain-serve](https://github.com/jina-ai/langchain-serve). - Exposes APIs from function definitions locally as well as on the cloud. - Very few lines of code changes and ease of development remain the same as local. - Supports both REST & WebSocket endpoints - Serverless/autoscaling endpoints with automatic tls certs on the cloud. - Real-time streaming, human-in-the-loop support - which is crucial for chatbots. - We can extend the simple existing app [pdf-qna](https://github.com/jina-ai/langchain-serve#-question-answer-bot-on-pdfs) on langchain-serve. Disclaimer: I'm the primary author of langchain-serve.