empty response with custom endpoint

[tien-sketch]

I tried to write custom endpoint but response empty. my code

from fastapi import FastAPI, Request
from fastapi.responses import JSONResponse
import time
import uuid

app = FastAPI()

@app.post("/v1/chat/completions")
async def chat_completions(request: Request):
    body = await request.json()
    print("body:", body)
    # You can inspect the incoming request here if needed
    # For now, we return a static response

    response = {
        "id": f"chatcmpl-{uuid.uuid4().hex}",
        "object": "chat.completion",
        "created": int(time.time()),
        "model": "llm",
        "choices": [
            {
                "index": 0,
                "message": {
                    "role": "assistant",
                    "content": "Hello! How can I assist you today?",
                    "name": None,
                    "tool_calls": []
                },
                "finish_reason": "stop"
            }
        ],
        "usage": {
            "prompt_tokens": 100,
            "completion_tokens": 50,
            "total_tokens": 150
        }
    }

    return JSONResponse(content=response)

librechat

    - name: 'llm-model'
      apiKey: ""
      baseURL: 'http://103.x.x.x:8001/v1/'
      models:
        default:
          - 'llm'
        fetch: true 
      titleConvo: false 
      titleModel: 'llm-model'
      modelDisplayLabel: 'llm-model'
      addParams:
        disableStreaming: true

[danny-avila]

Updating Instructions (docker):
https://www.librechat.ai/docs/local/docker#update-librechat