FastAPI async resouce not being closed

[John98Zakaria]

I was trying out the async resource provider to verify that it is actually closing the resource.
However, I noticed that it is not closing the resource.

After deep investigations I found out that the @Inject decorator on the API
makes python think that the function is not an async generator.

FastAPI decides whether the dependency is a generator on this line https://github.com/tiangolo/fastapi/blob/master/fastapi/dependencies/utils.py#L522

Which then tries to inspect the code using the builtin inspect function

def is_gen_callable(call: Callable[..., Any]) -> bool:
    if inspect.isgeneratorfunction(call):
        return True
    call = getattr(call, "__call__", None)
    return inspect.isgeneratorfunction(call)

def is_async_gen_callable(call: Callable[..., Any]) -> bool:
    if inspect.isasyncgenfunction(call):
        return True
    call = getattr(call, "__call__", None)
    return inspect.isasyncgenfunction(call)

Which is returning false for async generators decorated with @Inject

I have attached the test code.

I'll try investigating the @Inject decorator
To see whether it could be fixed

import contextlib
import os
from functools import partial

from dependency_injector import containers, providers, resources
from dependency_injector.wiring import Provide, inject, Closing
from fastapi import FastAPI, Depends
from pydantic import BaseSettings, Field
from sqlalchemy.ext.asyncio import AsyncEngine, create_async_engine, AsyncSession
from sqlalchemy.orm import sessionmaker

os.environ["sql_alchemy_str"] = "sqlite+aiosqlite:///database.db"


class DatabaseSettings(BaseSettings):
    sql_alchemy_str: str = Field(env="sql_alchemy_str")


async def make(engine=None):
    print(f"Make {engine}")
    session = sessionmaker(
        engine, expire_on_commit=False, class_=AsyncSession
    )
    yield session()
    with open("kill.txt", "w") as f:
        f.write("killed")
    print("kill")


class DatabaseContainer(containers.DeclarativeContainer):
    config = providers.Configuration[DatabaseSettings]("DatabaseConfig")
    alchemy_engine: AsyncEngine = providers.Singleton(create_async_engine, config.sql_alchemy_str, echo=True)
    async_session = providers.Resource(make, alchemy_engine)


app = FastAPI()


@app.get("/Hello")
@inject
async def say_hi(session: AsyncSession = Depends(Closing[Provide[DatabaseContainer.async_session]], use_cache=False)):
    print(f"Got {session}")


container = DatabaseContainer()
container.config.from_pydantic(DatabaseSettings())
container.wire(modules=[__name__])


@app.on_event("startup")
async def startup_event():
    print(container.alchemy_engine())

[John98Zakaria]

I suppose we have a regression?

#574

[Voldemat]

I encountered the same issue, shutdown method of resource just don`t called after handler scope ends.

[Voldemat]

I think the main problem here that Resource is more about global context, I mean that resource initialized and shutdowns with server. But in our case we need something like AsyncFactory, that will build different objects on every request and shutdown them properly after handler scopes ends.
From the docs:
"Resource provider is similar to Singleton. Resource initialization happens only once. You can make injections and use provided instance the same way like you do with any other provider."

[John98Zakaria]

I think the main problem here that Resource is more about global context, I mean that resource initialized and shutdowns with server. But in our case we need something like AsyncFactory, that will build different objects on every request and shutdown them properly after handler scopes ends. From the docs: "Resource provider is similar to Singleton. Resource initialization happens only once. You can make injections and use provided instance the same way like you do with any other provider."

I would argue against that.
If you put a breakpoint at
https://github.com/tiangolo/fastapi/blob/master/fastapi/dependencies/utils.py#L522

You will see how fastapi handles Depends(...) objects.

Fastapi is unable to recognize that the async generator function (the one creating/closing the db) a generator is. I instead it sees it as a normal function which makes it skip the yield call and nothing close the resource.
You can verify that by converting everything to a sync function.
Then the resource will be closed and everything would be work as expected.

The only once that is mentioned for being created once /request dependency chain.

[Voldemat]

I would argue against that.
If you put a breakpoint at
https://github.com/tiangolo/fastapi/blob/master/fastapi/dependencies/utils.py#L522

I put breakpoint there and in my case fastapi receive Closing marker, not generator.
I tried to use sync generator, but it also did not closed. So I think problem is that Closing marker don`t work with Depends, If you call function manually, resource closes how it should.

[Voldemat]

I would argue against that.
If you put a breakpoint at
https://github.com/tiangolo/fastapi/blob/master/fastapi/dependencies/utils.py#L522

I use fastapi==0.79.1 and dependency-injector==4.40.0. In your case fastapi also receives Closing marker at that breakpoint.

[panicoenlaxbox]

Hi, I'm facing the same problem here

Closing + Depends does not work

[Medhi83]

Hi guys! I have the same issue, there is any update on it, or any workaround ?

Example of my init method to provide connection resource :

async def init_connection(db_pool) :
    async with db_pool.connection() as connection:
        yield connection

Where db_pool is an instance of Database from databases module.

[dosuken123]

Also, this Depends(Provide[...]) usage will spin up a new thread per request due to solved = await run_in_threadpool(call, **sub_values). This has some major issues:

• When concurrent requests happen, these threads often linger even after dependency resolutions. It seems they are waiting for exclusive lock or dead lock in the worst case scenario.
• Often, dependency resolutions are non-thread safe. You might encounter a race condition.
• Vulnerable to DoS attack: These threads could pressurize the CPU utilization of the server.

Hence, I don't recommend following the FastAPI example. https://python-dependency-injector.ets-labs.org/examples/fastapi.html.

[Tolikqq]

@dosuken123 You can write AsyncProvide and use it in fastapi routers

class AsyncProvide(Provide):
    async def __call__(self) -> T:
        return self