Unable to run in Deno Deploy and Supabase Edge Functions

[savy-91]

Describe the bug
I am trying to run a simple RAG endpoint in Deno Deploy/Supabase Edge Functions and this import makes the bundled function too heavy:
Deploying Function: analyze (script size: 167.8MB)

I tried to import each part individually:

import {
    OpenAI,
    OpenAIAgent,
} from "llamaindex/llm/openai";

import {
    QueryEngineTool,
} from "llamaindex/tools/QueryEngineTool";

import {
    PDFReader,
} from "llamaindex/readers/index";

import {
    FunctionTool,
} from "llamaindex/tools/index";

import {
    VectorStoreIndex,
} from "llamaindex/indices/vectorStore/index";

import {
    Settings,
} from "llamaindex/Settings";

with no significant change.

To Reproduce

import {
    VectorStoreIndex,
    PDFReader,
    Settings,
    OpenAI,
    FunctionTool,
    OpenAIAgent,
    QueryEngineTool,
    Document,
    Metadata
} from "npm:llamaindex@^0.8.30";

Expected behavior
The documentation does not mention any specific procedure to run this in an edge environment like this so I would expect this to run.

Desktop (please complete the following information):

• OS: [e.g. macOS, Linux]
• JS Runtime / Framework / Bundler (select all applicable)
• Node.js
• Deno
• Bun
• Next.js
• ESBuild
• Rollup
• Webpack
• Turbopack
• Vite
• Waku
• Edge Runtime
• AWS Lambda
• Cloudflare Worker
• Others (please elaborate on this)
• Version [e.g. 0.8.30]

[savy-91]

Update:

import {
    OpenAI,
    OpenAIAgent,
} from "@llamaindex/openai";
import {Settings} from "@llamaindex/core/global";
import {FunctionTool} from "@llamaindex/core/tools";
import {PDFReader} from "@llamaindex/readers/pdf";

I was able to locate these from different submodules.

However I can't find any correspondence for these:

import { VectorStoreIndex } from "llamaindex";
import { QueryEngineTool } from "llamaindex";

[savy-91]

Update 2:

Apparently the main culprit of the size of the bundle is @llamaindex/clip.

As a hacky solution i was able to copy over from this repo all of the missing implementations related to VectorStoreIndex and QueryEngineTool, removing all dependencies on clip, and importing them from a local path.