GGUF support

[lutzroeder]

Tasks:

• Quantization
• Architecture generation

Source:
gguf_init_from_file

Examples:
gpt-oss-20b-MXFP4.gguf.zip
mixtral-8x7b-v0.1.Q4_K_M.gguf.zip
phi-2.Q2_K.gguf.zip
vicuna-33b.Q2_K.gguf.zip

[charmandercha]

I met this project now, how is this PR? I am still in the process of understanding everything

[NoahBPeterson]

@charmandercha It shows the blocks themselves, but not their relationships, their outputs, or how they feed into one another.