Why does the prior needs to be this complex?

[xiankgx]

Is it just so that text embedding to image embeddings is stochastic? Why not just a simple MLP between them?

[lucidrains]

sounds like a paper in the making 😄

[rom1504]

Let's try and answer that question by building eval code for the prior #29 and then we can try various priors