Seeing duplicate demos #7
Description
I noticed in a query I was optimizing, when using using num_promos = 3, I was getting duplicate demonstrations. I am not sure if that's because there are duplicates in the selection pool or something else. As a quick fix, I did change
sorted_scores = sorted(sim_scores, reverse=True)
to
sorted_scores = list(set(sorted(sim_scores, reverse=True)))
in get_k_promos in LLM_R2.py.
This worked, but I'm guessing there is a better fix. Of course I'm operating under the assumption that you didn't intend to produce duplicate demos inside the prompt.
Please advise. Again, I am continually thankful for your work and responses to my questions.