Re-use / clear out `HuffmanDecoder` state, or make it _much faster_ to build

[fasterthanlime]

I know this is for a lot of small requests, but still. Even just switching to ahash (#228) or properly-sizing the hashmap could help a lot: