• 0 Posts
  • 9 Comments
Joined 2 years ago
cake
Cake day: June 30th, 2023

help-circle




  • Nailed it. I’ve tried taking notification contexts and generally seeing how hard it is. Their foundational model, I think is 4bit quantized, 3billion parameter model.

    So I loaded up llama, phi, and picollm to run some unscientific tests. Honestly they had way better results than I expected. Phi and llama handled notification summaries (I modeled the context window, nothing official) and both performed great. I have no idea wtf AFM is doing, but it’s awful.