• 29 Posts
  • 3.36K Comments
Joined 2 years ago
cake
Cake day: August 17th, 2023

help-circle





  • That’s also true, though it’s important to remember that the “experts” aren’t experts in the classical sense. Say you have a word made up of 3 tokens, it’s possible that each token is routed to a different expert. It’s just a model architecture.