3·
17 hours agoThat basically just sounds like Mixture of Experts
- 0 Posts
- 2 Comments
Joined 7 months ago
Cake day: January 30th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
It isn’t exactly what you’re looking for, but you may find this interesting, and it’s a bit of an insight into the relationship between pretraining and fine tuning: https://arxiv.org/pdf/2503.10965