• 13 Posts
  • 1.74K Comments
Joined 2 years ago
cake
Cake day: August 22nd, 2023

help-circle






  • Using the best models as synthetic data is mostly pointless. You’re just going to recreate all of its biases and failures in a degraded copy. The whole point of open source software is being able to analyze the source code to learn how it works and understand and ideally remove its weaknesses.

    Open weights doesn’t let you do that, and what research it enables is mostly just tinkering around the edges. If someone trained a network, but it kept saying racist stuff, you can’t figure out why it’s racist or rebuild it without the racism from weights alone. Just the weights is like having a binary. Maybe nice to have a gratis app to use, but not really open.