goodharting
No content on this page itself — see linked references below.
5 linked references
Cointelligence R&D Lab Proposal
- Part of the whole point of the project is to cultivating a mode of being that is consistently able to orient towards what actually matters, rather than goodharting.
- Focusing on any quantitative metric is necessarily not the way to learn how to cultivate an ungoodhartable state of mind.
- Meanwhile, social things can goodhart exceptionally easily in a different manner than highly quantified goodharting: one ends up chasing the feeling of progress or insight, which may have little to do with actual progress or insight.
Podcast summaries
- Keywords - cooperation & defection aren't as obvious as they might seem (they depend on frame) IFS collective agency untangle self-authoring social technology is more of a bottleneck than material technology intentionality everyone is always doing whatever makes the most sense to them partswork Coherence Therapy everything makes sense Everyone is basically living in a dream mashup of their current external situation & old emotional meanings self-trust comes from respecting distrust Learning how to trust yourself when all men doubt you, but make allowance for their doubting too safety psychological safety Alfie Kohn punishment is goodharting waiting to happen protectiveness is damage control deliberate "negative reinforcement" is punishment even if you don't call it that intrinsic motivation adulthood An Everyone Culture in general, people don't not-care. they care about many things and don't know how to care for all of them together (PCT) reward is just the temporary relief of punishment scarcity much of human collaboration scales sublinearly but it's possible to scale superlinearly what is culture? how do we make groups with the union of their individual wisdoms rather than the intersection of their individual wisdoms? list of common schemas learned in school School is fake averagerianism post-average
- 11:58 - 20:10 - Why isn't society producing enough high-agency individuals? safety psychological safety Alfie Kohn punishment is goodharting waiting to happen protectiveness is damage control deliberate "negative reinforcement" is punishment even if you don't call it that intrinsic motivation