Research agenda for training aligned AIs using concave utility functions following the principles of homeostasis and diminishing returns
Research agenda proposing homeostatic and diminishing-returns concave utility functions for RL and LLM training to curb runaway optimisation, Goodhart failures and conflict, plus planned alignment benchmarks.