https://blog.tklingard.com/tags/shower-thoughts/Recent content in Shower Thoughts on tlHugoenThu, 30 Apr 2026 00:00:00 +0000https://blog.tklingard.com/posts/2026-04/thoughts-on-meta-learning/Thu, 30 Apr 2026 00:00:00 +0000https://blog.tklingard.com/posts/2026-04/thoughts-on-meta-learning/<p>One of the questions I&rsquo;ve been wondering recently is</p> <blockquote> <p>For World Models*, what should the model weights contain at the start of a rollout?</p> </blockquote> <p><em>*I&rsquo;m referring to world models in the robotics sense, rather than the pixel-generation game engine sense</em></p> <p>This may feel obvious: the world model is, by definition, a model of the world our agent finds itself in. It&rsquo;s reasonable therefore to say so it should contain information on gravity; the definition of a kitchen; where to look for ketchup&hellip; But there is a broader question here which in a sense mimics the nature/nurture debate (what instincts and knowledge are babies born with vs what they learn through observation and interaction), alongside a question of utility - nobody wants to buy a self driving car that&rsquo;s not yet learned how to drive!</p>