What are the important problems of your field? What important problems are you working on? If what you are doing is not important, and if you don’t think it is going to lead to something important, why are you working on it?
— Richard Hamming
I think all of the following problems are worth solving and we need someone to work on them. This doesn’t want to draw a line between things we should do and things we shouldn’t do. This is an attempt to figure out:
what problems deserve the best researchers and engineers alive?
\(\huge \textit{what problems deserve the best researchers and engineers alive?}\)
Better Reinforcement Learning: learning from explanations, not millions of examples
LLMs + traditional/better RL (not RLHF): what if you fine-tune an LLM to be a chess master in an RL fashion and as a side effect it becomes a superhuman genius in something else? Repeat WLOG for every problem where traditional/better RL can be applied, and strive to figure out ways to reformulate problems so traditional RL can be applied
Level 5 Self-driving: it must not be fun to drive trucks around all day, especially if you can’t come back home to your family at night — see also the following bullet point
Generative Vision / Robotics: Solving level 5 self-driving and/or generative vision potentially also gets us a good general physics simulator as a side effect, which can then be used to do reinforcement learning on more robotics tasks. The impact of each of these problems would compound far further and contribute to solving the other pivotal problems as you can see.
Maybe these are fundamentally all the same problem. Maybe all of these connect and converge towards general intelligence (”AGI”). I don’t know. Yet.
Bioengineering: solving diseases. This is fundamentally just information science, where the rest of techniques apply. Nothing new. It’s still worth remarking and being included here because this application is timeless and important enough regardless of techniques
Laziness / Attention span: the human attention span decrease is the saddest loss of this decade. This can both lead towards slowing down productivity and innovation as well as cutting individual’s ability to enjoy life and human consciousness as a whole. It also makes us optimize for the wrong lazy objectives, addictive infinite scrolling feeds may be just the beginning
Climate change: yes, we don’t have enough data and are not too sure about this, exactly because of this uncertainty, we should move as if the worst forecasts will become true.
I also think almost all of the original Y Combinator Requests for Startup from Summer 2024 are great ideas pivotal for humanity.
AI application/system-level efficiency (retrieval tricks, orchestration, use case-specific wrappers): the iPhone interface was so good it stayed the same for years. The chat interface, similarly, is so good that will stay until the next innovation of similar impact. Nothing pivotal here. Yes, it is necessary to integrate AI to improve the efficiency of as many fields as possible, and it is the right thing to do. Is it worth the best researchers/engineers of the decade? No.
AR/VR: cool, impressive, but what difference will it make? And will it be net positive or net negative? Is it worth the best researchers/engineers of the decade?
Brain-Computer Interfaces: the computer keyboard is completely fine. This is just good for accessibility.
Interplanetary quests: this is of course interesting but all the former problems, if solved, would make this easy.
I also don’t believe any of the latest (as of today) YC Requests for Startups are pivotal for humanity. Sure, they would probably make for good businesses, but do they deserve the best researchers/engineers alive? Probably not.
Correct me if I’m wrong at hello at danielfalbo dot com.
.png)

