Ask HN: Why doesn't AI use dynamical neurons instead of static activations?

I guess it's impossible to simulate billions of dynamical neurons with current computer architecture, it is limited by memory bandwidth.