Likely not, we will probably never have something like Summit or Fugaku in say, a smartphone-size form factor.
Just because we can put a 1990 supercomputer in a 2020 smartphone today doesn’t mean we can put a 2020 supercomputer in a 2050 smartphone.
Supercomputers are vastly larger than they used to be, and there are physical limits in how small we can make processors. Ultimately we are limited by the speed of light on how fast processors can run, and by the size of atoms in how small we can make a transistor in a microprocessor.
So we’ve got two hard limits in how small and how fast a computer can be.
So basically, no, we’re not going to see a 2020 supercomputer in a 2050 phone, or even a 2100 phone. It’s probably never going to be possible.