What architectural innovations do you expect to replace or extend Transformers in the future?

asked by Manish Kumar in artificial-intelligence