Of course, it does not solve all cases. And Transformers don’t won in all cases. But, most likely, it will not last long. For example, eye tracking on Transformers. Here's a tracking like Siamese neural networks which was done a couple of weeks ago. Here is BBOX tracking + features from one, and here is from another, with almost the same names.
TransTrack