Every researcher knows the pain. You type "attention mechanism survey" into Google Scholar. 50 pages of results. Half are from adjacent fields. A quarter are the wrong year. Maybe 3 papers are actually what you need.
This is not a search problem. It is a representation problem.
Keywords Are a 1990s Solution
Traditional academic search engines use inverted indices: map every word to documents containing it. When you search for "transformer architecture", the engine looks for papers with those exact words in the title or abstract.
Here is what it misses:
