Most implementations are actually moving in the opposite direction. Previously, there was a tendency to look to aggregate words into phrases to better capture the "context" of a word. Now, most approaches are splitting words into sub-word parts or even characters. With networks that capture temporal relationships across tokens (as opposed to older, "bag of words" models), multi-word patterns can effectively be captured by attending to the temporal order of sub-word parts.
Strong Analytics | Chicago, IL | Full-time Data Scientists, Data Engineers | https://www.strong.io
We help companies integrate state-of-the-art machine learning into their products, internal tools, and infrastructure. We've designed, built, and deployed products in the automotive space, pharma, gaming, retail, tech, and many other verticals.
Requires an advanced degree (M.S./Ph.D.) in a quantitative science and 1+ years applying machine learning to real-world problems.