It's not buying a cup of coffee that's the issue. The issue is in converting between currencies, which is no different than investing in foreign currencies. If you exchange USD for EUR, wait a while, then exchange back to USD and you've made a profit, it's taxable.