I remember the recent controversy about inclusion of google now features in chromium in relation to this.
We have mobile phones and other devices like Amazon's Echo that can and do listen to whatever we speak. Although, right now they only transmit the data to cloud after you say the tag phrase like "OK, Google" etc, it doesn't seem hard to make them always on, if the government agencies are given the legal authority to do so.