Perhaps look at it another way: each of your actions and thoughts influences people today, who influence people tomorrow, and so on — your legacy lives on within the state space of humanity (same as you are a vessel for the legacy of those before you).
We live in a chaotic system — each action echos through the rest of time (and quite possibly is a deterministic echo of the past).