Maybe a small part of the problem is that the processes generating patterns are not synonymous with the patterns themselves?

Energy drives the wave, while the fluctuations rise and fall. Effectively the process goes past to future, while the patterns go future to past.

Consciousness goes past to future, while the thoughts it generates go future to past.