You cannot suffer the past, or future

Because they do not exist.

What you are suffering is your memory

Or your imagination.