Joel: I walked out, I walked out the door!
Clementine: Why?
Joel: I don’t know. I felt like I was a scared little kid, I was like… it was above my head, I don’t know.
Clementine: You were scared?
Joel: Yeah. I thought you knew that about me. I ran back to the bonfire, trying to outrun my humiliation.
Clementine: Was it something I said?
Joel: Yeah, you said “so go.” With such disdain, you know?

I think that was what happened to you, to us. We felt that way, You felt that way that's why you never come back to say goodbye, or to say "don't go".