encoder (GRU) h1 h2 h3 h4 h5 Je ne suis pas chat final state = context vector fixed size, no matter how long the input bottleneck decoder (GRU) h5 s1 s2 s3 s4 I am not cat emits one token per step, feeds it back in