RNA polymerase IV (Pol IV) forms a complex with RNA-directed RNA polymerase 2 (RDR2) to produce double-stranded RNA (dsRNA) precursors essential for plant gene silencing. In the "backtracking-triggered RNA channeling" model, Pol IV backtracks and delivers its transcript's 3' terminus to RDR2, which synthesizes dsRNA. However, the mechanisms underlying Pol IV backtracking and RNA protection from cleavage are unclear. Here, we determined cryo-electron microscopy structures of Pol IV elongation complexes at four states of its nucleotide addition cycle (NAC): posttranslocation, guanosine triphosphate-bound, pretranslocation, and backtracked states. The structures reveal that Pol IV maintains an open DNA cleft and kinked bridge helix in all NAC states, loosely interacts with the nucleoside triphosphate substrate, and barely contacts proximal backtracked nucleotides. Biochemical data indicate that Pol IV is inefficient in forward translocation and RNA cleavage. These findings suggest that Pol IV transcription elongation is prone to backtracking and incapable of RNA hydrolysis, ensuring efficient dsRNA production by Pol IV-RDR2.