We investigate student confusion of concepts of electric and magnetic force. At various times during a traditional university-level course, we administered a series of simple questions about the direction of force on a charged particle moving through either an electric or a magnetic field. We find that after electric force instruction but before magnetic force instruction most students answer electric force questions correctly, and we replicate well-known results that many students incorrectly answer that magnetic forces are in the same direction as the magnetic field. After magnetic force instruction, most students answer magnetic force questions correctly, but surprisingly many students incorrectly answer that electric forces are perpendicular to electric fields, as would happen if a student confused electric forces with magnetic forces. As a further indication of interference between electric and magnetic concepts, we also find that students' responses depend on whether electric or magnetic force questions are posed first, and this effect depends on whether electric or magnetic force was most recently taught.