The upper level E&M course (i.e. based on Griffiths) involves the extensive integration of vector calculus concepts and notation with abstract physics concepts like field and potential. We hope that students take what they have learned in their math classes and apply it to help represent and make sense of the physics. Previous work showed that physics majors at different levels (pre-E&M course, post-E&M course, 1st year graduate students) had great difficulty using non-Cartesian unit vector symbols appropriately in a particular context. Since then we have developed a series of problems they work on in groups and discuss as a whole class to help them confront and resolve some of their difficulties. This paper presents those problems, typical in-class group responses, and three years of post-test data. Results show that students have (i) a very strong initial negative reaction to the vagueness of the r symbol, and (ii) an improved functional understanding of the notation as demonstrated by a better ability to use the symbols appropriately.