Faculty members involved in graduate admissions decisions have to determine who will be offered admissions to their respective graduate programs. In this study, we interviewed faculty at four institutions who currently serve or have served on their program's graduate admissions committee. The focus of this study was twofold: first, to explore what qualities faculty value in graduate students and second, to identify what sources of evidence faculty utilize in determining if a student possesses a desired quality. Results from these interviews showed that while qualities such as content knowledge and programming skills were valued, non-cognitive qualities such as self-motivation, resilience, and self-learning were also highly desired. The faculty noted that while current admissions practices can easily identify if a student has taken certain coursework, they typically lack the means to quickly assess non-cognitive qualities, which must often be inferred from the contents of personal statements and letters of recommendation. These results suggest that transparency on the part of graduate programs to better advertise the qualities they desire will assist letter writers and students writing personal statements to increase the impact of their application materials.