Evaluation Specialist - School of Language Studies

  • Full-time

Company Description

Founded in 2017 and headquartered in Manassas, Virginia, Toomey Technologies is a SBA certified HUBZone & Woman Owned Small Business that provides customer focused professional services and solutions. Our aim is to leverage our knowledge and skills to work with our clients, offering professional and impartial advice.

Job Description

  • Design and conduct quantitative and qualitative data collection and analysis for validity and reliability studies of language proficiency tests
  • Advise on design of validity and reliability studies of language proficiency tests for quality assurance purposes
  • Produce reports of validity and reliability studies
  • Organize and improve test data reporting and analysis to track rater reliability, in-house testing trends, and vendor performance on outsourced tests
  • Produces test data reports
  • Interpret data and communicate technical information (e.g., reports, recommendations) to non-technical and senior-level audiences
  • Assess & update test procedures and makes recommendations when appropriate
  • Advise and drafts policies and guidelines related to quality assurance processes and procedures for language proficiency testing
  • Support Language Testing Unit quality assurance initiatives and SLS-wide initiatives related to testing and assessment

Qualifications

  • Active Secret Clearance
  • Post baccalaureate degree with significant quantitative focus in fields such as language testing, second language acquisition, educational measurement, evaluation, psychometrics, and/or applied linguistics
  • Minimum of three years’ experience in positions where analyzing language testing data was the primary duty (more than 50% of the time)
  • Experience designing and conducting research studies, e.g., validity and reliability studies of language proficiency tests
  • Experience using data analysis software applications (e.g., SPSS, Stata, R, WINSTEPS, FACETS, Tableau) that are used to create, organize, and analyze large data files
  • Experience using data analysis concepts, principles, and practices to conduct data collection, reviews, and reporting of information gathered during an organizational study
  • Experience designing and implementing quantitative and qualitative data collection instruments, including surveys interviews, focus groups, observations and site visits, case studies, and document reviews
  • Strong ability to work in a diverse, multicultural team environment on high priority initiatives
  • Strong critical and creative thinking and analytical skills
  • Strong written and oral communication skills
  • High level of initiative and ability to work independently

Additional Information

Must be a US Citizen

You can expect to hear back from us either way within 5 business days. Be sure to keep an eye on your spam or junk folders in case our emails end up in there! Please, no phone calls directly to our business, CEO, hiring managers, or recruiters. Due to the high volume of applicants, we typically receive for our career openings, we are not able to do phone interviews until later stages of the hiring process.

Toomey Technologies is committed to creating a diverse environment and is proud to be an equal opportunity employer. At Toomey we don't just accept differences — we support them, celebrate them, and as a company, we thrive on them. We celebrate diversity and are committed to creating an inclusive environment for all employees.  We actively look for and hire people who bring new perspectives and experiences to our company. All qualified applicants will receive consideration for employment without regard to race, religion, gender, disability, age, or veteran status.