Validity and Reliability of the Navigator Assessments

The Navigator Assessments have been established and validated in accordance with the procedures described in “Standards of Educational Psychological Tests and Manuals,” which is referred to in paragraph (2) 1607.6, “Minimum Standards for Evaluation,” Federal Register Volume 35, dated Saturday, August 1, 1970. It is therefore not discriminatory and is in compliance with E.E.O.C. and other Federal Regulations.

The methodology of the Navigator establishes the legal and written confirmation that this evaluation was professionally developed and validated in accordance with both Construct and Criterion methods of validation. Navigator System Solutions, LLC., will defend the validation or content of the Navigator for any company using this assessment, but cannot assist any company as a result of the misuse or abuse of the tool.

There are four forms of validity:

CONSTRUCT refers to the extent in which dimensions with similar names on different tests relate to one another. Two things that correlate highly are not necessarily identical, but do provide reassurance that they are related and are a “construct” or part of the makeup (like honesty, dependability, sociability, etc.) of an individual as related to actual performance.

CONCURRENT is that approach whereby people who are successful within a given position within a given company or industry are evaluated and generally grouped TOP THIRD, MIDDLE THIRD, BOTTOM THIRD. The assessment scores of the people who fit each of these ranges are then compiled and Benchmark Standards of the TOP THIRD are used to recruit, hire, train or manage.

PREDICTIVE occurs when the company hires people for a job or awards a franchise based on normal internal procedures (interviewing, reference checks, education/experience, etc.) and at the same time has them complete the Navigator Assessment. Within seconds, or any appropriate period of time later, the assessment is scored, and benchmarks are established based on the individuals who are with the employer or franchisor and whom the employer or franchisor considers successful, based on their own internal measurements of performance. Benchmark Standards are thus established through the Predictive approach.

CONTENT represents job function testing, i.e., typing, mathematics, design, CPA exams, physical work endurance, etc. Content validation is not the method utilized by Navigator System Solutions, LLC., since we do not provide content assessments to the marketplace.

Reliability of The Navigator

An assessment is considered reliable when the results can be repeated with a high degree of consistency. To be reliable, assessments must meet two requirements:

•   Internal consistency

•   Test-retest reliability

To demonstrate empirical evidence for reliability, we regularly examine both the internal consistency and test, retest reliability statistics against the best practices defined by organizational and behavioral psychology.

Validity of The Navigator

An assessment is considered valid when the assessment measures what it is stated to measure. To demonstrate empirical evidence of this for the Navigator, we test for several types of validity:

•   Face validity

•   Content validity

•   Construct-convergent validity

•   Construct-divergent validity

•   Criterion-related validity

 The research team at the Navigator is constantly innovating to provide deeper and more meaningful insights into the impact behavioral sciences has on business, franchising and individuals and convey this information in an accessible, memorable format. All benchmarks developed, for clients, are tested and retested rigorously across sufficient populations to confirm their validity and reliability.

Standard Errors of Measure:

Standard errors of measure (SEM) is an indication of the consistency of an instrument based on its own point scale. Navigator assessment results are plotted on a scale from 0 – 100%. The SEM of the Navigator assessment tool ranges from 2.0% to 3.0%, indicating that a person who took an assessment over and over is not expected to get results that vary in any one category by more than 3%. This is a further indication of construct validity.

Actual User Feedback:

After thousands and thousands of assessments administered, on-line we can report that user feedback is that the Navigator Assessment results are useful for the intended purpose (personal growth, understanding of one’s value system, along with the meta-analysis in 9 key criteria). Such empirical data is a consideration for the validity of the Navigator assessment tool. Well over 95% of the participants offer very positive feedback. The rare cases where a participant has disagreed with the Navigator Personal Development Chart results are less than one tenth of one percent.

We are consistently told the Navigator is helpful and accurate.

NFIB
Impact
IFA Member
HCI