Glossary

Applicant tracking system (ATS)

By ScoringFactoryUpdated First published 1 July 20264 min read
Definition

An applicant tracking system (ATS) is software that collects job applications, moves candidates through hiring stages and stores interview feedback. Many also filter or rank applicants automatically, which means the system's settings can decide who a recruiter ever reads.

What an ATS does

At its core an applicant tracking system is a database with a workflow on top. A typical setup does five jobs:

  1. Posts the role to the careers page and job boards.
  2. Collects applications, parsing resumes into fields such as titles, employers, dates and skills.
  3. Screens with application questions, keyword filters, and in newer systems, a match score or rank.
  4. Moves candidates through stages (applied, screen, interview, offer) and schedules interviews.
  5. Stores feedback and decisions, which becomes the hiring record for reporting and compliance.

Steps 1, 2, 4 and 5 are record keeping. Step 3 is where the ATS starts making judgments, and it is the step to watch.

How ATS screening filters candidates

Screening in an ATS takes three common forms, often stacked.

  • Knockout questions. Yes or no questions on the application ("Do you have a commercial driver's license?") that reject automatically on the wrong answer. These are knockout criteria enforced by software.
  • Keyword and field filters. Recruiters search or filter the parsed fields, for example "title contains manager, 5 or more years". Anyone whose resume parsed badly, or who used a different word, drops out of the view.
  • Match scores and rankings. Many systems now rank applicants against the job description using a model. This is AI candidate scoring inside the ATS.

The Hidden Workers: Untapped Talent report from Harvard Business School and Accenture found that employers' automated recruiting systems often screen out capable candidates on narrow criteria, such as gaps in work history or missing exact keywords. The authors called the people filtered this way hidden workers.

Worked example: auditing an ATS filter

Riverside Credit Union, a fictional employer, gets 900 applications for a branch operations role. Its ATS shows recruiters only the top 150 by match score, after a knockout asking for "3 or more years in banking".

StageCandidatesFilter applied
Applied900None
Passed knockout4103 or more years in banking
Shown to recruiter150Top match scores
Phone screen30Recruiter review

A recruiter reads a sample of 50 knocked-out applications by hand. Eleven ran retail stores with cash handling and staff scheduling, which is most of the job. The knockout was screening for a proxy. Riverside replaces it with two specific questions about cash handling and team scheduling and widens the recruiter's longlist to 250. Reading a sample of rejects is the cheapest audit an ATS owner can run.

ATS vs recruiting CRM vs scoring tool

Applicant tracking systemRecruiting CRMCandidate scoring tool
Main jobManage active applicants for open rolesNurture potential candidates before they applyRate candidates against the role and the team's bar
Who is in itPeople who appliedPeople you might want laterWhoever you send to it
OutputPipeline stages and a hiring recordContact history and campaignsScores with reasons
Where judgment sitsFilters and match scores, if turned onMostly with recruitersIn the score, reviewed by people

The lines blur, since many products now include all three. What matters is knowing which feature is making a judgment and whether anyone checks it. Ranking features follow the same principles as candidate scoring by people: clear criteria, evidence per rating, and a human decision.

Rules and common mistakes

Automated screening inside an ATS can fall under rules for automated hiring tools. In New York City, Local Law 144 requires a bias audit within one year of use, a public summary of the results, and notice to candidates before an employer uses an automated employment decision tool. Whether a given ATS feature counts depends on how it is used. This is not legal advice. Ranking features that are turned on belong under AI governance: someone owns the settings and reviews the results and the rejects on a schedule.

  • Leaving default filters on. Vendors ship generic settings. Review every knockout and filter for each role.
  • Trusting resume parsing. Columns, tables and unusual job titles parse badly. Spot-check parsed records against the original files.
  • Never reading the rejects. A small hand-read sample each cycle shows what the filters are actually removing.
  • Treating the match score as the job. It measures similarity to the job description, which may be out of date. Score against the role's actual needs, as in job fit scoring.
  • Auto-rejecting at the bottom of the rank. Keep a human in the loop for rejections.

How ScoringFactory works alongside an ATS

ScoringFactory does not replace an ATS. It scores candidates by the work they have done, against a bar learned from the team's past hiring decisions, and cites each score to the line in the record, so a recruiter can see why someone ranked where they did. It never rejects anyone on its own; people make every decision. See the hiring use case.

Frequently asked questions

What is an applicant tracking system?

An applicant tracking system is software that employers use to post jobs, collect and store applications, move candidates through hiring stages, schedule interviews and record feedback and decisions. Many ATS products also screen applicants with knockout questions, keyword filters or match scores, which affects which candidates a recruiter sees.

Do ATS filters reject qualified candidates?

They can. Knockout questions and keyword filters remove anyone who does not match the exact wording or threshold, even when their experience fits the job. The Harvard Business School and Accenture Hidden Workers report described employers' systems screening out capable people on narrow criteria. Reading a sample of rejected applications by hand is the simplest way to check.

How does AI screening inside an ATS work?

The system parses each resume into fields, compares them with the job description or a profile of past hires, and produces a match score or rank. Recruiters often see only the top of that list. In some places, such as New York City, this kind of feature may need a bias audit and candidate notice before use.

Is an ATS the same as a recruiting CRM?

No. An ATS manages people who have applied to open roles. A recruiting CRM manages relationships with potential candidates who have not applied yet, such as past finalists or people met at events. Many vendors sell both in one product, but the jobs differ: one runs the pipeline, the other builds it.

Sources

  1. Hidden Workers: Untapped Talent, Harvard Business School, 2021
  2. Automated Employment Decision Tools (AEDT), NYC Department of Consumer and Worker Protection, current text