Human-in-the-Loop Review

Classification matches patterns and isn’t always correct. Human-in-the-Loop Review lets you reject an inaccurate finding before it reaches the report, and before it reaches the tags and policies built from that report. It works by holding a classification job after it finishes scanning so you approve or reject each of its findings first.

Review also remembers what you decided. Confirming a report carries its decisions forward to later runs of the same classification — the same data source, collection, and classification method — so a recurring job asks you only about findings that are new since the last report you confirmed in review instead of re-presenting everything you already judged.

A finding is one classifier match on one column — the unit you approve or reject. Review is set per job and is off by default. It’s available for classification jobs on Snowflake, Databricks, and OLTP data sources.

How Human-in-the-Loop Review Works

A job with review enabled scans its data source the same way any other job does — the same collection and classifiers, the same classifier rules, and the same processing location. What changes is what happens when scanning ends.

Without review, a job generates its classification report and completes. With review, the job moves to Generating Findings while ALTR prepares its findings, then to Needs Review, where it waits for you. You open its findings, approve or reject each one, and then either confirm the report — generating it from the approved findings — or cancel it.

Filter the report list by the Needs Review status to find jobs waiting on a decision.

The Findings Tree

The findings tree follows the shape of your data: database, schema, table, column. Beneath a column matched by more than one classifier, each of that column’s findings appears as its own row. A column matched by a single classifier, and an individual finding, are leaves with nothing beneath them.

You can approve or reject at any level, not just on individual findings. A decision applies to everything beneath the row you make it on. Approving a schema, for example, approves the findings on every table in that schema.

Where a broader and a narrower decision overlap, the narrower one wins. If you approve a schema and then reject a single column’s finding inside it, the rejection stands for that finding while the approval still covers the rest of the schema. The same holds one level further down: on a column matched by several classifiers, a decision on one of its findings overrides a decision made on the column as a whole.

Clearing a decision returns that row to whatever the level above it decided, or to Pending if nothing above it has been decided.

Filtering Findings

Two filters narrow the tree while you work:

• Classifier — show findings only for the classifiers you select.
• Status — show only Approved, Rejected, or Pending findings.

Progress counts every finding in the job, not only the ones the filters currently show.

Caution

While a classifier filter is active, a decision you make on a database, schema, table, or column row applies only to the classifiers you have selected — not to that row’s other classifiers. Clear the filter first to decide a row for all of its classifiers at once.

Decisions on Later Jobs

Confirming a report carries its decisions forward to a later job that reclassifies the same data source with the same collection and the same classification method, and that also runs with review enabled. You review each finding once rather than re-deciding the whole data source every time. A later job you run without review generates its report directly and carries nothing forward.

A job that changes the collection or the method doesn’t inherit those decisions, because a different collection or method can match a different set of classifiers entirely. Its findings come to you undecided, and confirming its report carries your decisions forward to later jobs on that collection and method.

Findings that weren’t in the previous report are the exception: they stay Pending and carry a NEW badge, and the rows above them are badged too. A finding counts as new when that exact pairing of column and classifier wasn’t in the last report you confirmed in review — so a newly discovered column produces new findings, and so does a classifier matching a column you have already reviewed. A decision you made earlier never carries silently onto something ALTR hasn’t classified before.

Run a Job with Human-in-the-Loop Review

Running a job with Human-in-the-Loop Review means selecting one checkbox during the normal job configuration — nothing else about the configuration changes. Follow the full procedure in Data Classification, and on the same step as Processing Location, select the Needs Human Review checkbox. ALTR runs the job and sets its status to Needs Review once scanning finishes.

Review Findings

To review a job’s findings:

1. Select Data Classification > Classification Reports in the navigation menu.
2. Click a report whose status is Needs Review.
3. Approve or reject each finding, working at whichever level of the tree suits the decision. Click anywhere on a row with children to open or close it, except on its approve and reject controls, which act on the row instead.

To see why a finding matched, click its Match Confidence badge — on a finding row, or on a column matched by a single classifier. The Details panel opens with the Match Breakdown: the same per-classifier rule results described in Match Confidence.

A job that scanned successfully but matched nothing has no findings to decide, and you can confirm its report as it is.

Confirm or Cancel the Report

Confirming the report turns your decisions into the classification report, built from the approved findings and leaving the rejected ones out; canceling ends the job without a report. Neither can be undone: a confirmed report’s decisions can’t be edited, and a canceled job can’t be resumed, so to review the same data source again, run the job again.

Decisions save as you make them. Once every finding has a decision, Confirm Report becomes available; until then it stays disabled.

To confirm a report:

1. Decide every finding.
2. Click Confirm Report.
3. Review the summary — the data source, classification method, connection type, when it was last scanned, the classifiers in scope, and the resolved, approved, and rejected counts — and click Confirm Report to continue. Report generation runs in the background, and ALTR opens the report when it’s ready.

To cancel a report:

1. Click Cancel Report.
2. Click Cancel Report in the confirmation dialog.

Danger

Canceling discards the findings and every decision you made on them, and the job ends as Cancelled. This can’t be undone, and the job can’t be resumed — classify the data source again to produce a new report.