Outline Check Round 2: Quick Guide
This is the last batch of frames for the project. Each RA checks 150 frames. Sophie will write the study up.
Deadline and pace
- Finish all 150 frames by the check-in on Friday, November 13, 2026, two weeks from the meeting.
- Time it takes: last round, a frame took about 1 minute 20 seconds. 150 frames is about 3 to 4 hours in total, so a few short sittings will do it.
- Keep pace with the team. There is no check-in next week. Sophie watches everyone's progress and will message you if you fall well behind the others.
First check on every frame: do the two pictures match?
Before you rate anything, compare the camera picture with the movie frame. They should show the same moment of the movie: the same scene, the same objects in the same places.
If they don't match, stop. Don't rate or fix the frame. Instead:
- Take a screenshot of the whole page.
- Click Can't tell from this picture.
- Send the screenshot to Sophie right away.
A mismatch usually means a timing problem in the pipeline. Sophie needs to fix it quickly, because it can affect other frames and other RAs.
What this is
The frames come from the eye-tracking videos. On each one, the computer has drawn an outline where it thinks the movie screen is. You rate how far off each corner is, and fix the outline when it is wrong.
Most frames this round come from the trials the computer finds hardest. Your fixes go straight back into the pipeline and repair those trials, so a careful fix is worth more than a fast one.
Getting started
- Connect to the IU network. Off campus, turn on the IU VPN first.
- Open http://hg-review.duckdns.org:8775/.
- Type your first and last name, the same name you used before. Your 150 frames load.
- Work in as many short sittings as you like. Each answer saves when you click Save, and you pick up where you left off.
The first 20 frames are the same for every RA. We use them to check that we all judge the same way, so take extra care on those.
When you finish a frame, save it, then move on or close the tab. A frame left open keeps counting time.
Each frame, step by step
- Check that the camera picture and the movie frame match (see the first check above). Then look at the blue outline on the camera picture. It should sit on the edges of the projected movie picture, not on the white screen around it or the screen's frame.
- Check all four edges, the bottom edge too. On a dark frame, click Brighten room first.
- Rate each corner, using the scale below. A corner outside the picture: imagine the screen's two sides running on into the dark margin until they meet, and judge that point.
- If all four corners are Fine, click All four corners are fine: save. You are done with this frame.
- If any corner is off, step 2 opens: fix the outline with one of the tools (next section), then click Save the fix and next.
- Only if you truly cannot see the screen's edges, even after brightening and trying landmarks, click Can't tell from this picture.
| Rating | Meaning | How far off, as a share of the screen's width |
|---|---|---|
| ✓ | Fine | On the corner, within about a line's width |
| 1 | Slightly off | Under 2% |
| 2 | Noticeably off | 2–5% |
| 3 | Clearly off | 5–15% |
| 4 | Badly off | Over 15% |
| 5 | Completely wrong | Nowhere near: another object, another corner, or far off the screen |
For a screen half as wide as the picture, 2% is about 20 pixels. In round 1, everyone rated about one step too low, so when in doubt, pick the higher number.
The tools
Pick the fix tool that suits the frame. The page opens on Match landmarks when a corner is outside the picture, and on Drag corners otherwise.
| Tool | Use it when | How |
|---|---|---|
| Drag corners | The outline is a little off | Drag each colored corner onto the real corner. A corner can go into the dark margin. |
| Click 4 corners | The outline is way off | Click the screen's four corners in any order, then drag any dot to fine-tune. |
| Match landmarks | Corners are hidden, or there is no outline | Click a spot in the camera picture, then the same spot in the movie frame on the left. Repeat. |
| Ghost (V) | Always, to check | Lays the movie over the picture through the current outline. If it lines up, the outline is right; a double image means it is off. |
| View: Brighten room, Picture edge | Dark or washed-out frames | Changes only how the picture looks, not your outline. B cycles through them. |
Match landmarks needs care. Four points always fit exactly, so they can hide a big mistake. The page asks for:
- at least 6 points, spread over the whole movie frame, near its edges where you can;
- still things only: signs, windows, road markings, building corners. Never people or cars, which move between frames;
- every point within 8 px of the others' fit. If one is flagged, re-click it or undo it;
- tight orange dots around each corner. They show how unsure the outline still is. Add points until they are close together; Save stays off until then.
The magnifier follows your mouse in the camera picture, so you can click exactly. Backspace undoes the last point.
Feedback from round 1
You did a good job last round. On most shared frames, everyone's outlines landed close together, and that is what we want again. Where RAs disagreed, it came down to these points:
- Find the real edge. Some RAs placed corners on a straight line near the picture, such as the screen's frame, instead of the edge of the projected movie. Use Brighten room or Picture edge to see the true boundary.
- Imagine hidden corners. When the top of the screen runs off the picture, extend its two sides into the dark margin until they meet. Never stop a corner at the edge of the picture. This caused the biggest disagreements.
- "Fine" means exactly on the corner. If you would rate a corner 1 or more, it is not fine: fix it. Calling small offsets fine was the most common split last time.
- Rate one step higher when unsure. Everyone rated about one step too low.
- Check before you save. After placing corners or landmarks, turn on the Ghost (V). The outline should never run far outside the projected picture.
The full round-1 results, with every RA's outlines on the shared frames, are on the round-1 results page (ask Sophie for the password).
If something looks wrong
- The camera picture and the movie frame don't match: follow the first check at the top of this guide (screenshot, Can't tell, send it to Sophie).
- The page won't load: check that you are on the IU network or the IU VPN.
- Anything else: ask Sophie in the RA or homography channel, where the link was posted.