Model-Free Repositioning for Natural Views
Let sensor modules propose the agent's pose so that an object is viewed from a cleaner or more natural view.
Repositioning to obtain face-on views of planar surfaces.
When viewing an object's surface from a steeply oblique angle, sensor modules are given data that is effectively compressed along an axis. This means that features, such as the color or principal curvatures, are necessarily computed over a larger physical area, and this skew is often along only one physical axis. In other words, features can be view-dependent, which introduces extra difficulty when comparing observed features to features stored in learned models. Furthermore, viewing a surface from an oblique angle makes it more difficult to evenly saccade across the surface, thereby reducing the effective coverage of an object's faces.
This can be addressed by allowing sensor modules to propose agent poses. In particular, an SM may detect that it is viewing a surface from an oblique angle based on its observed surface normals. The SM can then propose a goal that would place the agent and sensor(s) such that they view the surface "face-on". Here, "face-on" means viewing directly down the surface normal.

Rotating the sensor/agent around the forward axis for consistent views.
If the model-free system can consistently view an object with the same apparent orientation (i.e., an orientation in retinotopic space), then in principle we should be able to seed fewer hypotheses during inference. In other words, we may be able to reduce the size of the hypothesis search space by leveraging a preference to view objects according to their physical characteristics (e.g., a focus of mass along a certain axis).
For intuition, consider how much more difficult it is to recognize a face when it isn't upright. Similarly, it's much more difficult to read a line of text when it is tilted at an angle. In both cases, we'll often subconsciously tilt our heads or rotate a page to get a more "natural" view.
Note that the above describes an entirely model-free system for obtaining a consistent view, and it may or may not match the object's typical appearance in the world (i.e., its canonical view).

Help Us Make This Page Better
All our docs are open-source. If something is wrong or unclear, submit a PR to fix it!
Updated about 2 hours ago

