Shrinking You to Teach You