Structure Is Your Friend