Efficient input to a neural network is often about finding a representation for the input that simplifies its transformation into a useful latent representation for efficient manipulation. This can be pretty subtle and often takes creativity and an intimate understanding of the nature of the thing that you are trying to represent and how it is used internally by the network.
