Average

Can have a strong power.

• Wisdom of the crowd
• Aulchenko2009: averaging parents’ Height (by Francis Galton is more accurate than genome-based prediction.
• Wieting2015: “… simple compositional architectures based on updated vector averaging vastly outperform long short-term memory (LSTM) recurrent neural networks”