Tesco
A New Model and Dataset for Long-Range Memory
Article

A New Model and Dataset for Long-Range Memory

Jack Rae and Timothy Lillicrap
DeepMind, 2020
Read the article

Read or listen offline

  • 0.5×
  • 0.75×
  • 1×
  • 1.25×
  • 1.5×
  • 1.75×
1×

Editorial Rating

9

Qualities

  • Analytical
  • Scientific
  • Hot Topic

Recommendation

One of the challenges for AI systems is that, as they become more sophisticated and swallow up larger and larger databases, they need ever more processing power to achieve marginally better results. Even the biggest server farms have their limits. Yet people don’t want to wait for more than a few microseconds, so a major task in AI science is to determine how to reduce mountains of crude data to hills of important data. Google’s DeepMind project’s latest proposal is to use sleep as an inspiration for data processing. Your Eureka moment might have come one afternoon during a power nap.

Take-Aways

  • A major problem in AI is reducing extremely large datasets into more manageable dimensions for processing and analysis.
  • Human memory exists at different timescales and different levels of detail.
  • AI methodologies must incorporate this same mechanism to usefully process inputs and develop reasoning over longer time periods.

About the Authors

Jack Rae and Timothy Lillicrap are staff researchers at Google’s DeepMind project in London.

Comment on this summary or Diskussion beginnen