Neural Networks and Deep Learning
Using neural nets to recognize handwritten digits
How the backpropagation algorithm works
Improving the way neural networks learn
A visual proof that neural nets can compute any function
Why are deep neural networks hard to train?
Appendix: Is there a simple algorithm for intelligence?
A big thankyou to all the supporters whose contributions have made this work possible. Supporters include:
| Anonymous | Ivan Adanja | Kartik Agaram |
| Gui Ambros | Brent J. Anderson | Bennett Andrews |
| Philip H. Austin | Kyrylo Azhytskyi | Darius Bacon |
| Miëtek Bak | Thomas W. Ballinger | Pascal Belloncle |
| Nelson Batalha | Richard Baxter | Maxim Baz |
| Philippe Beaudoin | Marco Beri | Ariel Berwaldt |
| John Biesnecker | Mark Bloore | Paul Bloore |
| Aaron Paul Blossom | David Bonner | Leila Boujnane |
| Charles Brauer | Harrison Brown | Simon D. Burton |
| Nathan Campbell | Maria Del Carmen Anyo | Trey Causey |
| Alex Chamberlain | John Chaussard | Nikolay Chenkov |
| John Chia | Cheng kong Chit | Matias Varnum Christensen |
| Aaron Clauset | Dominic Cooney | Sidney Cox |
| Dominic Cummings | Paulo Darocha | Christopher Dawson |
| George Dean | Hendrik Demolder | Alexander v Dijk |
| Weiguang (Gavin) Ding | Amy Dodd | James K. Doherty |
| Michael J. Douglas | Daniel George Drumea | Pavel Dudrenov |
| Igor Dzreyev | Jeff Elmore | Mark England |
| Brian Eoff | Geoff Ericksson | Daniel Fernandes |
| Chris Ferrie | Ivo Flipse | Jelle Foks |
| Mardini Fouad | Rod Frey | Curtis Frye |
| Manoel Galdino | Senthil Gandhi | Inmar Givoni |
| Jeffrey Gold | Vojimir Golem | Christopher Granade |
| Ilya Grigorik | Steven Grimm | Joel Grus |
| Miki Habryn | Ward M. Haggard | Russell Hanson |
| Kathryne Hawthorne | Frank Hecker | Pablo Loyola Heufemann |
| Jens Christian Hillerup | Isaac A. Hodes | J. Paul Hoest |
| Jordan Holcombe | Juan Rodriguez Hortala | Steve Houghton |
| Tommi Hovi | Jeremy Howard | Tatsuya Ishihara |
| Paweł Jacewicz | Amit Jain | Damian Jordan |
| Victor Joukov | Guilherme Juraszek | Erkin Kanlioglu |
| Bart Kastermans | Jason Kelly | Alasdair K. King |
| SGJ Kockelkoren | Douglas Kratky | Charles Krempeaux |
| Dragisa Krsmanovic | Jason Kyle | Samuel Lampa |
| Michael Lachanski | Alex Lang | Ethan Langevin |
| Elmar Langholz | Christian Langreiter | Eugene Lazutkin |
| Jimmy Lee | Matthew Leifer | Daniel Lemire |
| Fuzz Leonard | Anselm Levskaya | Joseph Lewis |
| Jian Liang | Greg Linden | Chris Lintott |
| Baiyang Liu | James Lloyd | Tobias Lohse |
| Damien Loïc | Sergey Lymar | Gholson J. Lyon |
| James McCoy | Brent McWatters | Jean Maillard |
| Benoit Maison | Vito Mandorino | Stephen Marney |
| Maurice Mauser | Spyridon Michalakis | Florian Minges |
| Melanie Mitchell | Takashi Miyazaki | Nathan Mosher |
| Mike Murray | Aditiyaa Nagarajan | Sandeep Nayak |
| Alexandru Nedel | Eric Amir Nichols | Ken Nickerson |
| Kate Nielsen | Wendy Nielsen | Michael Noll-Hussong |
| Antonio Macias Ojeda | Nicholas O'Neill | Tom Parslow |
| Joan Puigcerver i Perez | Juan Carlos Kuri Pinto | Uffe V. Poulsen |
| Brian Du Preez | Sujith Radhakrishna | Hannu Rajaniemi |
| Rahul Ravu | Julien Rebetez | Dave Revell |
| Brendan Rogers | Konstantin Root | Peter Rudenko |
| Cody Russell | Michael Russo | Ross Ryder |
| Arthur Safira | Josep Saldaña | Christopher Sammon |
| Andrés G. Saravia | Kathryn Schmitt | Maximilian Schoefmann |
| Tim Schröder | John D. Schulman | David Schwab |
| Jan Sedlák | Satish Shankar | Gareth Shepherd |
| Makimoto Shimpei | Ekaterina Shmeleva | Keith Siilats |
| Christopher Silvia | Leif-Gerrit Singer | Harkanwal Singh |
| Rajob K. Singh | John Skarha | Arfon Smith |
| Mark Smith | Ezekiel Smithburg | Xavier Snelgrove |
| Robert Solovay | Matthew Sottile | Chris Squibb |
| Helge Stahlmann | Jan Stette | John Stockton |
| Wim Stubbe | Timo Sulg | Dave Sullivan |
| Daniel Suo | James Tauber | Oskar Thorén |
| Ben Toner | Luke Toop | Christian Tschanz |
| Peter Tutelaers | Matthew Trentacoste | Alexander van Dijk |
| Gregg Vesonder | Ricardo Vidal | Wai Keen Vong |
| Will Walmsley | Georg Walther | Matt Wells |
| Karijn Wessing | Ryan Whitnah | Nick Williamson |
| Brett Witty | Charles Wooters | Yusuke Yambe |
| Artem Yankov | Doron Yotam | Benjamin Sichit Yu |
| Zolmeister |
