Andrej is currently Senior Director of AI at Tesla, and was formerly a Research Scientist at OpenAI. His educational materials about deep learning remain among the most popular.
Software 1.0 consists of explicit instructions to the computer written by a programmer.
Software 2.0 can be written in much more abstract, human unfriendly language, such as the weights of a neural network.
In software 2.0, we restrict the search to a continuous subset of the program space where the search process can be made efficient with back-propagation and stochastic gradient descent.