# Phil 1.31.18

7:00 – 7:00 ASRC MKT

• The Matrix Calculus You Need For Deep Learning
• Most of us last saw calculus in school, but derivatives are a critical part of machine learning, particularly deep neural networks, which are trained by optimizing a loss function. Pick up a machine learning paper or the documentation of a library such as PyTorch and calculus comes screeching back into your life like distant relatives around the holidays. And it’s not just any old scalar calculus that pops up—you need differential matrix calculus, the shotgun wedding of linear algebra and multivariate calculus.
• Continuing BIC
• Explaining the evolution of any human behavior trait (say, a tendency to play C in Prisoner’s Dilemmas) raises three questions. The first is the behavior selection question: why did this trait, rather than some other, get selected by natural selection? Answering this involves giving details of the selection process, and saying what made the disposition confer fitness in the ecology in which selection took place. But now note that ‘When a behavior evolves, a proximate mechanism also must evolve that allows the organism to produce the target behavior. Ivy plants grow toward the light. This is a behavior, broadly construed. For phototropism to evolve, there must be some mechanism inside of ivy plants that causes them to grow in one direction rather than in another’ (Sober and Wilson 1998, pp. 199-200). This raises the second question, the production question: how is the behavior produced within the individual-what is the ‘proximate mechanism’? In the human case, the interest is often in a psychological mechanism: we ask what perceptual, affective and cognitive processes issue in the behavior. Finally, note that these processes must also have evolved, so an answer to the second question brings a third: why did this proximate mechanism evolve rather than some other that could have produced the same behavior? This is the mechanism selection question. (pg 95)
• These are good questions to answer, or at least address. Roughly, I thing my answers are
• Selection Question: The three phases are a very efficient way to exploit an environment
• Production Question: Neural coupling, as developed in physical swarms and moving on to cognitive clustering
• Mechanism Question: Oscillator frequency locking provides a natural foundation for  collective behavior. Dimension reduction is how axis are selected for matching.
• Value Orientations, Expectations and Voluntary Contributions in Public Goods
• Discussion with Aaron about JuryRoom design
• Observable is a better way to code.
• Discover insights faster and communicate more effectively with interactive notebooks for data analysis, visualization, and exploration.
• More Angular. Finished with module communication, starting with services
• Meeting with Wayne
• Submit to JASS
• Abstract to CI 2018 July 7-8, 2018 at the University of Zurich, Switzerland