Thursday, September 21, 2017

Mathematicians discover bottle necked compression

Last month, a YouTube videoof a conference talk in Berlin, shared widely among artificial-intelligence researchers, offered a possible answer [of how deep learning works] . In the talk, Naftali Tishby, a computer scientist and neuroscientist from the Hebrew University of Jerusalem, presented evidence in support of a new theory explaining how deep learning works. Tishby argues that deep neural networks learn according to a procedure called the “information bottleneck,” which he and two collaborators first described in purely theoretical terms in 1999. The idea is that a network rids noisy input data of extraneous details as if by squeezing the information through a bottleneck, retaining only the features most relevant to general concepts. Striking new computer experiments by Tishby and his student Ravid Shwartz-Ziv reveal how this squeezing procedure happens during deep learning, at least in the cases they studied.
Golly gee whiz, sounds like my theory.  

They have discovered that an encoding graph must be optimally queued.  They end up doing two color matches like the one I describe on the right link in this blog.  So, great, the basket theory of economics is now the basis of artificial intelligence.  Hence, there should be no doubt that we intend to auto trade the cash layer,  bankers have been warned. And, to reinforce, this means singularity 1.0.

 The biggest technology change in our history, well forecast, well planned.  I see the language of flow matching appearing more often in the discussion and research; dynamics of stock and flow, and sparse spectral responses (quantization). Queuing, the queue size has variance, the bet spread.

So, I should expect the change over to go smoothe,   central banker seeing that they are still very dominant.  Researchers at large banks must have gotten wind of the model, crypto coin exchanges understand ot, and I know a few large banks are getting the concept of using MS Coco*  to build lateral clearing systems.  .  Trezor** and the hardware wallet folks know, as does Intel***, all get the secure element concept.

* Send me a check
** You too
*** Triple that

No comments: