Author Archives: admin

Nonlinear Recurrent Connections

Unusually for me, I’ve usually agreed with the choice of linear circuits; especially when applied to practical stuff.  Noise, chaotic behavior, phase distortion  – there’s a long list of reasons guiding designers away from a nonlinear approach in many diverse domains.  But I could never relate … Continue reading

Posted in Nonlinear recurrence | Comments Off on Nonlinear Recurrent Connections

Ensembles and Architectures

I recall an epiphany about neural networks I had years back while developing a new system: ensembles of neural networks with highly dissimilar training paradigms can be superior, sometimes vastly so, in learning a set of training data when compared to … Continue reading

Posted in Gleaning Insight, Nonlinear recurrence, Self Organization | Comments Off on Ensembles and Architectures

Algorithms, Data Structures and AI

I recently had an interesting discussion about the enduring classic Gödel, Escher and Bach: An Eternal Gold Braid (GEB) by Douglas Hofstadter. The book is so famous and influential that High School classes have been modeled after it; it won the Pulitzer … Continue reading

Posted in Cool Speculations, GEB, Self Organization | Comments Off on Algorithms, Data Structures and AI

In Awe of the Cerebellum

A lot of the cool books and papers on AI I’ve read have focused on the role of the hippocampus and neocortex in human cognition. This seems right since the hippocampus is key in initial short term memory formation and the neocortex … Continue reading

Posted in Cerebellum | Comments Off on In Awe of the Cerebellum

Following The Trail To AI

Many AI start-up stories I recall can trace their history through well known phases: the initial hype and formation phase sometimes leveraging a thesis, book or even a simple Power Point presentation based on a new heuristic in hopes of … Continue reading

Posted in Why I'm Blogging | Comments Off on Following The Trail To AI

Self Organization

To me, AI self organization is a kind of spontaneous order that appears to emerge from random networks of simple neurons. Capturing this magic is a primary aim of AI these days and progress, although plagued with periods of stops … Continue reading

Posted in Self Organization | Comments Off on Self Organization

Speculations on Permutations

I’ve read estimates that each neuron in the neocortex connects to many thousands of other neurons and in total there are over 100 billion neurons in the brain. This alone is an interesting and revealing statistic about the capacity of … Continue reading

Posted in Cool Speculations | Comments Off on Speculations on Permutations

Embedded, Self Organizing Systems

A few years back, after many years developing embedded, real-time systems, I turned my attention to AI systems of the day to explore opportunities for embedding them into new products. Fuzzy Logic was in vogue at the time along with … Continue reading

Posted in Why I'm Blogging | Comments Off on Embedded, Self Organizing Systems