AGI/ASI Research 20250813: Computational Demonstration

 Computational Demonstration


Using Python with PyTorch, I simulated a 30-layer sigmoid network (vanishing due to sig' <0.25) and a 40-layer linear chain with factor 1.2 (exploding). 

Formula for Zero stabilization floors/caps the gradient products.

For Vanishing (early layers small):


Standard: [4.17e-20, 1.67e-19, ..., 0.22] (vanishes to near-zero).

FFZ: [0.001, 0.001, ..., 0.22] (floored at ε=0.001).


For Exploding (early layers large):


Standard: [1469.77, 1224.81, ..., 1.20] (explodes >1000).

FFZ: [1000.00, 1000.00, ..., 1.20] (capped at 1/ε=1000).


This shows FFZ preventing breakdowns, enabling training in deep nets.


Comments

Post a Comment

Popular posts from this blog

Mathematical Emotions: Ambivalence

Notebook LM talks about this blog.  20250718 "Partly happy because it is the same as it ever was, and partly sad because it is the same as it ever was." Notebook LM talks about this blog. An intriguing phrase. A mathematical model? How would you? WHY would you?  Curiosity:  Binary State Model Define two emotional states:  H : Happiness, triggered by “it is the same as it ever was.”  S : Sadness, triggered by the same phrase.  Let X be the state of the world (“it is the same as it ever was”).  Then: P ( H | X ) > 0 P ( S | X ) > 0  The probability of being happy or sad, given the state X, are both nonzero.  In short: Modeled mathematically, this phrase is a beautiful example of how the same input can yield multiple, even contradictory, outputs—a concept that appears in probability, logic, psychology, and philosophy.  "Ambivalence" is most commonly used in psychology and everyday language to describe mixed feelings, the mathematical ...
Read more

Corporate Stereotype Standard Operating Procedure Log 20250911 10:00AM

Image
 Corporate Stereotype SOP Log 20250911 10:00AM  I am collaborating with Gemini AI to build AI agents that collaborate with each other to build synthetic version of Gemini AI and myself that collaborate to build AI agents that collaborate with each other to build synthetic versions of Gemini AI and myself that collaborate to build AI agents that collaborate with each other...This application deserves some love. 
Read more

Corporate Stereotype Prompts

Getting started using AI can be a challenge. I recommend starting with this prompt.  "I am trying to wordsmith in the vernacular that expresses the language of a PICK A SUBJECT/ANY SUBJECT using a vivid vocabulary of multidimensional contextualized isomorphisms." The phase is translated into the 13 most used languages in the world, based on the total number of speakers. The complexity and idiomatic nature of the English phrase present a significant challenge for translation, and the nuance, particularly of a term like "vernacular," may not be perfectly captured in each language.  The phrase for translation is: 13. English (as the baseline) "I am trying to wordsmith in the vernacular that expresses the language of a PICK A SUBJECT/ANY SUBJECT using a vivid vocabulary of multidimensional contextualized isomorphisms."  Here are the translations into the top 13 most spoken languages:  1. Mandarin Chinese 我正用一种能表达任何主言的白文行文字作够试图题语话进创，同使用多情境化同构的生时维动词汇。 (Wǒ zhèng ...
Read more