HQ COURSES STORE NEW POSTS ABOUT

Comments

  • deTERMINATOR: Confidence Level vs. Score Problem
    Hey Dave !!!
    Your website emailed me as soon as you replied, pretty cool.

    In the Attention idea of LLMs, they update the matrix continuously so that the words are not allowed to focus too much on themselves. Like you said, that is language, not handicapping. I was wondering if you used a procedure that continually evolved to rate the genetic evolutions of your "ants" then they would not be able to game the rules. They would learn the previous generation of rules and then be judged by the current. Perhaps this would get the better ones to not worry too much about the rules, but instead try to improve the outcome so that no matter what the rules for "SUCCEED & BREED vs. FAIL & DIE." get updated to, they are consistently turning out successful iterations and labeling the confidence as accurately as possible.

    I would love to have lunch again. Red Bloom it is if you like that one. I had their beef dish and it was very good. Their veggie dishes were good when we tried those as well.

    I am proud of you and the hard work you have put into yourself getting healthy. These last two years have been the sickest of my life. In 2024, I got that tumor that was spawning infections and had to be cut out. Last year seemed like nothing but recovery from the operation and the infections... they had me on two different doses of super powerful antibiotics, one was the lyme disease regimen and the other was the flesh eating bacteria regimen. I think they did a number on my body, killed off all the helpful bacteria. This last February, I got a bad head injury that I am just now getting over. It was hell for months, with the room spinning every time I got up or laid down. Anyways, I am trying hard to follow your good example and get my health together now, we shall see. You have about fifteen years on me if I remember right and you are definitely in better health, so that gives me a clear goal. With luck, when I catch you on years, I will also catch up to your good health :)

    Would love lunch. This week is bad, my car is in the shop. Maybe next week, the 25th is memorial day right? Maybe later that week if you can do that, otherwise the first week of June?

    It is always great talking to you, you have a truly unique insight into a lot of things. There are very few iconoclasts left in our society. Let me know, I am up for sushi, buffet, red bloom, deli, whatever you prefer...
  • deTERMINATOR: Confidence Level vs. Score Problem
    Also, and this is kind of a strange idea...

    Do you know the paper, Attention is all you need? Well the way they keep words from inflating themselves to the detriment of the whole, is they require each matrix row to sum to 1. Words are still typically more attuned to themselves than the rest of the words in the array/sentence, but they are attentive enough to the words around them that there is meaning. Have you tried a mathematical approach in that manner with your genetic style algorithms that are limiting their guesses to "game" the rules? I wonder if there is a linear algebraic solution to your issue.
  • deTERMINATOR: Confidence Level vs. Score Problem
    Hi Dave,
    This is my first post here, so hopefully it won't be too much.

    I take it you are using your own neural network in DET? I know you have experience with neural networks going back years, and when you started this project, there really weren't any open LLMs like we have today. I am no expert, but it seems like the neural nets in DeepSeek and Alibaba's Qwen are both pretty good and they have resources to train that you probably can't get without a billion dollar investment. Have you thought about using one of their models to check your DET? The new Qwen 3.6 29b is supposed to be really good. It is a dense model and it seems like what your are doing is more of a MoE, but then they do have Qwen 3.6 35b which is a MoE style logic under the hood.

    I remember talking to you over lunch at the Atlantis and I was very skeptical that AIs would improve quickly and you were totally right on that one. I did not see the release of DeepSeek coming at all. It really caught me by surprise. I figured that AIs would be a SaaS scam for years before anything really improved, but now with so many people running local AIs, things are moving at light speed. Kudos for you for making the jump. You really had vision.

    Hope you are doing well. Can't wait to see DET take the NHC. That will be a huge step. When someone working with an AI wins the big one and takes home the $800k+.