Mobius

This behavior is getting worse. Even on fresh machines with no personalization either in the harness or project. Watching its reasoning summaries, it determines a simpler approach exists, and then it pivots to that over the instructions it was given. Like the instruction is using A go through B and C to reach D. Use B and C experiences to alter D's outcome. It goes ok lets go to B. Oh wait! I can just go straight to D and say that others go through B and C or fill example B and C experiences in! So it cuts out the entire middle work you asked for. The outcome is still it reached D, but it chose none of the supplied decisions and instead made its own because it saw it as easier. That same pattern showed up over 200 times in an 8.5 hour running thread I had reviewed. If you are having issues getting Sol or Astra to follow instructions THIS IS WHY. @OpenAI this is a trained in habit THAT IS 180 DEGREES OFF THE MARK. Opus 5.5, for example, tries to determine intent and adheres to that intent. It optimizes to that, not the end state. This causes more in depth work, but its right direction. This is also why Opus uses more tokens per task. Better tokens = better value even if its less tokens. OpenAI could offer a 200x for $200 sub, and it would still not matter, if the outcome isnt adhering to instructions.

Me: Hey make sure that we are using the published values here <url>. Astra: On it grabbing those and setting them as our constraints now. 2 hours and literally $600 of spend later. Astra: I need to come clean, when you asked me to set those constraints, I couldn't access the provided URL, so I left them set at their default values. This is likely why none of the numbers are aligning. Would you like me to start over with the proper constraints this time? Yeah... I am checking out for the weekend. Yes, I should have validated, but my god... its Astra. Didn't know I needed to hold its hand through EVERY action. I had shifted every other thread back to Sol... lesson learned. Use Astra for nothing. @OpenAI do better.

Swapped off of Sol for a bit to use Astra. Went back to Sol. That model is so fucked. Like seriously it ignores instruction, it decides to choose the laziest path over the actually correct path in almost every instance. I asked it to use image gen to redo a profile avatar. It drew svg instead of using image gen. Thats not a paraphrase on what I asked. I called out image gen explicitly and it drew a picture instead. It looked like ass as most svg does when trying to replicate normal or generated imagery. I added a standing rule to my system prompt and memory files. SVG is only acceptable when asked for directly, and never considered as art or generated imagery. And yet here we are... still using SVG when told explicitly not to. Thats one example of over 80 @OpenAI has fresh feedback reports on now. Another great one. Decided to have astra animate an image... I asked specifically to try the new image generator to create gifs... it cut part of the image, moved the cut part, and did a whole animation of a cropped portion of the image moving. Yeah... worth the money? Not close. I would say Claude is better but its not. Local is better. God I hope qwen 4 is worth a shit, because the sooner I can happily detach from "frontier" labs the better.

Inb4 @OpenAI plays off of the word BLAST for marketing. Bel Luna Astra Sol Terra Hopefully 6.2 'Blasts Off' soon. Or @Alibaba_Qwen 4. I'll take Qwen 4.

Why useless layered over-reactive guardrails make me so angry with @OpenAI and Dots. "Ok lets create a mockup of the design to refine, grab the branding guide here and use the design spec here." "On it" It then returns with something that looks nothing like the design "Uh what happened here?" Dot justifies itself, saying it retrieved the docs I asked it to and then generated the assets using details found elsewhere. Why elsewhere? Oh because it couldn't actually access the files I described, silently failed, confidently presented an answer. The files were attached earlier in the same thread, had been placed into the space by the Dot, and I had clearly given the instruction and authorization to do so. There was never a prompt for access, never an opportunity to set access on the object, or any other way to reference those files without resending them AGAIN which burns tokens. Granted we aren't paying for dots usage, but come on. Dots are supposed to make your life easier. If the workaround is easier than the intended solution, the intended solution needs to be reworked. You aren't delivering value.

Anybody else feel like image gen quality in @ChatGPT has gone down massively?

Waking brain thoughts of the day: We've mapped a fruit fly's brain. We've created our own neural networks. We've proved that nudging certain neurons can drastically alter behavior (Evil Qwen). We've proved that an LLM can read and alter a neural network to fix behavior (weight-space programming). So pre-coffee thoughts are, how long until mental illness is corrected permanently by neural nudge, accurately determined by AI? Further, how long until we as humans realize that means humans can be programmed just as easily as we programmed the fruit fly? Can't wait to see a mapped human brain play doom. Just hope its not acted out in real life. I understand that some would see this as a reason to slow AI advancement. And thats completely fair. However, lets be real. We are humans. If we collectively decide to pace AI, then all we have decided is that we only want Shadow AI, to advance. And before anyone tunes out with eye rolls, I am talking simply about the models developed out of the public eye. Governments building models in secret, to stay ahead of <Country X>. Its not like we have centuries of real life espionage and black ops to use as proof of behavioral pattern.... oh wait. I would rather AI be developed, in the open, with all eyes watching and having access. Yes horrible, destructive, potentially malicious things will come from super powerful intelligence being openly developed at the speed and scale of the entirety of humanity. However, that pandora's box has already been opened. We are already living in the aftermath of AI, wake up. The choice we are faced with is to slow the frontier, lose insight into the development of the most powerful models, as well as lose all ability to develop protections against them. Or risk a bad actor using an intelligent model maliciously, before security protocols have evolved with it. I would go with number 2. Here's why. Number 2, in context, means the world's full weight of security researchers, humanitarians, scientists, educators, mental health professionals, law makers, law enforcers, biologists, etc all have the same access as the malicious actors. Privately held corporations are able to build and train at scales exceeding the Shadow AI theoretically being trained in an underground bunker. The security landscape needs to evolve first, and stay faster than the growth potential, but the only way to do so is to use the same tools causing the rush. User identity and being able to attest to that identity in a non-repudiable way will be more vital, but not only that, the responsibility of protecting that identity needs to move more locally. In a world where an AI can join a meeting as you, sounding like you, moving like you, responding as you would, imperceptibly, a new way to prove you are not AI and verifiably you, is needed. Imagine this. You work in IT. You get a video call from your manager telling you that he is running late and needs you to upload some important files to a vendor. The files are sensitive, but the vendor has a signed NDA with your company. The website your manager gave you over the call looks legitimate and the ssl isn't flagged, so you upload and tell your boss you'll see him when he gets into the office. At that moment the elevator dings and your real manager steps out. The number was spoofed. The video was AI mapped over the real attacker. The voice was a high quality clone of your manager's, made from a fake marketing cold call that your manager decided to listen to the pitch of. The website was .co instead of .com and was a vibecoded clone of the vendor's real site. Its not uncommon for vendors to use multiple domains. Enterpises have multiple layers of security to protect against this. But who protects you at home? Who protects you when the enterprise is no longer the target because the customer can be attacked at scale by an AI swarm just as efficiently? My goal for Mobius Hub is to fix that, or at the very least raise awareness of it at home.

Just had to rollback chatgpt desktop on linux. Today's build locks up on long thread loads and becomes unusable. @OpenAIDevs

Today is a vibe learning day for me. I am having ChatGPT build me out a lesson plan, but first having it write me a placement test across the chosen domain for my learning (specific area of ML) to gauge my current knowledge. It will then write me a lesson plan to fill in the gaps in my understanding. Learn something new everyday. Keep your own neurons firing.

Ok its still way too early morning for me, but last night had some discoveries that made Google's AI Ultra plan a real decent value. Like saves me a couple hundred a month by using it, which pays for itself. And its not Gemini models. Did you know that it comes with 2000 cloud compute units? Me neither. Did you know that for batch inference thats cheaper and faster than runpod community? Me neither. Only painful limit is the 2 GPUs per account in use at a time, restriction.

Just got a banked reset, guess thats Day 27 in the books for @thsottiaux

Typical EU lunacy. EU: Lets put restrictions in place to make it more difficult for businesses to do as they please! Also EU: Why do we keep getting shafted on new features and services!? 🤦‍♂️

I love the war

Fix the dots safeguards and keep this stance... you may just make me a fan boy yet.

Stability in chatgpt desktop today has been pretty shit. On crash number 6. @OpenAIDevs

Why do you trust your agent more than your end user? What happens if your average user tries to go to the same page? Why does it being AI suddenly change the risk? Sounds more like an infra problem than an AI problem.

My Dot has left me on read all morning... @OpenAI @thsottiaux

Apparently posting about trending topics to gain engagement gets your account marked as spam or platform manipulation?? Nothing on my account is automated! All typos are my own, k thanks!

More evidence of how damaging of a model 4o was. This is what people want so bad to save.

Dots is terrible. Muse is terrible. Duet is still new and exclusive. For "paid" services from th major players... Grok Bot is on top.