• 0 Posts
  • 157 Comments
Joined 3 years ago
cake
Cake day: June 30th, 2023

help-circle

  • What an entitled and dumb twat. I guess he didn’t think it through that the guy maintaining it now doesn’t have some magical ability to tell who would be a good new owner and “handing over the mainline” to any one person could screw people more than any AI changes because that new person might be malicious or neglectful.

    Forks need to earn trust and it’s best that that step isn’t skipped by some inheritance. Not that there even is any obligation to hand it off no matter how many people rely on it or complain.

    And the comparison with ms or Google was dumb because I didn’t expect them to do it the way I wanted and stopped using what I could to get away from where they were going and any expectation that they hand over their projects to someone else would be ridiculous (and Google open source projects have been forked).



  • Or just do it like reddit did, where you can delete your post content and remove your username from it, but the thread and comments remain.

    Though with how the fediverse works, it’s possible to spin up a custom instance that highlights deleted content instead of deleting it, meaning the attempt to get rid of it can be what brings it more attention if anyone has decided to do it. Just like with vote identities, they aren’t anonymous and there are instances/sites that just show who voted for what.



  • Yeah, while I can agree that plastic straws weren’t the worst offender for gestures around, I still think reducing that plastic use was a good thing and have noticed it takes more than hours for a paper straw to lose structure, though even then it doesn’t stop being a straw unless you bend it.

    Though I think the claims that they are also filled with plastics are plausible. I use metal straws at home but maybe it’s time to start carrying some in the car for use with takeout.





  • You can train it on all the source code, meta data for that source code, and documentation you want but it will never understand programming. It’s a text predictor that was trained on both sides of a bunch of debates. Contradictions mean nothing to it, but it usually only predicts what one side of the debate will say to champion its side, which means it will use confident and absolute language to “sell” whatever side of the debate it looks like the previous tokens are headed towards.

    It is impressive what it can output sometimes and it makes a decent debate/exploration partner, but it will always have a chance at predicting a useless series of tokens or contradicting the previous thing it just said because a) its training data only trains it to predict tokens from statistics, and b) its training data includes some of those contradictions directly.

    I have lost count of the times I’ve been “thinking out loud” about something with an LLM and realize something about what I’m thinking about that contradicts what it is currently saying, then I’ll add my new perspective and it agrees entirely, despite the contradiction. Sometimes it tries to resolve the contradiction, sometimes it just abandons what it said previously entirely, sometimes it adds more to the perspective that I hadn’t considered.

    That’s fine for just shooting the shit about some random topic but horrible for a tool intended to provide expertise and reliability, when the response matters because it feeds into something else and you want to automate it. Should a tool just inject “are you sure?” after each response? What if it makes it second guess something that was correct? What if it’s one of those debates and it will endlessly switch sides when it faces any opposition? That’s a waste of resources and time.

    Funny thing is I’m expecting this to eventually go back to scripting for automation. An LLM has a higher chance of outputting a script that does what you want (depending on the task) while you hold its hand than it does of consistently giving the correct output when it is thrown into an automated system directly. But you get “goodish” results much quicker just trying putting the LLMs everywhere, even if there’s some selection bias on the results (“didn’t work, didn’t work, oh it worked, great!”).


  • For someone fluent in all involved languages, sure.

    But from the sounds of it, OP’s company outsources the translation but doesn’t fully trust the output they get back. They’re back to square one for verifying it, because if they knew both languages enough to verify, they could do the translations themselves.

    The problem AI is trying to solve is “how do I access a skill I don’t have cheaply?” It’s only because it’s bad at that problem that it has shifted to “how can we use AI to get more production out of the skilled workers we still need to babysit the AI that is unreliable at everything?”


  • It’s kinda like the push to return to office. It was driven by corps having invested in the “can’t fail (ignoring the last previous crash)” real estate market and buying their offices. If everyone suddenly works from home instead of in the office, then those investments go bad because demand for office space is way down. So they tell people to go back to the office, hoping to return to that “every business needs offices!” status quo and save their investments. Though the demand is false (especially combined with layoffs), so it won’t necessarily cause any new corp to want that office space. If they don’t have the sunk cost, then they don’t need to accept the rest of the fallacy.

    With AI, it’s the same but just replace building investment with R&D as well as data centre investment. A lot of the companies really pushing AI are the ones that will profit from people going along with that. They really want to build a dependence amongst users as well as a good reputation for execs so they can get a return on the investment. Then there’s also the True Believers (who think LLMs are brilliant AIs that can solve anything if given the right prompts) and the FOMOs (who don’t know much about it but see the world moving towards it and don’t want to miss it because if it was a real AI, missing it could be a massive mistake). There’s also some people who just don’t have various skills and want the AI agents to fill those gaps (and probably don’t have a very good idea about what the LLMs are actually doing in those gaps).

    At this point, I think it’s a mistake to go all in on this tech. LLMs aren’t reliable, and their ability to “perform” is more about their flexibility than being well-suited for any task. They’ll go directly from saying things that seem “insightful” (they have no insight) to making the dumbest “mistake” (a mistake requires intent, which they lack, they just predict tokens). But there’s all kinds of false and true (albeit misguided IMO) demand right now and it’s still in early pricing mode (remember the intent is to make that investment money back).

    Oh and there’s also China which has been making more efficient models and open sourcing some of them. If they continue to do this, there’s a decent chance those investments will never give the desired returns, at least not to those who are trying to sell tokens. Or those who depend on those selling tokens, like any hardware companies selling hardware under the assumption that it will then make the money to pay for itself (which I believe both nVidia and AMD have done).

    It’s mirroring the dotcom bubble with that last bit because network cable companies started loaning the money to pay for their cables to ISPs, expecting returns that never came.




  • And AI is going to put that into overdrive.

    For a little while, I helped with some intern and recent grad interviews and holy shit some people didn’t have a clue. Had one guy on a remote interview that had a friend there helping him answer questions. It was obvious because he didn’t even mute his mic and we could hear them. And it was extra pathetic because his friend wasn’t even feeding him anything useful, like Bevis was helping Butthead with a software engineering interview.

    We had a short break and when we resumed, he had at least figured out to mute his mic between questions (not that that helped, as muting yourself frequently when you’re one of the main speakers in the meeting alone is a red flag without some reason that should be obvious when it isn’t muted). Only resumed because I was fairly new to interviewing, if I got one of those today (and still did interviews), I would have ended it early.


  • Try making a game. I think minesweeper might be a good one because it can be broken down into many different problems with different complexities. Like user input could start out as entering coordinates into specific cells to interact with a seperate grid, then you could switch to using an input grid where you enter a value into the cell you want, and then move on to clicking on cells like in the real minesweeper, including different behaviours for left, right, and both clicks.

    Pretty sure you could implement a full version of minesweeper in excel, though even if you can’t get all the way, there should be enough low hanging fruit you can reach to learn a lot from the process.

    Or if you’re feeling really ambitious, I think a realistic physics racing simulator is also possible, though I wouldn’t expect a lot on the graphics side of such a thing. Just lots of formulas that then get used to simulate a car accelerating, braking, and turning. But this one might also be great to get started with because you can start with a simple model and add complexity from there.



  • Though, if you prefer, you can also move your hand to the mouse. With the scroll wheel and good hand-eye coordination, you can get pretty close to the speed of a true vim exper–haha jk, they finished converting the entire source file from python to rust using a specially crafted regex by the time your hand reached the mouse and implemented a matrix view by the time you scrolled to the line you wanted.

    And when you say that falling green symbols aren’t that impressive, they look at you in confusion for a moment before realizing what you meant and handing you a VR plug to show you what “matrix view” really means.