Yeah, I don’t see how to transition from office rat to monster slayer or ninja

Scrappy created exactly for this use case. I used to work in project for product info scraping when LLMs didn’t exist. So you don’t really have to use LLM. It’s usually semi-structured data. Your biggest pain will likely be SPAs with JS which need to run in order to load content. If you need to render SPAs check Selenium web driver or similar

TF is this formatting

How large is very large? Would it be something that jq can’t do? Is it purely string search or JSON-tree search?

Generally you would want to get file size, split it into ranges which can be read as valid UTF-8. Feed each range into reader thread. Can be inefficient for HDDs because each thread will try to access random location on disk forcing needle to jump back and forth. Also you’ll need reread ranges at split point with some positive and negative offset in case desired content got split. Things are getting much more complicated if you want JSON-tree grep. Branches may get split from parent nodes across multiple ranges.

My networking knowledge is not good, so maybe it’s nonsense indeed. I just thought if everyone in the network knows what is blocked then DDoS protection could be distributed because every “reputable” switch/router in the network can block connection as early as possible without hopping close to destination creating unnecessary traffic

I’m wondering can DNS be extended to handle blacklisting. It already has some level of security resolving “C should have no control over A and B communication”.

svg is da way

Yaml is dogshit format. If you need tree-like structure use json if you need list of props use toml or simple key value pairs. I fucking hate app properties in yaml.

• can’t search shit
• copy-paste doesn’t “just work” when you want to merge two files
• your editor doesn’t show whitespaces and you messed up somewhere - valid but incorrect
• messed up formatting your list of banned IPs/hosts/ports/users/subnets/commands - get pwned

It should’ve never left the basement of crackhead who thought “let’s make schema-less format depend on number of invisible characters”.

I’ll rather save my data in Copybook and record it on tape then use this Python-bastardized abomination

I’m curious now. Can you describe “corrupted”? One char off? Non-ascii gibberish?

That’s if their API implementation itself is just bad and underlying DBs aren’t . If they or someone else with bad practices manages the DB you may be in worse situation than before. In general, to me, shared DB is bad because it is hard to not cut corners in such design and ensure that DB owner does not break contract for all consumers. This is basically why APIs created - to guarantee contracts and encapsulate change. But I digress. My point is that it will be your responsibility to ensure schema changes adopted to expected contract. If data is not normalized/structured, like say, it’s JSON then I would stay away.

Does API actually doing anything or it’s pass-through to data source? You could request data feed and build adequate API on your side

• I don’t use AI code autocomplete. It was giving me nonsense and interrupts my thought process when I write code. Standard non-AI autocomplete is much better. I tried to use chat to generate medium size logic (up to 100 lines). Mostly it does not work or refining prompt takes more time than writing code myself so I stopped using it for medium sized tasks. I use it for small tasks up to 20 lines where I need an example of how to use specific API. What it does well is generating test cases (not tests themselves). I once tried to summarize set of made up requirements (can elaborate if anyone interested in), it instantly gave me idea of how far we are from AGI as it failed miserably.
• I do not consider for my usage since I use it maybe once-twice a week on average. But generally, I think it’s a huge waste of resources, not only natural but financial and human
• Claude 4 sonnet at work. Mistral for personal curiosity episodes
• I already covered work part. For personal, mostly “searching” random info I couldn’t find via DDG or offloading social rituals such as congratulations

Infrastructure is there to be used by apps/services. It doesn’t matter how it’s created if infrastructure across providers does not provide same API. You can’t use GCP storage SDK to call AWS s3. Even if API would be same, nothing guarantees consistent behavior. Just like JPA provides API but implementations and DBs behavior are inconsistent

I have experience with paid code review AI. It’s mostly bad. It did catch few bugs throughout the course of the project but I wasted much more time on useless or sometimes straight up wrong suggestions. I also think static code analysis gives more value

I recently started setting up home server on Raspberry Pi 5. Having issues with raid1. I have 2 nvme PCIe gen 4 SSDs. There was power outages while writing. Now second disk keeps randomly falling. Though, I’m not sure if that’s the reason because I don’t know what was raid status before outage, also disk passes checks. First time it degraded, it tried to recover and it failed. I removed that disk from raid, recreated partition run some test using nvme-cli. Disk looked healthy. I re-added disk, rebuild started and completed successfully. Then I’ve written around 500Gbs of data and it degraded again. At that point I took a break.

There are two things I’m yet to try:

1. Change configs to use gen 2 PCI, currently it’s set to gen 3, but AFAIK pi 5 does not support gen 3 officially.
2. Remove, format and write data to problematic disk directly. I hope this will give me an idea is this hardware issue or software issue

I’m frustrated and will appreciate any hints.

Idk which market you are in. In mine no one cares about your project. Most of companies don’t do innovation. Most of real life projects I saw just moves data around. When I interview people all I care about is knowledge of tech stack and what I call “analytical thinking”.

Omg this is so true, I had 3 engineers which supposed to work on component. It took me almost a day to explain context, requirements and how work is split. Two of them were busy with other work. One did their part. After reviewing I realized they still lack understanding and need to rework what was done.I made an experiment and implemented whole thing myself. Since coordination part was eliminated it took me 3 times less than initially estimated.

Don’t get me wrong, I’d always choose html over js if I could. My problem with css, and web in general, that it’s too fragmented. It’s like those people who are designing css, html, js and browsers didn’t speak to each other whatsoever. So now there is entire industry of js frameworks to glue all shit together. Like, look at the WebComponents. Which supposed to be native, out of the box replacement. So much effort and they still cannot compete, in some cases they simply do not provide basic features needed to build complex UIs. Next time I can choose stack I’ll probably just go with htmx

Don’t know about tailwind but I used styled-components and not going back to vanilla css. CSS seems to be designed to be used with HTML, which did make sense back when it was created. Modern web is 99% JS and components composition which does not work well with Vanilla CSS in terms of class name uniqueness, specificity. Also it easy to dumb shit with CSS, like, I worked in the project where we had a lot of legacy global CSS. We had like dozen CSS styles which were adding margin to <label/>, <p> and so on. I mean no classes, just globally. I’ve been forced to add ‘all: unset’ to basically all my new components just to avoid changing global styles and breaking something else. Do not recommend.

Explosion?