• 3 Posts
  • 110 Comments
Joined 3 years ago
cake
Cake day: June 24th, 2023

help-circle
  • How large is very large? Would it be something that jq can’t do? Is it purely string search or JSON-tree search?

    Generally you would want to get file size, split it into ranges which can be read as valid UTF-8. Feed each range into reader thread. Can be inefficient for HDDs because each thread will try to access random location on disk forcing needle to jump back and forth. Also you’ll need reread ranges at split point with some positive and negative offset in case desired content got split. Things are getting much more complicated if you want JSON-tree grep. Branches may get split from parent nodes across multiple ranges.








  • Yaml is dogshit format. If you need tree-like structure use json if you need list of props use toml or simple key value pairs. I fucking hate app properties in yaml.

    • can’t search shit
    • copy-paste doesn’t “just work” when you want to merge two files
    • your editor doesn’t show whitespaces and you messed up somewhere - valid but incorrect
    • messed up formatting your list of banned IPs/hosts/ports/users/subnets/commands - get pwned

    It should’ve never left the basement of crackhead who thought “let’s make schema-less format depend on number of invisible characters”.

    I’ll rather save my data in Copybook and record it on tape then use this Python-bastardized abomination










  • That’s if their API implementation itself is just bad and underlying DBs aren’t . If they or someone else with bad practices manages the DB you may be in worse situation than before. In general, to me, shared DB is bad because it is hard to not cut corners in such design and ensure that DB owner does not break contract for all consumers. This is basically why APIs created - to guarantee contracts and encapsulate change. But I digress. My point is that it will be your responsibility to ensure schema changes adopted to expected contract. If data is not normalized/structured, like say, it’s JSON then I would stay away.



    • I don’t use AI code autocomplete. It was giving me nonsense and interrupts my thought process when I write code. Standard non-AI autocomplete is much better. I tried to use chat to generate medium size logic (up to 100 lines). Mostly it does not work or refining prompt takes more time than writing code myself so I stopped using it for medium sized tasks. I use it for small tasks up to 20 lines where I need an example of how to use specific API. What it does well is generating test cases (not tests themselves). I once tried to summarize set of made up requirements (can elaborate if anyone interested in), it instantly gave me idea of how far we are from AGI as it failed miserably.
    • I do not consider for my usage since I use it maybe once-twice a week on average. But generally, I think it’s a huge waste of resources, not only natural but financial and human
    • Claude 4 sonnet at work. Mistral for personal curiosity episodes
    • I already covered work part. For personal, mostly “searching” random info I couldn’t find via DDG or offloading social rituals such as congratulations

  • Lysergid@lemmy.mltoProgrammer Humor@programming.devduh-dum.
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    6 months ago

    Infrastructure is there to be used by apps/services. It doesn’t matter how it’s created if infrastructure across providers does not provide same API. You can’t use GCP storage SDK to call AWS s3. Even if API would be same, nothing guarantees consistent behavior. Just like JPA provides API but implementations and DBs behavior are inconsistent