merari42@lemmy.world to Programmer Humor@programming.dev · 1 年前What Drove You to Madness?lemmy.worldimagemessage-square45fedilinkarrow-up1444arrow-down148
arrow-up1396arrow-down1imageWhat Drove You to Madness?lemmy.worldmerari42@lemmy.world to Programmer Humor@programming.dev · 1 年前message-square45fedilink
minus-squarewise_pancake@lemmy.calinkfedilinkarrow-up3·edit-21 年前Most recently: I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types. It’s truly an abomination. I’ve never had to use pythons AST module to parse data before…
minus-squarewise_pancake@lemmy.calinkfedilinkarrow-up2·edit-21 年前It was 900mb raw and compressed to 1.6mb after cleaning. That’s how much junk data there was. Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.
Most recently:
I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types.
It’s truly an abomination.
I’ve never had to use pythons AST module to parse data before…
🤮
It was 900mb raw and compressed to 1.6mb after cleaning.
That’s how much junk data there was.
Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.