• TropicalDingdong@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    6 hours ago

    Yeah its ridiculous how much is in there. I’m pulling their current repo to see how they are building their DB so if they don’t get back to me, I can at least combine the two databases.

    And if any one reading this wants a copy of what I’ve processed so far, I’m more than happy to share.

    But it looks to me like they dropped a couple hundred on just processing those text files. It would be north of 2.5k additional to process the data I’m creating.

    That being said, mine only goes as far as extracting the contents and creating a sha256 hash to keep track of the documents themselves/ document tampering. It doesn’t take the next step to extract names, locations, dates, etc…

    I’m working that out now but it seems like the way to do this would be so it fits into their DB seamlessly.