I'm using the xml dumps for the latest enwiki and ruwiki and i'm not sure it's fully extracting the articles. my enwiki text goes to GY and my ruwiki text goes to AI, they decompress to 100gb and 30gb respectively and my wikiextractor text output is only 18gb and 8gb respectively. Is this correct?
I'm using the xml dumps for the latest enwiki and ruwiki and i'm not sure it's fully extracting the articles. my enwiki text goes to GY and my ruwiki text goes to AI, they decompress to 100gb and 30gb respectively and my wikiextractor text output is only 18gb and 8gb respectively. Is this correct?