Commit Graph

585 Commits (rewrite)
 

Author SHA1 Message Date
Hydriz Scholz 060588c283 Spliting rewrite files into a separate branch 10 years ago
Hydriz Scholz 421df6d4bb Spliting rewrite files into a separate branch 10 years ago
Emilio J. Rodríguez-Posada c07b527e5d adding session to getWikiEngine() 10 years ago
Emilio J. Rodríguez-Posada 30c153ce1f chg: using 'with open' for files 10 years ago
Emilio J. Rodríguez-Posada 10d269deb0 Merge branch 'balr0g-requests' 10 years ago
balr0g 1391cf893b Update requirements file 10 years ago
balr0g 9aa3c4a0e1 Removed all traces of urllib except for encode/decode; more bugs fixed. 10 years ago
balr0g c8e11a949b Initial port to Requests 10 years ago
Emilio J. Rodríguez-Posada 9553e3550c adding wiki engine detector 10 years ago
Emilio J. Rodríguez-Posada eb97cf1adf version 0.2.2 and tiny bits in --help 10 years ago
Emilio J. Rodríguez-Posada fc2ed3ed0d Merge pull request #138 from balr0g/argparse
Initial port to argparse
10 years ago
Emilio J. Rodríguez-Posada 636c6a91df adding spider for neoseeker, updating list, adding info file 10 years ago
Emilio J. Rodríguez-Posada 514d5fea0e removing unused modules 10 years ago
Emilio J. Rodríguez-Posada a3e69666fe adding spider for orain wikifarm, updating list too 10 years ago
Emilio J. Rodríguez-Posada 374cf83c54 adding info file for orain.org wikifarm list 10 years ago
balr0g 32fded6e8a Add requirements file 10 years ago
Emilio J. Rodríguez-Posada 7c76b77842 revamping image list tests 10 years ago
Emilio J. Rodríguez-Posada 3a8fa1f0cc adding test for getImageFilenamesURL(), the image scraper 10 years ago
Emilio J. Rodríguez-Posada 5f0ca74d87 adding simple test for delay(), 0 and 3 seconds 10 years ago
balr0g 50b011f90d Initial port to argparse 10 years ago
Emilio J. Rodríguez-Posada 09be8b5f22 prints 10 years ago
Emilio J. Rodríguez-Posada 3da6bc222f ignoring .pyc files 10 years ago
Emilio J. Rodríguez-Posada d04c0e5bce first test 10 years ago
Emilio J. Rodríguez-Posada 568deef081 adding comments for clarification 10 years ago
Emilio J. Rodríguez-Posada d4eed1f738 fixing #127 and #134 , now works with APIs that returns 'name' field for images and those that don't do it (in this case we unquote over ascii); also fixing bug that re-download image list when it was completed previously 10 years ago
Emilio J. Rodríguez-Posada 005de23c1d adding gzip to siteinfo downloader 10 years ago
Emilio J. Rodríguez-Posada d79ea64d41 fixing issue #97 pretty siteinfo json saving, indenting 4 chars 10 years ago
Emilio J. Rodríguez-Posada 3854a344fe Merge branch 'master' of https://github.com/WikiTeam/wikiteam 10 years ago
Emilio J. Rodríguez-Posada 1c1f0dbb86 replacing XML with JSON in image downloading 10 years ago
Emilio J. Rodríguez-Posada 6bbdf42ed0 Merge pull request #125 from balr0g/check-for-disabled-api
Don't try to download sites with disabled API
10 years ago
balr0g 481323c7f7 Don't try to download sites with disabled API 10 years ago
Emilio J. Rodríguez-Posada 084ccc6456 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 10 years ago
nemobis 1933db8a94 Merge pull request #124 from balr0g/scraper-unicode-title-fix
Fix scraper for sites with Unicode titles
10 years ago
balr0g 62be069026 Fix scraper for sites with Unicode titles 10 years ago
nemobis dbfc1b598a Ask Wikimedia Commons reseed 10 years ago
nemobis c41cc5235c Fix typo, add balrog
Because he always saves wikiteam from my silly mistakes, helping out on #wikiteam.
10 years ago
nemobis 62d961fa97 Fix typo, unused variable spotted by balrog 10 years ago
Emilio J. Rodríguez-Posada 7d00cfa0de adding list info file for tropicalwikis 10 years ago
Emilio J. Rodríguez-Posada ecd539f1ae adding scribblewiki list info file 10 years ago
Emilio J. Rodríguez-Posada e95d8ba6e1 sort list 10 years ago
Emilio J. Rodríguez-Posada c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 10 years ago
Emilio J. Rodríguez-Posada c7fc194f0d add info file for wikkii.com list 10 years ago
Emilio J. Rodríguez-Posada 29a64507c2 last update date 10 years ago
Emilio J. Rodríguez-Posada d90127e9cc adding details to shoutwiki info 10 years ago
Emilio J. Rodríguez-Posada 90c442a5b7 updating shoutwiki list and uploading basic spider 10 years ago
Emilio J. Rodríguez-Posada 75e2234c2c adding details to referata list 10 years ago
Emilio J. Rodríguez-Posada db9bcb68ca adding license to referata-spider.py 10 years ago
Emilio J. Rodríguez-Posada fa6f603fe8 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 10 years ago
Emilio J. Rodríguez-Posada eaec1afa83 adding info about shoutwiki list 10 years ago
nemobis 95bc2dec38 Link GitHub issue tracker 10 years ago