Kevin Lynx
|
b0428a1e5e
|
fix sphinx builder query range bug; improve sphinx builder db query performance, to avoid `getmore' command and the 4M useless response
|
11 years ago |
|
Kevin Lynx
|
395d73b000
|
build date index at startup
|
11 years ago |
|
Kevin Lynx
|
cd1fab1ecb
|
change sphinx_builder, query from mongodb by `skip' really don't work well, build a date index to query by date range
|
11 years ago |
|
Kevin Lynx
|
44464b40b3
|
add a new config `search_method', if set to `sphinx', hash reader will not create name_array, also add config for httpd, to config the search method
|
11 years ago |
|
Kevin Lynx
|
e816757fef
|
add a new config to head_reader `use_sphinx', when this flag is true, the reader will not create `name_array' for torrent document; now http use sphinx search
|
11 years ago |
|
Kevin Lynx
|
6fbd0cb218
|
add a new force to string log func, add log to httpd, it can log unicode characters to logfiles
|
11 years ago |
|
Kevin Lynx
|
ba92e9cd77
|
fix hash_date
|
11 years ago |
|
Kevin Lynx
|
45ca7d584e
|
config max download task per hash-reader,
|
11 years ago |
|
Kevin Lynx
|
928fc86934
|
recompile
|
11 years ago |
|
Kevin Lynx
|
f5655ba0f3
|
fix hash_reader stop working bug
|
11 years ago |
|
Kevin Lynx
|
810464330d
|
NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries.
|
11 years ago |
|
Kevin Lynx
|
1ed66b3863
|
fix memory leak for hash_reader (message queue keep increasing), set http search result to 50
|
11 years ago |
|
Kevin Lynx
|
d81d6a2fd2
|
integrate cache_index to hash_reader, default is disabled
|
11 years ago |
|
Kevin Lynx
|
0f24428faa
|
add cache_indexer progress displaying
|
11 years ago |
|
Kevin Lynx
|
86665cb93b
|
only build torrent name indexes
|
11 years ago |
|
Kevin Lynx
|
a1fc6ec3c0
|
add text segment config for hash_reader (text_seg), the default is simple
|
11 years ago |
|
Kevin Lynx
|
269584c708
|
add rmmseg, to segment chinese texts, add a tool to convert the existing torrent file names
|
11 years ago |
|
Kevin Lynx
|
676d354515
|
disable numid for sphinx default
|
11 years ago |
|
Kevin Lynx
|
1320002674
|
integrate torrent downloader monitor, change http today_top to show the today request count, instead total request count, remove ibrowse initial config
|
11 years ago |
|
Kevin Lynx
|
5a0b21c7b0
|
chang http top query, add a new database to map date to hashes, to support query by date range
|
11 years ago |
|
Kevin Lynx
|
42b32810c6
|
torbuilder(importer) fix badarith bug when there're invalid name torrent
files
|
11 years ago |
|
Kevin Lynx
|
164c0f0f21
|
change inc_announce response fileds to empty (only _id)
|
11 years ago |
|
Kevin Lynx
|
40dbbeb581
|
fix hash_reader stop working bug when there's only wait_download hash
|
11 years ago |
|
Kevin Lynx
|
0c6097f130
|
separate embedded css style to page.temp
|
11 years ago |
|
Kevin Lynx
|
cedd378fa6
|
IMPORTANT: add number id to torrent database
|
11 years ago |
|
Kevin Lynx
|
10c11df943
|
fix http cache bug
|
11 years ago |
|
Kevin Lynx
|
c1f99eccd5
|
add http search cache
|
11 years ago |
|
Kevin Lynx
|
603336cfd7
|
update readme
|
11 years ago |
|
Kevin Lynx
|
2d4d3f89a7
|
change http to read data from mongodb slave
|
11 years ago |
|
Kevin Lynx
|
2788de582d
|
change http interface
|
11 years ago |
|
Kevin Lynx
|
4f7fe8805e
|
first commit
|
11 years ago |