Commit Graph

361 Commits (main)
 

Author SHA1 Message Date
Aloïs Micard ace3b4a0fc
Merge pull request #102 from creekorful/100-archiver-rework
Make API publish new index event
3 years ago
Aloïs Micard 9e75f85923
Rename handler 3 years ago
Aloïs Micard db7d204724
Fix comment 3 years ago
Aloïs Micard f4099838e1
Make API publish new index event 3 years ago
Aloïs Micard f855f51a8e
add missing flag to extractor 3 years ago
Aloïs Micard 1efc3d5263
Merge pull request #99 from creekorful/replicated-checks
Replicated checks
3 years ago
Aloïs Micard a70a958ee4
Create constraint package 3 years ago
Aloïs Micard d62af0889e
extractor: check forbidden hostnames 3 years ago
Aloïs Micard 9fb1861d62
Merge pull request #98 from creekorful/replicated-checks
Replicated checks
3 years ago
Aloïs Micard 2f6a569349
api: fix tests 3 years ago
Aloïs Micard 17e4e0cd61
crawler: skip forbidden hostnames 3 years ago
Aloïs Micard ab9bf3d4c3
api: do not save forbidden hostname 3 years ago
Aloïs Micard 79939ffd62
Merge pull request #97 from creekorful/develop
Release 0.8.0
3 years ago
Aloïs Micard 40470b2221
release.sh: assume release commit exist 3 years ago
Aloïs Micard 592a1621d6
Bump app versions 3 years ago
Aloïs Micard a2db14cc7b
blacklister: do not publish duplicates 3 years ago
Aloïs Micard e9059c71d4
Merge pull request #96 from creekorful/91-dead-hostname-event
Implement blacklister process
3 years ago
Aloïs Micard 78b9e16ded
Implement blacklister process 3 years ago
Aloïs Micard 4e849830f0
Merge pull request #95 from creekorful/91-dead-hostname-event
crawler: publish event in case hostname is down
3 years ago
Aloïs Micard 95989b157b
make http client throw err timeout if one occurs 3 years ago
Aloïs Micard 0cca8b0037
make crawler publish event in case crawling has failed 3 years ago
Aloïs Micard c21783d436
Merge pull request #94 from creekorful/93-create-process-pkg
Create process package
3 years ago
Aloïs Micard fcca98f99f
writeJson -> writeJSON 3 years ago
Aloïs Micard c114e091f9
api: return content-type 3 years ago
Aloïs Micard 5a865dd6d4
blacklist .svg 3 years ago
Aloïs Micard 205235aa7b
fix api & configapi 3 years ago
Aloïs Micard 5429bb70d8
Make api take refresh-delay from configapi 3 years ago
Aloïs Micard 672c758897
Remove echo dependency 3 years ago
Aloïs Micard 275bad8a6e
Finalize refactoring 3 years ago
Aloïs Micard c6a9038dad
Refactor base api 3 years ago
Aloïs Micard 8555c5eb05
Refactor configapi 3 years ago
Aloïs Micard 2b0c65ff28
refactor extractor 3 years ago
Aloïs Micard 1feda6e3b9
Refactor archiver 3 years ago
Aloïs Micard 63ad33f984
Refactor scheduler 3 years ago
Aloïs Micard d1633844c4
Refactor crawler using new process library 3 years ago
Aloïs Micard 823c3640c4
Merge pull request #89 from creekorful/83-event-driven-configuration
Add event driven configuration
3 years ago
Aloïs Micard 51f12b4cba
Simplify configapi 3 years ago
Aloïs Micard b7ad2097e4
Improve crawler test 3 years ago
Aloïs Micard 0079f4b0ed
configapi: create default values if not exist 3 years ago
Aloïs Micard aacb28ea1c
Start refactoring crawler 3 years ago
Aloïs Micard 62250bcf61
Unit test configapi client 3 years ago
Aloïs Micard 18bb162ac7
event: Create new SubscribeAll function 3 years ago
Aloïs Micard 2d86123c4a
SubscribeAsync -> Subscribe 3 years ago
Aloïs Micard e751e0e73e
Merge remote-tracking branch 'origin/develop' into 83-event-driven-configuration 3 years ago
Aloïs Micard 485a109519
Improve extensions check 3 years ago
Aloïs Micard 89710584b4
Merge pull request #90 from creekorful/fix-scheduler-test
Fix scheduler test
3 years ago
Aloïs Micard 1b0efdf13e
Fix scheduler test 3 years ago
Aloïs Micard ec6bcd9d12
Finalize client implementation 3 years ago
Aloïs Micard a9e1d44e6c
Rework event system: add RawMessage 3 years ago
Aloïs Micard c50c4bb9c9
Working on config update trough event 3 years ago