Aloïs Micard
|
96c75a85b1
|
Rename project
|
3 years ago |
|
Aloïs Micard
|
71f82d4aad
|
process: Rework whole flags system
- Turn the flag into Feature system to allow easier configuration.
- Add prefetch flag to event feature
|
3 years ago |
|
Aloïs Micard
|
ec3357be5d
|
Big improvements
- Reduce debug noise
- Create scripts to blacklist 'famous' legit hostnames
- Make blacklister more resilient
- Merge archiver & indexer together
- Better prefix for cache key
- Rework scheduling process
- Update architecture.png
- Remove trandoshanctl
- Improve testing
|
3 years ago |
|
Aloïs Micard
|
17e4e0cd61
|
crawler: skip forbidden hostnames
|
3 years ago |
|
Aloïs Micard
|
0cca8b0037
|
make crawler publish event in case crawling has failed
|
3 years ago |
|
Aloïs Micard
|
d1633844c4
|
Refactor crawler using new process library
|
3 years ago |
|
Aloïs Micard
|
b7ad2097e4
|
Improve crawler test
|
3 years ago |
|
Aloïs Micard
|
aacb28ea1c
|
Start refactoring crawler
|
3 years ago |
|
Aloïs Micard
|
a9e1d44e6c
|
Rework event system: add RawMessage
|
3 years ago |
|
Aloïs Micard
|
54ff87a130
|
event: add PublishJson method
|
3 years ago |
|
Aloïs Micard
|
5b37a4aeb0
|
Add time to new resource event
|
3 years ago |
|
Aloïs Micard
|
ca47be907f
|
Fix state visibility
|
3 years ago |
|
Aloïs Micard
|
4ff76ed552
|
Refactor crawler
|
3 years ago |
|
Aloïs Micard
|
91a0dbb0ba
|
Move http folder into crawler
|
3 years ago |
|
Aloïs Micard
|
db983c584b
|
Merge remote-tracking branch 'origin/develop' into rabbitmq-refactoring
|
4 years ago |
|
Aloïs Micard
|
5f657cfc74
|
Add mock http client & response
|
4 years ago |
|
Aloïs Micard
|
a4f86fbee9
|
Finalize usage of authentication for components
|
4 years ago |