Commit Graph

39 Commits (main)

Author SHA1 Message Date
Aloïs Micard 6f79af997f
s/creekorful/darkspot(-org)/ 3 years ago
Aloïs Micard 02a0dca6ed
Add process description 3 years ago
Aloïs Micard 96c75a85b1
Rename project 3 years ago
Aloïs Micard 6c678478a1
Implement better blacklist config 3 years ago
Aloïs Micard 4e33813b21
Merge remote-tracking branch 'origin/develop' into 124-improve-scheduler-speed 3 years ago
Aloïs Micard 7820820fa9
scheduler: add batch support for dialing with cache 3 years ago
Aloïs Micard 9b46dc205e
Indexer: support buffered indexing 3 years ago
Aloïs Micard 71f82d4aad
process: Rework whole flags system
- Turn the flag into Feature system to allow easier configuration.
- Add prefetch flag to event feature
3 years ago
Aloïs Micard ec3357be5d
Big improvements
- Reduce debug noise
- Create scripts to blacklist 'famous' legit hostnames
- Make blacklister more resilient
- Merge archiver & indexer together
- Better prefix for cache key
- Rework scheduling process
- Update architecture.png
- Remove trandoshanctl
- Improve testing
3 years ago
Aloïs Micard 8da1f29a43
little fixes 3 years ago
Aloïs Micard d0dffb9928
Implement new blacklister 3 years ago
Aloïs Micard e245e5d79a
last fixes 3 years ago
Aloïs Micard 4a0fbd0b9b
add configapi key prefix 3 years ago
Aloïs Micard 387a93b7b9
Create new flags for cache 3 years ago
Aloïs Micard d826fe73b6
Refactor configapi to use new cache 3 years ago
Aloïs Micard 4bddf39335
make scheduler use whitelisting instead of blacklisting 3 years ago
Aloïs Micard a2db14cc7b
blacklister: do not publish duplicates 3 years ago
Aloïs Micard 78b9e16ded
Implement blacklister process 3 years ago
Aloïs Micard 205235aa7b
fix api & configapi 3 years ago
Aloïs Micard 275bad8a6e
Finalize refactoring 3 years ago
Aloïs Micard 8555c5eb05
Refactor configapi 3 years ago
Aloïs Micard 51f12b4cba
Simplify configapi 3 years ago
Aloïs Micard 0079f4b0ed
configapi: create default values if not exist 3 years ago
Aloïs Micard aacb28ea1c
Start refactoring crawler 3 years ago
Aloïs Micard 62250bcf61
Unit test configapi client 3 years ago
Aloïs Micard 18bb162ac7
event: Create new SubscribeAll function 3 years ago
Aloïs Micard 2d86123c4a
SubscribeAsync -> Subscribe 3 years ago
Aloïs Micard ec6bcd9d12
Finalize client implementation 3 years ago
Aloïs Micard a9e1d44e6c
Rework event system: add RawMessage 3 years ago
Aloïs Micard c50c4bb9c9
Working on config update trough event 3 years ago
Aloïs Micard a4326ab955
Add redis as config backend database 3 years ago
Aloïs Micard b9cea755de
Fix ConfigAPI server 3 years ago
Aloïs Micard 2fd03d2112
Implement memory only database to test configapi 3 years ago
Aloïs Micard 32cb7e63e0
Implement ConfigAPI client 3 years ago
Aloïs Micard 901653dc02
Dockerize configapi 3 years ago
Aloïs Micard 345f9c2669
Finalize ConfigAPI server 3 years ago
Aloïs Micard 353880bc22
Implement ConfigAPI service layer 3 years ago
Aloïs Micard 278f8e58c2
Refactor scheduler to use new configapi 3 years ago
Aloïs Micard a1f8313246
Design configapi interfaces 3 years ago