Aloïs Micard
|
5491f5c3e7
|
Use my personal docker account
|
11 months ago |
Aloïs Micard
|
6f79af997f
|
s/creekorful/darkspot(-org)/
|
3 years ago |
|
Aloïs Micard
|
06e49ca764
|
Add values to make ES in single node
|
3 years ago |
|
Aloïs Micard
|
ce88e57726
|
Initial commit
|
3 years ago |
|
Aloïs Micard
|
66481a3f55
|
Merge remote-tracking branch 'origin/develop' into 66-add-kubernetes-config-files
|
3 years ago |
|
Aloïs Micard
|
a2ffa21dce
|
Allow proper cache configuration
|
3 years ago |
|
Aloïs Micard
|
d66eee8b94
|
Add working files
|
3 years ago |
|
Aloïs Micard
|
96c75a85b1
|
Rename project
|
3 years ago |
|
Aloïs Micard
|
6c678478a1
|
Implement better blacklist config
|
3 years ago |
|
Aloïs Micard
|
84a28c5be0
|
scheduler: increase event prefetch
|
3 years ago |
|
Aloïs Micard
|
9b46dc205e
|
Indexer: support buffered indexing
|
3 years ago |
|
Aloïs Micard
|
71f82d4aad
|
process: Rework whole flags system
- Turn the flag into Feature system to allow easier configuration.
- Add prefetch flag to event feature
|
3 years ago |
|
Aloïs Micard
|
ec3357be5d
|
Big improvements
- Reduce debug noise
- Create scripts to blacklist 'famous' legit hostnames
- Make blacklister more resilient
- Merge archiver & indexer together
- Better prefix for cache key
- Rework scheduling process
- Update architecture.png
- Remove trandoshanctl
- Improve testing
|
3 years ago |
|
Aloïs Micard
|
d0dffb9928
|
Implement new blacklister
|
3 years ago |
|
Aloïs Micard
|
1ac5c1e036
|
Merge remote-tracking branch 'origin/develop' into 110-archiver-new-format
|
3 years ago |
|
Aloïs Micard
|
cc3c0d62d6
|
remove hacky check
|
3 years ago |
|
Aloïs Micard
|
0aba4fa4f9
|
Finalize redis cache impl
|
3 years ago |
|
Aloïs Micard
|
387a93b7b9
|
Create new flags for cache
|
3 years ago |
|
Aloïs Micard
|
87a2fb246f
|
Add new hostname to blacklist
|
3 years ago |
|
Aloïs Micard
|
4bddf39335
|
make scheduler use whitelisting instead of blacklisting
|
3 years ago |
|
Aloïs Micard
|
a996bf2d5b
|
Turn API into indexer
|
3 years ago |
|
Aloïs Micard
|
f855f51a8e
|
add missing flag to extractor
|
3 years ago |
|
Aloïs Micard
|
78b9e16ded
|
Implement blacklister process
|
3 years ago |
|
Aloïs Micard
|
5a865dd6d4
|
blacklist .svg
|
3 years ago |
|
Aloïs Micard
|
5429bb70d8
|
Make api take refresh-delay from configapi
|
3 years ago |
|
Aloïs Micard
|
0079f4b0ed
|
configapi: create default values if not exist
|
3 years ago |
|
Aloïs Micard
|
aacb28ea1c
|
Start refactoring crawler
|
3 years ago |
|
Aloïs Micard
|
a4326ab955
|
Add redis as config backend database
|
3 years ago |
|
Aloïs Micard
|
901653dc02
|
Dockerize configapi
|
3 years ago |
|
Aloïs Micard
|
62d9589ffa
|
Fix RabbitMQ persistence
|
3 years ago |
|
Aloïs Micard
|
1640f424d1
|
blacklist .js
|
3 years ago |
|
Aloïs Micard
|
1cb038727e
|
Allow to add forbidden hostnames
|
3 years ago |
|
Aloïs Micard
|
579a39dddf
|
Implement archiver
|
3 years ago |
|
Aloïs Micard
|
b6e59600f0
|
Increase ES memory
|
3 years ago |
|
Aloïs Micard
|
05708e962e
|
Add persistence for RabbitMQ
|
3 years ago |
|
Aloïs Micard
|
7a7a0980dc
|
Change rabbitmq dashboard port
|
3 years ago |
|
Aloïs Micard
|
ae31e70c42
|
Rename event-srv -> hub
|
3 years ago |
|
Aloïs Micard
|
0dc70f63f7
|
Refactor to use RabbitMQ
|
3 years ago |
|
Aloïs Micard
|
fec9d5c506
|
Make things more readable
|
3 years ago |
|
Aloïs Micard
|
c3d387b545
|
Finalize ACL implementation
|
3 years ago |
|
Aloïs Micard
|
e1c0320a7b
|
Allow to skip scheduling for url with forbidden extensions
Closes: #42
|
3 years ago |
|
Aloïs Micard
|
dfbefad9a5
|
docker-compose: bump versions
- also enable back services logging
|
3 years ago |
|
Aloïs Micard
|
a4f86fbee9
|
Finalize usage of authentication for components
|
4 years ago |
|
Aloïs Micard
|
27e7c9d2fa
|
Implement basic user registration system
|
4 years ago |
|
Aloïs Micard
|
25d6452c65
|
Implement authorization trough JWT
|
4 years ago |
|
Aloïs Micard
|
a0be5160dc
|
Start implementing new architecture
|
4 years ago |
|
Aloïs Micard
|
589f3e2b07
|
Use dockerhub for images.
Closes: #22
|
4 years ago |
Gagan Bhat
|
3721428ebb
|
Java options fix in docker-compose.yml. (#18)
|
4 years ago |
|
Aloïs Micard
|
976500084c
|
Persist elasticsearch data
|
4 years ago |
|
Aloïs Micard
|
52c2bc2ded
|
Create docker subfolder in build/ & deployments/
|
4 years ago |