Aloïs Micard
|
6f79af997f
|
s/creekorful/darkspot(-org)/
|
3 years ago |
|
Aloïs Micard
|
96c75a85b1
|
Rename project
|
3 years ago |
|
Aloïs Micard
|
ec3357be5d
|
Big improvements
- Reduce debug noise
- Create scripts to blacklist 'famous' legit hostnames
- Make blacklister more resilient
- Merge archiver & indexer together
- Better prefix for cache key
- Rework scheduling process
- Update architecture.png
- Remove trandoshanctl
- Improve testing
|
3 years ago |
|
Aloïs Micard
|
c42cb26a11
|
remove extractor
|
3 years ago |
|
Aloïs Micard
|
a996bf2d5b
|
Turn API into indexer
|
3 years ago |
|
Aloïs Micard
|
78b9e16ded
|
Implement blacklister process
|
3 years ago |
|
Aloïs Micard
|
c6a9038dad
|
Refactor base api
|
3 years ago |
|
Aloïs Micard
|
8555c5eb05
|
Refactor configapi
|
3 years ago |
|
Aloïs Micard
|
2b0c65ff28
|
refactor extractor
|
3 years ago |
|
Aloïs Micard
|
1feda6e3b9
|
Refactor archiver
|
3 years ago |
|
Aloïs Micard
|
63ad33f984
|
Refactor scheduler
|
3 years ago |
|
Aloïs Micard
|
d1633844c4
|
Refactor crawler using new process library
|
3 years ago |
|
Aloïs Micard
|
901653dc02
|
Dockerize configapi
|
3 years ago |
|
Aloïs Micard
|
579a39dddf
|
Implement archiver
|
3 years ago |
|
Aloïs Micard
|
742ccbaa79
|
Finalize whole implementation
|
4 years ago |
|
Aloïs Micard
|
a0be5160dc
|
Start implementing new architecture
|
4 years ago |
|
Aloïs Micard
|
82a4a9c527
|
Add tdsh- prefix to executables.
API#searchResources:
- Serialize date
- Do not return body in get
|
4 years ago |
|
Aloïs Micard
|
317a4eabbd
|
Add api process
|
4 years ago |
|
Aloïs Micard
|
fd9d2e2b9e
|
Add persister process
|
4 years ago |
|
Aloïs Micard
|
c6a857f45b
|
Add basic scheduler implementation
- Create separate proto package to store Trandoshan related protocol implementation
|
4 years ago |
|
Aloïs Micard
|
06f31f8d9c
|
Implement crawler process
- Also change module URL.
- Create natsutil package
|
4 years ago |
|
Aloïs Micard
|
2f17ee088a
|
Initial commit
|
4 years ago |