725 Commits (dev)

Author	SHA1	Message	Date
Jeff	68148e098f	* add mockable network functions ... * add unit tests with ability to pretend to be different network setups	2 years ago
Jason Rhinelander	c82ade2d81	Make test code work with new logging	2 years ago
Jason Rhinelander	b81f7025c9	Replace logging with oxen-logger ... Replaces custom logging system with spdlog-based oxen logging. This commit mainly replaces the backend logging with the spdlog-based system, but doesn't (yet) convert all the existing LogWarn, etc. to use the new format-based logging. New logging statements will look like: llarp::log::warning(cat, "blah: {}", val); where `cat` should be set up in each .cpp or cluster of .cpp files, as described in the oxen-logging README. As part of spdlog we get fmt, which gives us nice format strings, where are applied generously in this commit. Making types printable now requires two steps: - add a ToString() method - add this specialization: template <> constexpr inline bool llarp::IsToStringFormattable<llarp::Whatever> = true; This will then allow the type to be printed as a "{}" value in a fmt::format string. This is applied to all our printable types here, and all of the `operator<<` are removed. This commit also: - replaces various uses of `operator<<` to ToString() - replaces various uses of std::stringstream with either fmt::format or plain std::string - Rename some to_string and toString() methods to ToString() for consistency (and to work with fmt) - Replace `stringify(...)` and `make_exception` usage with fmt::format (and remove stringify/make_exception from util/str.hpp).	2 years ago
Jason Rhinelander	3cd699fa7f	Show router pubkey at startup	2 years ago
Jeff	1eba0f836e	replace LLARP_PROTO_VERSION macro	2 years ago
Jeff	98b3860655	set source ip on service nodes for outbound link to not use all interfaces	2 years ago
Jeff	60ada470db	format systemd status as time deltas from now	2 years ago
Jeff	18e1272c76	add gossip info to systemd status ... * adds next and last gossip datetimes * adds a few things for time points, like ostream operator overloads for time point	2 years ago
Jeff	3c44a06403	publish our rc out to the network when we regenerate them	2 years ago
Jeff	5f496259b7	if we are decommissioned or deregistered, do not test other routers so we do not spam them. ... disambiguiate error message to distinguish between decomissioned and deregistered.	2 years ago
Jeff	706e34c082	connect to routers even if we are decomissioned	2 years ago
majestrate	5b0ece3f9e	Update llarp/router/outbound_message_handler.cpp ... add comment Co-authored-by: Thomas Winget <tewinget@gmail.com>	2 years ago
Jeff	26c8063fc9	convert priority queues	2 years ago
Jeff	8960ca08f3	propagate link layer message priority to link layer so it can order retransmissions with that in mind	2 years ago
Jeff	a76acd4956	fix wire protocol race condition ... only send close packet once, before we were sending a close after we got a close causing excess log spam. include handshake phase when checking for connection timeouts. when we change our rc make sure to put it into nodedb too when we are a service node to prevent weirdness in dht lookups.	2 years ago
Jeff	eeb93343c0	rpc fixes for lokinet gui ... only add stats for services when we have them	2 years ago
audric	41405be612	summary status: no services means not running	2 years ago
Audric Ackermann	ad6d206aa6	add version and uptime to summary status endpoint	2 years ago
Audric Ackermann	d9467f4dee	fix numPaths value in Router::ExtractSummaryStatus	2 years ago
Jeff	fc444741f1	move constant to new header ... create llarp/constants/time.hpp for time/duration constants	2 years ago
Jeff	5fac6c84d8	detect timeskip and thaw network when we think it happened.	2 years ago
majestrate	27619f5fb4	Merge pull request #1838 from majestrate/sd_notify_extra_info-2022-01-13 ... redo systemd status line	2 years ago
Jeff	b3d9cd463f	route poker: allow not blackholing routes. ... allow runtime configuration to disable ip blackholing.	2 years ago
Jeff	205584acdf	redo systemd status line to include number of paths and endpoint count. optionally warn about low path success.	2 years ago
majestrate	2c44ffe85b	Update llarp/router/route_poker.cpp ... Co-authored-by: Jason Rhinelander <jason@imaginary.ca>	2 years ago
Jeff	27ba3e044d	prevent segfault in route poker if Init() is not called	2 years ago
Jeff Becker	14ffdb6639	configurable route poker ... this allows you to use exit nodes without forcing routes over the interface, useful for using lokinet with an exit and selectively routing over the lokinet interface using an external socks proxy or binding to device explicitly. * make route poker configurable, defaults to enabled but allows disabling it on runtime if desired * add config option [network]:auto-routing to enable/disable route poker	2 years ago
Jeff	388fc53380	match io loop event order on windows/apple to match linux. ... on win32/apple reading packets from the interface does not count as an io operation. manually trigger pump on win32/apple to pretend that it is an io event. add platform quark function MaybeWakeUpperLayers on vpn::Interface to manaully wake up the other components on platforms that need that (ones on which packet io is not done via io events). on non linux platforms, use uv_prepare_t instead of uv_check_t as the former triggers before blocking for io, instead of after. this better matches linux's order of operations in libuv.	2 years ago
Jason Rhinelander	09c2b31b25	Move paths pumping into PumpLL	3 years ago
Jason Rhinelander	b3a8160c89	Pump hidden context sooner ... This has to happen before pumping links because it is putting things on links.	3 years ago
Jason Rhinelander	9844d358e6	Fix packet delay creep ... - Make the main PumpLL also pump hidden services, rather than using separate wakers in each TunEndpoint. It seems there is some interactions that just one or the other is not enough. - Eliminate TunEndpoint send queue -- it isn't needed as we can just send directly.	3 years ago
Jason Rhinelander	78cc466bf2	Rename PumpLL -> TriggerPump ... And rename the actual pump implementation back to PumpLL.	3 years ago
Jason Rhinelander	031ea7aa37	Get rid of external event loop direct wakeups ... If something needs to wake up the event loop it should be using an async, as we are now with PumpLL(); but we had various code triggering a wakeup, expecting that PumpLL gets called on every wakeup, which isn't true anymore.	3 years ago
Jason Rhinelander	74215fc44c	Fix link layer delivery race condition (fix random ping delays) ... We trigger a pump immediately, but this is racey because we add to our plaintext data in a worker thread; if the worker thread runs after the pump then it ends up leaving plaintext to be handled, but there's no wakeup until the next one. This was the cause of seeing a random +1s and bunching added to ping responses sometimes: it wasn't until the *next* ping goes through the network that the plaintext queue gets processed, at which point it flushes the old one and often the new one together. The fix here gets rid of the map of sessions needing wakeups and instead adds an atomic flag to all of them to let us figure out which ones need to be flushed.	3 years ago
Jason Rhinelander	9113a6b36b	Triggered pumping ... This redoes how/when we pump so that we should only be calling the idempotent PumpLL() when we actually have (or may have) something to pump.	3 years ago
Jason Rhinelander	bfc6d35b33	Simplifications & C++17 ... - Modernize some iterator loops - Simplify a couple places by using `if (init; ...)` - Replace various std::binds with lambdas	3 years ago
Jason Rhinelander	cf5c4e7284	outbound_message_handler: skip instead of aborting on removed paths	3 years ago
Jason Rhinelander	633431be66	Make outbound message queue PumpLL again if it doesn't send all	3 years ago
Jeff Becker	8a9025e234	only pump path context in idempotent pumpll	3 years ago
Jeff Becker	bb86996acf	make event loop pump function non idempotent	3 years ago
Jeff Becker	8744c93944	prevent 100% cpu usage on service nodes ... call_soon wakes up the mainloop and is often reentrant, we dont want to ever way up the event loop but we also want to always defer the call so we always use the workers	3 years ago
Jeff Becker	22d4b88edc	make PumpLL idempotent to reduce cpu use a bit	3 years ago
Sean	e11a94c95c	RPC call for summary get_status (#1742) ... * RPC call for summary get_status * lint * update with review notes * further review points * uint64_t	3 years ago
Jeff Becker	5c457ff486	refactor logging to use std::source_location ... * use std::source_location instead of godawful macros in logging * remove unused/absolutely haram af json logstream * fix bug in android logger where it doesn't respect eLogNone	3 years ago
Jeff Becker	d1246947f7	SystemD DNS fix: ... when dns is port 53 call SetLinKDNS otherwise call SetLinkDNSEx as on older versions of systemd-resolved SetLinkDNSEx is not available.	3 years ago
Jeff Becker	9ad63140f2	use std::sample to grab MaxGossipPeers when populating std::unordered_set	3 years ago
Jeff Becker	a739e7b532	try not to prefer outbound vs inbound link sessions ... before when we get the list of router ids for gossip it was highly bias towards outbound sessions. instead now we get a full list of link session router ids in random order, truncate them to be at most MaxGossipPeers number of keys, and then put them into an unordered set	3 years ago
Jeff Becker	d91ce53da1	limit RC gossip to 20 peers max	3 years ago
Jeff Becker	64cd2990bc	remove old routing table maniuplation code	3 years ago
Jeff Becker	0871862452	initial routing table refactor ... * move routing table manipulation to vpn platform * add initial linux implementation of vpn platform route manipulation	3 years ago
Jeff Becker	e96ec156ea	add / remove route blackhole so we dont leak if we crash	3 years ago
Jeff Becker	14cc115489	dont use constexpr	3 years ago
Jeff Becker	069d9487b7	* throw exception on invalid SessionResult when transforming to SendStatus ... * add case for printing unknown SessionResult	3 years ago
Jeff Becker	18cb59a1b5	* make tranform function for SessionResult to SendStatus ... * add case for SessionResult::EstablishFail * clean up outbound message handler to use transform function instead of many private member functions	3 years ago
Jeff Becker	75451d7124	* add establish fail enum ... * dont call outbound session hooks for inbound sessions	3 years ago
Jeff Becker	e3281cd026	add string representation to SessionResult	3 years ago
Jeff Becker	1d1d97b0ef	disable peer status entirely	3 years ago
Jeff Becker	2578983a09	dont give peer stats in rpc	3 years ago
Jeff Becker	99379c5def	establish outbound sessions when we have no outbound session. ... when we have an inbound session we still want to make an outbound session.	3 years ago
Jeff Becker	cf0349c259	if we have an inbound session don't fail with NoLink	3 years ago
Jeff Becker	f4fa83703f	refactor to use RouterID instead of rc.pubkey	3 years ago
Thomas Winget	8515fe09d4	fix minor oversight/inefficiency with already established connections	3 years ago
Jeff Becker	a24b82119b	fix #1655 ... * make it so that we don't set up unbound resolver when we have no resolvers provided by config * clean up dns codepath and make it use llarp::SockAddr instead of llarp::IpAddress	3 years ago
Jeff Becker	5074dd5f2b	re-enable multithreading on clients but not on service nodes	3 years ago
Jeff Becker	d7a51e88f5	make router tick 250ms instead of 100ms to prevent excessive log spam ... limit calls to decommissioned warning to every 30s to prevent excessive log spam	3 years ago
Jeff Becker	f3deabdb96	* get_failing does not need abstract router as paramter so we remove it ... * add remove_node_from_failing to remove a node by pubkey from the failing set * if a router is deregistered we remove it from the failing set so we don't retest it * remove a router from the failing set if we get a test success	3 years ago
Jeff Becker	d88ed4eee0	make windows happy by making some constexprs non static and such as windows does not LTO	3 years ago
Thomas Winget	d68d39a450	make outbound session if we do not have ... currently creating an outbound session will cancel if we have any session at all with the relay. instead, only cancel if we have an outbound session to that relay. this is useful for reachability testing.	3 years ago
Jeff Becker	37ab78b654	dont run router testing if we are decommissioned. ... properly name function to be called LooksDecommissioned because that is different than deregistered	3 years ago
Jeff Becker	07d18b30c0	typofix	3 years ago
Jason Rhinelander	7c964800ba	Fix unintentional whitelist/greylist copying	3 years ago
Jeff Becker	ef924aea39	gossip RC when we are not deregistered so we can come back when we are decommissioned	3 years ago
Jeff Becker	95537804cd	separate white/grey list for active/decommissioned nodes. ... allow sessions to decommissioned nodes but not paths.	3 years ago
Jason Rhinelander	28ba0b7533	Add logging about testing success/fail	3 years ago
Jeff Becker	d40484deea	handle case where we already have an outbound session, inform caller about it	3 years ago
Jeff Becker	c23e121139	capture by value to appease clang 11	3 years ago
Jeff Becker	e8af36ee91	there were some unhandled edge cases in outbound_session_maker, specifically when we are not permitted to connect to a remoute but we got its rc we silently drop the error.	3 years ago
Jeff Becker	9ad90d029d	* use weak_ptr on core rpc ... * use reachability testing code lifted storage server's code	3 years ago
Jeff Becker	b830eeb535	initial lokinet router testing: ... * report via rpc to oxen core connection stats on success and failure * connect to random service node by pubkey every 5 seconds for testing	3 years ago
Jeff Becker	499bb38e6f	fix route poking via rpc: ... * immediately poke routes when we are told to use an exit so that packets get pushed which makes an exit path happen * fix up cmake oddity in nsis section	3 years ago
Jeff Becker	51b7566a46	if we look deregistered we will now: ... * not gossip our rc * not explore the network to prevent outbound session attempts * not establish sessions to other service nodes * close all open sessions we have to tell clients we don't want them * catch exceptions flushing peerdb in disk thread * don't connect out to non allowed routers * simplify logic in RCLookupHandler::RemoteIsAllowed() * add HaveReceivedWhitelist to I_RCLookupHandler base type * add LooksDeregistered to Router type that tells us if we think we are deregistered * don't allow building paths over us if we are deregistered	3 years ago
Jeff Becker	ec62228149	limit path builds across all builders	3 years ago
Jeff Becker	554a44c8bf	report block height reported by oxend in systemd status	3 years ago
Thomas Winget	cecbddc912	Fixes subtle memory leak, adds comments ... Fixes a subtle memory leak that was a result of outbound messages which were in the shared queue (not yet sorted into a per-path queue) when a path was removed, resulting in a ghost path queue (and thus round-robin order entry as well). Adds much needed documentation to the outbound message handler class.	3 years ago
Jeff	ef28de8c9f	Merge pull request #1610 from majestrate/android-fixes-2021-04-26 ... Android fixes	3 years ago
Jason Rhinelander	7963cd0181	Fix headers & grammar for non-systemd	3 years ago
Jason Rhinelander	1d48cd6d35	format	3 years ago
Jason Rhinelander	b9363c8d21	Put systemd ifdef around the headers, too	3 years ago
Jason Rhinelander	4ef25ef679	Add systemd-resolved dynamic DNS updating ... Wires up systemd support to configure DNS on startup and when enabling/disabling exit mode. On startup (and when turning off an exit) we tell systemd-resolved to direct .loki and .snode lookups to lokinet (leaving other DNS traffic alone). On exit enabling, we reconfigure it to resolve "." (i.e. the root DNS domain) so that all lookups come into it.	3 years ago
Jeff Becker	6d12a7a712	fixes for android jni	3 years ago
Jason Rhinelander	86dcdde8d3	Add missing <optional> header ... Reported by TechnicalTumbleweed as needed to fix a build.	3 years ago
Jeff Becker	545021aa3d	temp commit	3 years ago
Jeff Becker	25e338d621	srv records ... * add srv records in RCs if we have any * add mechanism to add SRV records for plainquic exposed ports * resign and republish rc or introset on srv record changes	3 years ago
Jeff Becker	a2285730b8	reduce log level	3 years ago
Jeff Becker	48ce77ed1f	XXX: single threaded mode	3 years ago
Jeff Becker	2188b443e9	more liblokinet api stuff ... * add lokinet_wait_for_ready to wait until we have published introsets and such * optionally expose ports in lnproxy * dont save profiles by default	3 years ago
Jeff Becker	95cd275cdd	liblokinet additions: ... * add lokinet_add_bootstrap_rc function for adding an rc from memory * prevent stack overflow on error closing connection in quic * add in memory nodedb * refactor how convotags are set as active * add initial stubs for endpoint statistics * refactor time stuff to be a bit cleaner * update lnproxy script with more arguments	3 years ago
Jeff Becker	59c9e997f2	build paths faster and limit path builds at edge router instead of via a time counter for all edges	3 years ago
Jeff Becker	7098f46d60	rpc endpoint for triggering quic tunnel	3 years ago
Jason Rhinelander	2ca7ef7f5f	Rename isRouter -> isSNode ... The isRouter wording was quite confusing, especially in a call such as: router->Configure(config, opts.isRouter, nodedb)	3 years ago