4774 Commits (f777075893944ea622dab21d0f3339bfb921c325)

Author	SHA1	Message	Date
majestrate	8a849e81df	Merge pull request #1858 from jagerman/omq-11 ... Crank oxen-mq to (1.2.)11; switch to oxen-encoding	2 years ago
Jason Rhinelander	d02558350a	Crank oxen-mq to (1.2.)11; switch to oxen-encoding ... - Update oxen-mq submodule to latest stable - Add oxen-encoding submodule - Convert all oxenmq encoding usage to oxenc - Modernize cmake handling of oxenmq/oxenc	2 years ago
majestrate	f8b6b9d34b	Merge pull request #1856 from Bilb/fix-num-path-built-summary-status ... fix numPaths value in Router::ExtractSummaryStatus	2 years ago
Audric Ackermann	d9467f4dee	fix numPaths value in Router::ExtractSummaryStatus	2 years ago
Jeff	ac9fb9d479	use quad nine as default upstream dns	2 years ago
Jeff	810e3cc9c2	dont capture flow_addr, results in compiler error on sid	2 years ago
majestrate	838183e36e	Merge pull request #1748 from majestrate/liblokinet-udp-api-2021-09-19 ... liblokinet updates	2 years ago
Jeff	582fdeda27	add close_reason parameter to quic::Endpoint::close_connection defaulting to emtpy string	2 years ago
Jeff	95efe8f4e5	bump ngtcp2 to v0.1.0 tag	2 years ago
Jeff Becker	04b23416ed	do less allocations in lokinet_hex_tobase32z	2 years ago
Jeff Becker	743bc2433a	resolve race condition in udp flow and packet handling	2 years ago
Jeff Becker	635f4bcd8c	make it compile	2 years ago
Jeff Becker	5286d442fb	updates: ... * add udptest example * fix up udp codepath in liblokinet	2 years ago
Jeff Becker	65b29a1b70	add liblokinet custom logger	2 years ago
Jeff Becker	f5157c31da	make it compile	2 years ago
Jeff Becker	b225ec1043	thread safety stuff	2 years ago
Jeff Becker	ba57ab04aa	wire up liblokient_udp_*	2 years ago
Jeff Becker	1c70b0f42f	add lokinet_hex_to_base32z	2 years ago
Jeff Becker	bbb082931a	more logging	2 years ago
Jeff Becker	66de680884	sanity check	2 years ago
Jeff Becker	8c8f97adda	more logging	2 years ago
Jeff Becker	38d4cec7d1	log errors on decoding	2 years ago
Jeff Becker	c5b5ff7810	typo fix	2 years ago
Jeff Becker	2428cc189e	llarp::BootstrapConfig update ... * make routers member a llarp::BootstrapList	2 years ago
Jeff Becker	c4b1a9c074	lokinet_add_bootstrap_rc ... * allow bootstrap lists to be passed in	2 years ago
Jeff	fc444741f1	move constant to new header ... create llarp/constants/time.hpp for time/duration constants	2 years ago
Jeff	5fac6c84d8	detect timeskip and thaw network when we think it happened.	2 years ago
Jeff	38c6d99375	wire up sigusr1 to trigger a network thaw on non win32 platforms	2 years ago
majestrate	27619f5fb4	Merge pull request #1838 from majestrate/sd_notify_extra_info-2022-01-13 ... redo systemd status line	2 years ago
Jeff	b3d9cd463f	route poker: allow not blackholing routes. ... allow runtime configuration to disable ip blackholing.	2 years ago
Jeff	205584acdf	redo systemd status line to include number of paths and endpoint count. optionally warn about low path success.	2 years ago
majestrate	2c44ffe85b	Update llarp/router/route_poker.cpp ... Co-authored-by: Jason Rhinelander <jason@imaginary.ca>	2 years ago
Jeff	27ba3e044d	prevent segfault in route poker if Init() is not called	2 years ago
majestrate	9e4bd2cd44	Merge pull request #1801 from majestrate/introset-publish-spam-fix-2021-11-16 ... prevent introset publish spam	2 years ago
Jeff Becker	061aebc964	reword auto-routing config comment	2 years ago
Jeff Becker	14ffdb6639	configurable route poker ... this allows you to use exit nodes without forcing routes over the interface, useful for using lokinet with an exit and selectively routing over the lokinet interface using an external socks proxy or binding to device explicitly. * make route poker configurable, defaults to enabled but allows disabling it on runtime if desired * add config option [network]:auto-routing to enable/disable route poker	2 years ago
Jeff Becker	da887dc559	implement exit node pooling, allows users to use multiple exits for an address range. ... mappings per ip stick to the same exit, each new ip is mapped to a random exit in the specified pool. make exit-auth multi value	2 years ago
Jeff	776e9227fd	make serivce::Endpoint::EnsurePathToService have a default timeout as a named constant.	2 years ago
Jeff	301b19bd0f	do not send buggy reply as rpc	2 years ago
Jeff	388fc53380	match io loop event order on windows/apple to match linux. ... on win32/apple reading packets from the interface does not count as an io operation. manually trigger pump on win32/apple to pretend that it is an io event. add platform quark function MaybeWakeUpperLayers on vpn::Interface to manaully wake up the other components on platforms that need that (ones on which packet io is not done via io events). on non linux platforms, use uv_prepare_t instead of uv_check_t as the former triggers before blocking for io, instead of after. this better matches linux's order of operations in libuv.	2 years ago
Jeff Becker	0e2b0edaf6	when lokinet looses ip4 connectivity libunbound used to freak out and only use ip6 after such an event. ... as a result dns queries stop working because we blackhole ip6 routes if exit mode is on. this prevents this case from being hit.	3 years ago
Jeff Becker	ec8d990163	demote log statement levels	3 years ago
Jeff Becker	172c2dec45	create new constexpr for the staleness window for introsets and use it in publishing introsets and intro selection	3 years ago
Jason Rhinelander	189c4bfba4	Also consider last publish; eliminate unwanted condition ... We don't really carry about when the last regen was attempted, but rather about when the last publish was attempted (or succeeded).	3 years ago
Jeff Becker	8ba03de44e	match timeouts in introset selection spread with logic for publishing	3 years ago
Jason Rhinelander	5115162066	Use libuv's cached current time for `time_now()` ... We are calling time_now() a huge amount, and it is a major consumer of CPU cycles, but we don't need it: most of the time the current event loop time is enough.	3 years ago
Jason Rhinelander	b2ee003329	Optimization: eliminate unneeded shared_ptrs ... We have a few cases where we're making an extra shared_ptr which we copy into a lambda, which then results in an extra unnecessary refcount decrement in the parent; this changes them to give an rvalue reference to the lambda to avoid the extra incr/decr instead. The one in Session::Pump is particularly noticeable and shows up in profiling.	3 years ago
Jason Rhinelander	7a04911b9b	Avoid std::function in hot pump code ... We're seeing overhead here of the std::function invocation, which we can easily avoid in this case by not using a std::function around the callback.	3 years ago
Jason Rhinelander	09c2b31b25	Move paths pumping into PumpLL	3 years ago
Jason Rhinelander	687b54f860	Abstract & simplify logic	3 years ago
Jason Rhinelander	711038d150	Remove debug comment	3 years ago
Jason Rhinelander	0fe7153f6e	Fix client latency bug; De-shared_ptr IHopHandler queues ... - Replace m_FlushWakeup with a call to the router's god mode pump method. m_FlushWakeup apparently isn't enough to get things out, and we can end up with incoming packets that don't get properly handled right away without it. - The shared_ptr around the ihophandler queues isn't needed and is just adding a layer of obfuscation; instead just exchange the list directly into the lambda. - Use std::exchange rather than swap - A couple other small code cleanups.	3 years ago
Jason Rhinelander	70553c7627	Remove hopeless flush ... The TriggerPump just below this is *already* going to trigger a flush, so the extra flush call here can't do anything useful (and in particular, it won't clear up the queue *immediately*, which is what this code looks like it was aimed at doing).	3 years ago
Jason Rhinelander	fbc5cb0a6d	Add another missing pump trigger	3 years ago
Jason Rhinelander	bce7e2e56d	Pump outbound context	3 years ago
Jason Rhinelander	846577a0aa	Add missing inbound traffic pump trigger	3 years ago
Jason Rhinelander	8cdde74020	Simplify	3 years ago
Jason Rhinelander	b3a8160c89	Pump hidden context sooner ... This has to happen before pumping links because it is putting things on links.	3 years ago
Jason Rhinelander	0924dd8862	Remove dead declaration	3 years ago
Jason Rhinelander	f9395cd5dd	Cleanup: avoid pointless copy of `this` pointer	3 years ago
Jason Rhinelander	9844d358e6	Fix packet delay creep ... - Make the main PumpLL also pump hidden services, rather than using separate wakers in each TunEndpoint. It seems there is some interactions that just one or the other is not enough. - Eliminate TunEndpoint send queue -- it isn't needed as we can just send directly.	3 years ago
Jason Rhinelander	99b12940ad	Cleanups	3 years ago
Jason Rhinelander	e47d3098ac	Increase plaintext queue size from 32 to 512 ... In testing we were sometimes hitting a full queue error, which makes sense because the queue size seems really small. Increase it to 512.	3 years ago
Jason Rhinelander	78cc466bf2	Rename PumpLL -> TriggerPump ... And rename the actual pump implementation back to PumpLL.	3 years ago
Jason Rhinelander	031ea7aa37	Get rid of external event loop direct wakeups ... If something needs to wake up the event loop it should be using an async, as we are now with PumpLL(); but we had various code triggering a wakeup, expecting that PumpLL gets called on every wakeup, which isn't true anymore.	3 years ago
Jason Rhinelander	74215fc44c	Fix link layer delivery race condition (fix random ping delays) ... We trigger a pump immediately, but this is racey because we add to our plaintext data in a worker thread; if the worker thread runs after the pump then it ends up leaving plaintext to be handled, but there's no wakeup until the next one. This was the cause of seeing a random +1s and bunching added to ping responses sometimes: it wasn't until the *next* ping goes through the network that the plaintext queue gets processed, at which point it flushes the old one and often the new one together. The fix here gets rid of the map of sessions needing wakeups and instead adds an atomic flag to all of them to let us figure out which ones need to be flushed.	3 years ago
Jason Rhinelander	aa1dc83459	Simplify	3 years ago
Jason Rhinelander	362fda5a56	Combine empty + pop into single call	3 years ago
Jason Rhinelander	b03f3c2d79	Remove another unwanted unconditional PumpLL	3 years ago
Jason Rhinelander	9113a6b36b	Triggered pumping ... This redoes how/when we pump so that we should only be calling the idempotent PumpLL() when we actually have (or may have) something to pump.	3 years ago
Jason Rhinelander	bfc6d35b33	Simplifications & C++17 ... - Modernize some iterator loops - Simplify a couple places by using `if (init; ...)` - Replace various std::binds with lambdas	3 years ago
Jason Rhinelander	41807f1763	transit hop: drop instead of flushing when full ... If full happens we are going to trigger a bunch of flushes which probably isn't very useful, so drop instead.	3 years ago
Jason Rhinelander	cf5c4e7284	outbound_message_handler: skip instead of aborting on removed paths	3 years ago
Jason Rhinelander	633431be66	Make outbound message queue PumpLL again if it doesn't send all	3 years ago
Jason Rhinelander	faf95cbd0a	Allow a nullptr callback for event loop PumpLL	3 years ago
Jeff Becker	8a9025e234	only pump path context in idempotent pumpll	3 years ago
Jeff Becker	bb86996acf	make event loop pump function non idempotent	3 years ago
Jeff Becker	8744c93944	prevent 100% cpu usage on service nodes ... call_soon wakes up the mainloop and is often reentrant, we dont want to ever way up the event loop but we also want to always defer the call so we always use the workers	3 years ago
Jeff Becker	22d4b88edc	make PumpLL idempotent to reduce cpu use a bit	3 years ago
Jason Rhinelander	1ddfb7420a	Merge pull request #1791 from majestrate/exclude-failing-from-queue-2021-10-29 ... exclude fully failed nodes from service node testing list	3 years ago
Jason Rhinelander	0ec50e6624	Fix comment typo	3 years ago
Jeff Becker	fcba709fcb	do not requeue nodes for testing from failing queue if we do not have them marked as failing anymore	3 years ago
Jeff Becker	6c70022dcc	check for intersecting ip ranges correctly, add unit test	3 years ago
Jason Rhinelander	52492c6253	make format	3 years ago
Jason Rhinelander	1e22417ade	Add missing deprecated copy assignment operator ... Clang-13 warns (and -Werror dies) without it.	3 years ago
Jason Rhinelander	50449038b4	Another gcc-11 fix ... GCC is wrongly warning that `h` is uninitialized here, but it clearly isn't. Work around it.	3 years ago
Sean	e11a94c95c	RPC call for summary get_status (#1742) ... * RPC call for summary get_status * lint * update with review notes * further review points * uint64_t	3 years ago
Jason Rhinelander	0768593fa5	Merge pull request #1762 from majestrate/v6-base-address-configuration-fix-2021-10-06 ... catch ipv6 ioctl throwing when someone runs lokinet with no ipv6	3 years ago
Jeff	1846c3e3d8	prevent bizare half open state. (#1754) ... * attempt path timeout bullshittery fix * make sure ServiceInfo always has its address set up * do not copy intros in constuctor, ammend logging and add assert	3 years ago
Jeff Becker	937d07b6ce	catch ipv6 ioctl throwing when someone runs lokinet with no ipv6	3 years ago
Jeff Becker	5e9f9686e7	set base v6 address to nullopt when explicit empty string is provided	3 years ago
Jeff	24681fd35d	Merge pull request #1759 from majestrate/iterate-dir-in-order-2021-10-06 ... iterate through directory entries in lexigraphical order	3 years ago
Jeff	1d955cf28d	Update fs.hpp ... style nit	3 years ago
Jeff Becker	00f81b1dac	iterate through directory entries in lexigraphical order	3 years ago
Jeff Becker	d882f1a302	some compilers hated [[maybe_unused]] so use (void) when they are unused	3 years ago
Jeff Becker	cf187ddffc	fix up logging, put _log into anonynous namespace, make only log trace nop in release builds	3 years ago
Jeff Becker	20814a4adc	use llarp:: prefix for LogError	3 years ago
Jeff Becker	1b06e263fb	update log statement for win32	3 years ago
Jeff Becker	2d5faccb9f	refactor for apple	3 years ago
Jeff Becker	7d07dea235	fix up gripes in source_location ... * get rid of columns we dont need those	3 years ago
Jeff Becker	acdb8a19a6	for some reason [[maybe_unused]] is hated by buster 32 bit x86 so we do something else ... to appease that compiler.	3 years ago
Jeff Becker	18c5b43e63	use inline source_location implementation for android too	3 years ago
jeff	0546dab2e3	make source location happy on macos ... * because of course apple doesn't provide any implementation (lmao) we provide one ourself	3 years ago
Jeff Becker	5c457ff486	refactor logging to use std::source_location ... * use std::source_location instead of godawful macros in logging * remove unused/absolutely haram af json logstream * fix bug in android logger where it doesn't respect eLogNone	3 years ago
Jeff Becker	9c37e0146e	make it compile again	3 years ago
Jeff Becker	45b5fec314	make it compile again (squashme)	3 years ago
Jeff	ed271de715	make lokinet-util library static ... every other lokinet internal lib is static, but liblokinet-util was not, this fixes that.	3 years ago
Jeff Becker	d1246947f7	SystemD DNS fix: ... when dns is port 53 call SetLinKDNS otherwise call SetLinkDNSEx as on older versions of systemd-resolved SetLinkDNSEx is not available.	3 years ago
Jeff Becker	9ad63140f2	use std::sample to grab MaxGossipPeers when populating std::unordered_set	3 years ago
Jeff Becker	a739e7b532	try not to prefer outbound vs inbound link sessions ... before when we get the list of router ids for gossip it was highly bias towards outbound sessions. instead now we get a full list of link session router ids in random order, truncate them to be at most MaxGossipPeers number of keys, and then put them into an unordered set	3 years ago
Jeff Becker	d91ce53da1	limit RC gossip to 20 peers max	3 years ago
Jeff Becker	344d0a2f2d	format	3 years ago
Jeff Becker	2ee43c2162	set ipv6 address on apple to hardcoded value	3 years ago
Jason Rhinelander	c52782ab32	Add IPv6 addr/routing for macos	3 years ago
Jeff Becker	b52cf97e11	override ShouldHandlePacket on android to bypass non .snode/.loki dns hooking.	3 years ago
Jason Rhinelander	7fe5ffb209	Fix IPv4 routes are disabling exit ... (This was actually already working because macOS is buggy and doesn't actually remove routes other than the default).	3 years ago
Jeff Becker	0d64de17c8	tmp commit for debugging (revert me)	3 years ago
Jeff Becker	82314a3cac	add comment about android dns	3 years ago
Jason Rhinelander	831cc23de1	Remove obsolete bigs ... Removes stuff we didn't end up needing/using: - Lokinet.modulemap - apple bits from lokinet.cpp (we don't use lokinet.cpp at all on macos anymore). - dnsproxy/extension C++ headers - apple-specific network extension config in llarp::config::Config	3 years ago
Jason Rhinelander	38335f13a2	Remove debugging	3 years ago
Jason Rhinelander	8aef5d742d	Re-enable LTO; target macos 10.12+	3 years ago
Jeff Becker	10cd331863	invert logic for android dns hook	3 years ago
Jason Rhinelander	f51d0a80a2	Forward-declare ub_ctx/ub_result ... Avoids needing unbound.h in the search path to include the unbound_resolver.hpp header.	3 years ago
Jason Rhinelander	a7decd5ec3	Silence warnings	3 years ago
Jason Rhinelander	e11efe9bc5	Reformat	3 years ago
Jason Rhinelander	9dd604820f	Unleak exit mode DNS via unbound DNS trampoline on (macOS) ... When we enable/disable exit mode on this restarts the unbound DNS responder with the DNS trampoline (or restores upstream, when disabling) to properly route DNS requests through the tunnel (because libunbound's direct requests don't get tunneled because unbound is inside the network extension).	3 years ago
Jason Rhinelander	0f097450d7	Remove debug	3 years ago
Jason Rhinelander	f00e78c1a3	Add DNS trampoline ... This runs a DNS listener on localhost:1053 that bounces requests to the upstream DNS through the tunnel. The idea here is that, when we turn on exit mode, we start libunbound bouncing the requests through the trampoline (since if it makes direct requests they won't go through the tunnel). (The actual libunbound configuration is still to follow).	3 years ago
Jason Rhinelander	fd759914b6	Remove unused vars	3 years ago
Jason Rhinelander	e84390748d	Add RouteManager; make exit on/off work	3 years ago
Jason Rhinelander	c74dcba463	Add lokinet subnet to default routes ... Mac doesn't route to a tunnel's ip range by default. WTF.	3 years ago
Jason Rhinelander	9afa95cd7a	Remove unused/empty/no longer used apple headers	3 years ago
Jason Rhinelander	3527c9cdb5	Remove more unused dns-proxy files	3 years ago
Jason Rhinelander	58da228f62	Generate a default client lokinet.ini on startup if it doesn't exist ... Thus when a user goes looking for it they'll find the (commented out) default in the right place and can edit it. (That right place is: ~/Library/Containers/com.loki-project.lokinet.network-extension/Data/lokinet.ini)	3 years ago
Jason Rhinelander	fec3598e16	Remove no-longer-used framework.mm	3 years ago
Jason Rhinelander	2964051f0d	Remove swift version (do not squash) ... Don't squash this commit so that the swift version stays around in history in case we need to resurrect it again some day (i.e. when Apple decides to kill off Objective-C support).	3 years ago
Jason Rhinelander	329da951b7	Apple OS interface cleanup & refactoring ... - Add a C callback interface (context_wrapper.h) between lokinet and the objective-C code so that: - we can use objective-C (rather than objective-C++), which seems more likely to be supported by Apple into the future; - we minimize the amount of code that needs to be aware of the Apple APIs. - this replaces apple logger objective c++ implementation with a plain c++ implementation that takes a very simple C callback (provided from the obj-c code) to actually make the call to NSLog. - Add various documentation to the code of what is going on. - Send all DNS traffic to the primary IP on the tun interface. The match prefixes simply don't work as advertised, and have weird shit (like even if you get it working for some domains, "instagram.com" still doesn't because of god-knows-what Apple internal politics). - Drop the dns proxy code as we don't need it anymore. - Don't use 9.9.9.9 for default DNS. (We might consider the unfiltered 9.9.9.10 as an alternative default, but if we do it should be a global lokinet change rather than a Mac-specific change). - Parse a lokinet.ini in the data directory, if it exists. (Since we are sandboxed, it is an app-specific "home" directory so is probably buried god knows where, but at least the GUI ought to be able to get it to let users add things to it). - This commit also adds a swift version of the PacketTunnelProvider glue, which ought to work in theory, but the *tooling* for cmake is so underdeveloped that I couldn't find any way to actually get the damn thing working. So I'm committing it here anyway (and will revert it away in the next commit) in case we someday want to switch to it. -	3 years ago
Jason Rhinelander	3f0b34e860	Consolidate apple-specific bits into llarp/apple	3 years ago
jeff	deb0a982be	it works	3 years ago
jeff	7db2459469	macos sort of works now	3 years ago
Jason Rhinelander	3ab117a03b	Switch extension from a framework to an appex	3 years ago
Jason Rhinelander	faf8a699a6	Set version into Info.plist, don't manually configure ... cmake already treats the info plist as a file to be configured (not merely copied) so we don't need to configure_file ourselves to a temp file.	3 years ago
Jason Rhinelander	0bb00baacf	Various cmake build cleanups/refactors ... - Added contrib/macos/README.txt with description of the cancer happening here. - Add provisioningprofiles that Apple wants to make things work properly - Made the entitlements files match the provisioningprofiles - Remove configured entitlements files; we *can't* change any of the things here because they are closedly tied to the provisioningprofiles -- which means if someone wants to build their own Lokinet, they have to replace a bunch of crap and change application IDs throughout. This is the hostile-to-open-source Apple way. - Remove unused old lokinet binary, as we're no longer using it on macos - Use a POST_BUILD rather than install to copy things around into the right places - Convert all the configure_file's to consistently use @ONLY - Misc cleanups	3 years ago
jeff	5edd045c9b	add swift version bullshit file and additional bullshittery	3 years ago
jeff	0708a0d897	initial network extension code for macos ... probably does not work	3 years ago
Jeff	3bcc8f99c0	Merge pull request #1726 from majestrate/dns-graceful-teardown-2021-09-01 ... dns refactor	3 years ago
Jeff	060c571060	Merge pull request #1727 from majestrate/android-hang-fix-2021-09-01 ... dont save addrmap on android as it hangs	3 years ago
Jeff	cd99e5c4f4	Merge pull request #1729 from jagerman/fix-omq-deprecation ... Stop using deprecated OMQ connect_remote overload	3 years ago
Jason Rhinelander	a8a7ef5461	Stop using deprecated OMQ connect_remote overload	3 years ago
Jason Rhinelander	14c93e2b93	Unbound callbacks also need arguments reversed ... PR #1725 reversed argument orders but UnboundResolver was still using (from,to) ordering in its callbacks, which leaked through to make a wrong order in our reply function (which simply forwards arguments). This fixes that bug by making UnboundResolver callback argument order consistent (i.e. using to, from) with the PacketHandler argument order.	3 years ago