Commit Graph

89 Commits

Author SHA1 Message Date
Connor Olding c95b6ba0e1 use an alternative to the now-defunct Alexa top-1m 2023-11-08 05:53:08 -08:00
Connor Olding e9a36ed397 tweak known IPs (edited months ago) 2022-01-19 14:37:11 -08:00
Connor Olding 99b6ed3045 tweak ip-api cooldown (again) 2021-08-14 17:42:59 -07:00
Connor Olding 44e2a491a0 merge a couple lines 2021-08-14 17:42:22 -07:00
Connor Olding 6508ee1210 rewrite rate-limiter to not create any tasks 2021-08-14 00:55:06 -07:00
Connor Olding ffbdf50674 remove number from program name (an ancient artifact) 2021-08-13 03:06:39 -07:00
Connor Olding b78081b65d fix all_ips method 2021-08-13 02:38:36 -07:00
Connor Olding 477f983145 tweak ip-api cooldown 2021-08-13 02:35:05 -07:00
Connor Olding f1a5cbe69f clean up some commented-out stuff 2021-08-13 02:33:43 -07:00
Connor Olding 12d0b4b738 detect and handle task cancellations semi-properly (again) 2021-08-13 02:28:41 -07:00
Connor Olding 3ca869ccad overhaul the try_ip function's async stuff 2021-08-13 02:09:48 -07:00
Connor Olding 55024634f7 add a configurable soft limit to number of DNS connections
yes, i know UDP connections don't technically exist
outside of sockets at the OS level, don't @ me.
2021-08-13 00:52:10 -07:00
Connor Olding 367329cf8c fix missing handling of deferred IPs 2021-08-12 22:38:19 -07:00
Connor Olding a71d9c33d7 fix stupid and dangerous bugs with sleeps not working 2021-08-12 22:18:57 -07:00
Connor Olding 0b198cc5c0 overhaul the main function's async stuff
after i confirm i didn't break anything,
next up is the underlying try_ip function.
2021-08-12 21:10:09 -07:00
Connor Olding 788d75a5e9 reduce domain cutting from 100 to 99 2021-08-11 18:57:51 -07:00
Connor Olding a1a405220e bump python requirement to 3.9 for my own sanity 2021-08-11 18:56:15 -07:00
Connor Olding 7a1a728a5a generate different, pseudo-random subdomains every week 2021-08-11 18:56:15 -07:00
Connor Olding d2d4917a53 detect and handle task cancellations semi-properly 2021-08-11 18:56:15 -07:00
Connor Olding 7d2637c1ad remove a couple unused imports 2021-08-09 08:10:07 -07:00
Connor Olding 9defbc8da0 switch from storm to sqlalchemy 2021-08-07 10:53:58 -07:00
Connor Olding 1395e7d6f6 detect blocks that self-redirect 2021-08-06 14:22:27 -07:00
Connor Olding 5804ad6145 use fancy dict syntax 2021-06-27 17:06:48 +02:00
Connor Olding d24831a233 fix assert 2021-06-27 17:06:41 +02:00
Connor Olding 848d5791ed fix some general awfulness with http header handling 2021-06-27 16:06:36 +02:00
Connor Olding f0e6f2d6da add a mode to update country codes of all known IPs 2021-06-09 11:00:54 +02:00
Connor Olding 40ddd264fb fix top1m unzipping 2021-06-09 10:59:55 +02:00
Connor Olding 27ee8c1081 add a few comments 2021-06-09 10:58:45 +02:00
Connor Olding 24c24f4690 update checks for 2021 2021-06-09 10:58:28 +02:00
Connor Olding 239dd6bda4 update GFW IPs 2020-09-08 13:25:45 +02:00
Connor Olding 41e489671f use argparse's built-in mutually exclusive groups 2020-09-08 13:09:29 +02:00
Connor Olding e1ff8918cc add --first and --debug flags 2020-09-08 12:54:33 +02:00
Connor Olding 1c1a5e7992 update china IPs 2020-09-07 10:02:30 +02:00
Connor Olding a3cd1a8de5 update failure counts 2020-09-07 10:02:20 +02:00
Connor Olding 4511eadb73 remove unused field 2020-09-06 12:13:39 +02:00
Connor Olding d380e3a065 add a couple checks via public-dns.info 2020-09-06 12:13:39 +02:00
Connor Olding 73f4ca2b53 invert bad conditional 2020-09-06 12:13:39 +02:00
Connor Olding 6d6c2d52cd only flush ip info occasionally 2020-09-05 04:09:21 +02:00
Connor Olding c65b465560 make country code lookup a background task 2020-09-05 03:45:05 +02:00
Connor Olding 52f315b395 require python 3.8 or greater
3.7 was my previous target, but 3.8 has been out for a while.
plus, i'm not planning on releasing this for a while,
so i can do what i want.
2020-09-05 03:35:51 +02:00
Connor Olding 8dba94b61a remove old comment 2020-09-05 03:13:28 +02:00
Connor Olding 8dc6b5bf98 add flag for enabling all checks 2020-09-04 16:17:32 +02:00
Connor Olding 49ad63750e enable archive.is again but as a new "ignore" group 2020-09-04 16:16:59 +02:00
Connor Olding 2b8f1dacc7 merge arrays of Checks and partition by failures 2020-09-04 16:07:53 +02:00
Connor Olding 788648aeb0 fix style 2020-09-04 15:49:21 +02:00
Connor Olding 74f96f5c99 update GFW IPs 2020-09-04 15:42:56 +02:00
Connor Olding f6e3a28aff add failures field to Check and sort by them
this commit removes the comments on individual checks.
these comments should be restored at a later point.
2020-09-04 15:39:08 +02:00
Connor Olding 35f2ce9206 add newline for pycodestyle 2020-09-04 15:34:29 +02:00
Connor Olding a8a7b9e7b8 deduplicate main loop 2020-09-04 15:08:03 +02:00
Connor Olding 93cf742971 tweak defaults to do more IPs simultaneously with less delay 2020-09-04 15:02:18 +02:00