Commit graph

Select branches

Hide pull requests

master

Mono Color

• c95b6ba0e1 use an alternative to the now-defunct Alexa top-1m master Connor Olding 2023-11-08 05:53:08 -08:00
• e9a36ed397 tweak known IPs (edited months ago) Connor Olding 2022-01-19 14:37:11 -08:00
• 99b6ed3045 tweak ip-api cooldown (again) Connor Olding 2021-08-14 17:42:59 -07:00
• 44e2a491a0 merge a couple lines Connor Olding 2021-08-14 17:42:22 -07:00
• 6508ee1210 rewrite rate-limiter to not create any tasks Connor Olding 2021-08-14 00:40:38 -07:00
• ffbdf50674 remove number from program name (an ancient artifact) Connor Olding 2021-08-13 03:06:39 -07:00
• b78081b65d fix all_ips method Connor Olding 2021-08-13 02:38:36 -07:00
• 477f983145 tweak ip-api cooldown Connor Olding 2021-08-13 02:35:05 -07:00
• f1a5cbe69f clean up some commented-out stuff Connor Olding 2021-08-13 02:32:21 -07:00
• 12d0b4b738 detect and handle task cancellations semi-properly (again) Connor Olding 2021-08-13 02:28:41 -07:00
• 3ca869ccad overhaul the try_ip function's async stuff Connor Olding 2021-08-13 02:09:01 -07:00
• 55024634f7 add a configurable soft limit to number of DNS connections Connor Olding 2021-08-13 00:52:10 -07:00
• 367329cf8c fix missing handling of deferred IPs Connor Olding 2021-08-12 22:36:59 -07:00
• a71d9c33d7 fix stupid and dangerous bugs with sleeps not working Connor Olding 2021-08-12 22:15:18 -07:00
• 0b198cc5c0 overhaul the main function's async stuff Connor Olding 2021-08-12 21:06:00 -07:00
• 788d75a5e9 reduce domain cutting from 100 to 99 Connor Olding 2021-08-11 18:57:51 -07:00
• a1a405220e bump python requirement to 3.9 for my own sanity Connor Olding 2021-08-11 18:52:46 -07:00
• 7a1a728a5a generate different, pseudo-random subdomains every week Connor Olding 2021-08-11 18:50:47 -07:00
• d2d4917a53 detect and handle task cancellations semi-properly Connor Olding 2021-08-11 18:49:47 -07:00
• 7d2637c1ad remove a couple unused imports Connor Olding 2021-08-09 08:10:07 -07:00
• 9defbc8da0 switch from storm to sqlalchemy Connor Olding 2021-08-06 18:14:17 -07:00
• 1395e7d6f6 detect blocks that self-redirect Connor Olding 2021-08-06 14:22:27 -07:00
• 5804ad6145 use fancy dict syntax Connor Olding 2021-06-27 17:06:48 +02:00
• d24831a233 fix assert Connor Olding 2021-06-27 17:06:41 +02:00
• 848d5791ed fix some general awfulness with http header handling Connor Olding 2021-06-27 16:06:36 +02:00
• f0e6f2d6da add a mode to update country codes of all known IPs Connor Olding 2021-06-09 11:00:54 +02:00
• 40ddd264fb fix top1m unzipping Connor Olding 2021-06-09 10:59:55 +02:00
• 27ee8c1081 add a few comments Connor Olding 2021-06-09 10:58:45 +02:00
• 24c24f4690 update checks for 2021 Connor Olding 2021-06-09 10:57:12 +02:00
• 239dd6bda4 update GFW IPs Connor Olding 2020-09-08 13:25:45 +02:00
• 41e489671f use argparse's built-in mutually exclusive groups Connor Olding 2020-09-08 13:09:29 +02:00
• e1ff8918cc add --first and --debug flags Connor Olding 2020-09-08 12:54:13 +02:00
• 1c1a5e7992 update china IPs Connor Olding 2020-09-07 10:02:30 +02:00
• a3cd1a8de5 update failure counts Connor Olding 2020-09-07 10:02:20 +02:00
• 4511eadb73 remove unused field Connor Olding 2020-09-06 09:09:04 +02:00
• d380e3a065 add a couple checks via public-dns.info Connor Olding 2020-09-06 06:22:11 +02:00
• 73f4ca2b53 invert bad conditional Connor Olding 2020-09-05 15:40:15 +02:00
• 6d6c2d52cd only flush ip info occasionally Connor Olding 2020-09-05 04:09:21 +02:00
• c65b465560 make country code lookup a background task Connor Olding 2020-09-05 03:45:05 +02:00
• 52f315b395 require python 3.8 or greater Connor Olding 2020-09-05 03:35:51 +02:00
• 8dba94b61a remove old comment Connor Olding 2020-09-05 03:13:28 +02:00
• 8dc6b5bf98 add flag for enabling all checks Connor Olding 2020-09-04 16:17:32 +02:00
• 49ad63750e enable archive.is again but as a new "ignore" group Connor Olding 2020-09-04 16:16:59 +02:00
• 2b8f1dacc7 merge arrays of Checks and partition by failures Connor Olding 2020-09-04 16:06:37 +02:00
• 788648aeb0 fix style Connor Olding 2020-09-04 15:49:21 +02:00
• 74f96f5c99 update GFW IPs Connor Olding 2020-09-04 15:42:56 +02:00
• f6e3a28aff add failures field to Check and sort by them Connor Olding 2020-09-04 15:39:08 +02:00
• 35f2ce9206 add newline for pycodestyle Connor Olding 2020-09-04 15:34:29 +02:00
• a8a7b9e7b8 deduplicate main loop Connor Olding 2020-09-04 15:07:48 +02:00
• 93cf742971 tweak defaults to do more IPs simultaneously with less delay Connor Olding 2020-09-04 15:02:18 +02:00
• d659763672 move blocking_file_io into Options Connor Olding 2020-09-04 15:01:58 +02:00
• 921c51e118 match IPs more robustly and multiple per line Connor Olding 2020-09-04 14:48:23 +02:00
• 70308230e6 write and use async iterator for IpReader Connor Olding 2020-09-04 14:15:21 +02:00
• 853d25c51a always accumulate as much as possible Connor Olding 2020-09-04 13:50:08 +02:00
• b26a4e7646 rewrite IpReader iterator to accumulate IPs before yielding Connor Olding 2020-09-04 13:36:59 +02:00
• e6c080bf32 support reading IPs from multiple files at once Connor Olding 2020-09-04 13:09:49 +02:00
• 92ee219ffc make database syncing asynchronous Connor Olding 2020-09-04 13:08:04 +02:00
• db9eb0236b replace some IPs with a single subnet check Connor Olding 2020-09-03 15:02:59 +02:00
• 989304a7e9 update GFW IPs Connor Olding 2020-09-03 13:49:10 +02:00
• 94d2c0c112 remove "new" checks Connor Olding 2020-09-03 13:31:40 +02:00
• 08b6b775e2 reword the comment on censorship Connor Olding 2020-09-03 13:31:21 +02:00
• 1ee3ccf724 only add a couple IPs and no kinds during database creation Connor Olding 2020-09-03 13:24:38 +02:00
• d8fb3b5e62 add Failed column to view Connor Olding 2020-09-03 13:16:58 +02:00
• 134e87cb4b update China IPs Connor Olding 2020-09-03 13:08:19 +02:00
• 3a3c1340a9 assume IP info is the same for any /24 subnet Connor Olding 2020-09-03 12:57:05 +02:00
• 0603081c49 rewrite ipinfo into a class Connor Olding 2020-09-03 12:41:47 +02:00
• d0d29bd0d4 improve approximate duration of one month Connor Olding 2020-09-03 11:33:25 +02:00
• 51df54be80 add country code column with remote lookup Connor Olding 2020-09-03 11:28:38 +02:00
• 24338417a8 split and abstract block ranges into a function Connor Olding 2020-09-03 11:23:20 +02:00
• 1c85e7b329 increase default timeout duration Connor Olding 2020-09-02 10:38:38 +02:00
• a0ad19ed54 update GFW IPs again Connor Olding 2020-09-02 09:16:26 +02:00
• 3a09d52345 update GFW IPs Connor Olding 2020-09-02 00:51:34 +02:00
• d64db84783 write comment about a shock domain being parked Connor Olding 2020-09-01 08:25:59 +02:00
• 660e37f8e3 add one more known blocking IP Connor Olding 2020-09-01 08:25:02 +02:00
• 9a3598b599 fix pooler so finisher is optional Connor Olding 2020-09-01 08:22:05 +02:00
• 3b31919f75 add more known GFW and China IPs Connor Olding 2020-09-01 08:20:48 +02:00
• f3255fb1ba add a ton more known blocking IPs Connor Olding 2020-08-31 15:06:41 +02:00
• 8dd0dbd382 remove needless comments from blocking IPs Connor Olding 2020-08-31 13:59:28 +02:00
• 484de18d46 superficial cleanup Connor Olding 2020-08-30 12:19:42 +02:00
• ca136b65a3 add Failed column to Messages table Connor Olding 2020-08-30 02:30:52 +02:00
• de0d8f73f0 disable archive.is once more Connor Olding 2020-08-29 15:44:16 +02:00
• 0b007120d8 fix code broken by previous commit Connor Olding 2020-08-29 15:38:29 +02:00
• bdb2a88f40 abide to PEP 808 (passes pycodestyle) Connor Olding 2020-08-29 15:34:46 +02:00
• 2a00288a9c even more reorganization Connor Olding 2020-08-29 15:13:59 +02:00
• 85045f397f further reorganization Connor Olding 2020-08-29 15:04:56 +02:00
• ecb2596090 begin reorganizing code Connor Olding 2020-08-29 14:54:07 +02:00
• 6c516f53f3 update ignores Connor Olding 2020-08-29 10:30:00 +02:00
• 93e7fa3431 reorganize checks Connor Olding 2020-08-29 10:28:26 +02:00
• 3afeb5a3fd init Connor Olding 2020-08-29 10:16:06 +02:00