Commit Graph

63 Commits

Author SHA1 Message Date
Connor Olding 40ddd264fb fix top1m unzipping 2021-06-09 10:59:55 +02:00
Connor Olding 27ee8c1081 add a few comments 2021-06-09 10:58:45 +02:00
Connor Olding 24c24f4690 update checks for 2021 2021-06-09 10:58:28 +02:00
Connor Olding 239dd6bda4 update GFW IPs 2020-09-08 13:25:45 +02:00
Connor Olding 41e489671f use argparse's built-in mutually exclusive groups 2020-09-08 13:09:29 +02:00
Connor Olding e1ff8918cc add --first and --debug flags 2020-09-08 12:54:33 +02:00
Connor Olding 1c1a5e7992 update china IPs 2020-09-07 10:02:30 +02:00
Connor Olding a3cd1a8de5 update failure counts 2020-09-07 10:02:20 +02:00
Connor Olding 4511eadb73 remove unused field 2020-09-06 12:13:39 +02:00
Connor Olding d380e3a065 add a couple checks via public-dns.info 2020-09-06 12:13:39 +02:00
Connor Olding 73f4ca2b53 invert bad conditional 2020-09-06 12:13:39 +02:00
Connor Olding 6d6c2d52cd only flush ip info occasionally 2020-09-05 04:09:21 +02:00
Connor Olding c65b465560 make country code lookup a background task 2020-09-05 03:45:05 +02:00
Connor Olding 52f315b395 require python 3.8 or greater
3.7 was my previous target, but 3.8 has been out for a while.
plus, i'm not planning on releasing this for a while,
so i can do what i want.
2020-09-05 03:35:51 +02:00
Connor Olding 8dba94b61a remove old comment 2020-09-05 03:13:28 +02:00
Connor Olding 8dc6b5bf98 add flag for enabling all checks 2020-09-04 16:17:32 +02:00
Connor Olding 49ad63750e enable archive.is again but as a new "ignore" group 2020-09-04 16:16:59 +02:00
Connor Olding 2b8f1dacc7 merge arrays of Checks and partition by failures 2020-09-04 16:07:53 +02:00
Connor Olding 788648aeb0 fix style 2020-09-04 15:49:21 +02:00
Connor Olding 74f96f5c99 update GFW IPs 2020-09-04 15:42:56 +02:00
Connor Olding f6e3a28aff add failures field to Check and sort by them
this commit removes the comments on individual checks.
these comments should be restored at a later point.
2020-09-04 15:39:08 +02:00
Connor Olding 35f2ce9206 add newline for pycodestyle 2020-09-04 15:34:29 +02:00
Connor Olding a8a7b9e7b8 deduplicate main loop 2020-09-04 15:08:03 +02:00
Connor Olding 93cf742971 tweak defaults to do more IPs simultaneously with less delay 2020-09-04 15:02:18 +02:00
Connor Olding d659763672 move blocking_file_io into Options 2020-09-04 15:01:58 +02:00
Connor Olding 921c51e118 match IPs more robustly and multiple per line 2020-09-04 14:48:23 +02:00
Connor Olding 70308230e6 write and use async iterator for IpReader
also fixes the counter in the blocking version when progress is enabled
2020-09-04 14:17:04 +02:00
Connor Olding 853d25c51a always accumulate as much as possible 2020-09-04 13:50:08 +02:00
Connor Olding b26a4e7646 rewrite IpReader iterator to accumulate IPs before yielding
still needs work
2020-09-04 13:36:59 +02:00
Connor Olding e6c080bf32 support reading IPs from multiple files at once
this also adds the progress flag that was missing previously.
2020-09-04 13:09:49 +02:00
Connor Olding 92ee219ffc make database syncing asynchronous 2020-09-04 13:08:04 +02:00
Connor Olding db9eb0236b replace some IPs with a single subnet check 2020-09-03 15:02:59 +02:00
Connor Olding 989304a7e9 update GFW IPs 2020-09-03 13:49:19 +02:00
Connor Olding 94d2c0c112 remove "new" checks 2020-09-03 13:31:40 +02:00
Connor Olding 08b6b775e2 reword the comment on censorship 2020-09-03 13:31:21 +02:00
Connor Olding 1ee3ccf724 only add a couple IPs and no kinds during database creation 2020-09-03 13:24:38 +02:00
Connor Olding d8fb3b5e62 add Failed column to view 2020-09-03 13:16:58 +02:00
Connor Olding 134e87cb4b update China IPs 2020-09-03 13:08:30 +02:00
Connor Olding 3a3c1340a9 assume IP info is the same for any /24 subnet 2020-09-03 12:57:09 +02:00
Connor Olding 0603081c49 rewrite ipinfo into a class 2020-09-03 12:41:47 +02:00
Connor Olding d0d29bd0d4 improve approximate duration of one month
what a silly-sounding commit message
2020-09-03 11:37:28 +02:00
Connor Olding 51df54be80 add country code column with remote lookup
this needs work
2020-09-03 11:28:38 +02:00
Connor Olding 24338417a8 split and abstract block ranges into a function 2020-09-03 11:24:39 +02:00
Connor Olding 1c85e7b329 increase default timeout duration 2020-09-02 10:38:38 +02:00
Connor Olding a0ad19ed54 update GFW IPs again 2020-09-02 09:16:26 +02:00
Connor Olding 3a09d52345 update GFW IPs 2020-09-02 00:51:34 +02:00
Connor Olding d64db84783 write comment about a shock domain being parked 2020-09-01 08:31:35 +02:00
Connor Olding 660e37f8e3 add one more known blocking IP 2020-09-01 08:31:32 +02:00
Connor Olding 9a3598b599 fix pooler so finisher is optional 2020-09-01 08:31:27 +02:00
Connor Olding 3b31919f75 add more known GFW and China IPs 2020-09-01 08:30:53 +02:00