Commit graph

68 commits

Author SHA1 Message Date
1395e7d6f6 detect blocks that self-redirect 2021-08-06 14:22:27 -07:00
5804ad6145 use fancy dict syntax 2021-06-27 17:06:48 +02:00
d24831a233 fix assert 2021-06-27 17:06:41 +02:00
848d5791ed fix some general awfulness with http header handling 2021-06-27 16:06:36 +02:00
f0e6f2d6da add a mode to update country codes of all known IPs 2021-06-09 11:00:54 +02:00
40ddd264fb fix top1m unzipping 2021-06-09 10:59:55 +02:00
27ee8c1081 add a few comments 2021-06-09 10:58:45 +02:00
24c24f4690 update checks for 2021 2021-06-09 10:58:28 +02:00
239dd6bda4 update GFW IPs 2020-09-08 13:25:45 +02:00
41e489671f use argparse's built-in mutually exclusive groups 2020-09-08 13:09:29 +02:00
e1ff8918cc add --first and --debug flags 2020-09-08 12:54:33 +02:00
1c1a5e7992 update china IPs 2020-09-07 10:02:30 +02:00
a3cd1a8de5 update failure counts 2020-09-07 10:02:20 +02:00
4511eadb73 remove unused field 2020-09-06 12:13:39 +02:00
d380e3a065 add a couple checks via public-dns.info 2020-09-06 12:13:39 +02:00
73f4ca2b53 invert bad conditional 2020-09-06 12:13:39 +02:00
6d6c2d52cd only flush ip info occasionally 2020-09-05 04:09:21 +02:00
c65b465560 make country code lookup a background task 2020-09-05 03:45:05 +02:00
52f315b395 require python 3.8 or greater
3.7 was my previous target, but 3.8 has been out for a while.
plus, i'm not planning on releasing this for a while,
so i can do what i want.
2020-09-05 03:35:51 +02:00
8dba94b61a remove old comment 2020-09-05 03:13:28 +02:00
8dc6b5bf98 add flag for enabling all checks 2020-09-04 16:17:32 +02:00
49ad63750e enable archive.is again but as a new "ignore" group 2020-09-04 16:16:59 +02:00
2b8f1dacc7 merge arrays of Checks and partition by failures 2020-09-04 16:07:53 +02:00
788648aeb0 fix style 2020-09-04 15:49:21 +02:00
74f96f5c99 update GFW IPs 2020-09-04 15:42:56 +02:00
f6e3a28aff add failures field to Check and sort by them
this commit removes the comments on individual checks.
these comments should be restored at a later point.
2020-09-04 15:39:08 +02:00
35f2ce9206 add newline for pycodestyle 2020-09-04 15:34:29 +02:00
a8a7b9e7b8 deduplicate main loop 2020-09-04 15:08:03 +02:00
93cf742971 tweak defaults to do more IPs simultaneously with less delay 2020-09-04 15:02:18 +02:00
d659763672 move blocking_file_io into Options 2020-09-04 15:01:58 +02:00
921c51e118 match IPs more robustly and multiple per line 2020-09-04 14:48:23 +02:00
70308230e6 write and use async iterator for IpReader
also fixes the counter in the blocking version when progress is enabled
2020-09-04 14:17:04 +02:00
853d25c51a always accumulate as much as possible 2020-09-04 13:50:08 +02:00
b26a4e7646 rewrite IpReader iterator to accumulate IPs before yielding
still needs work
2020-09-04 13:36:59 +02:00
e6c080bf32 support reading IPs from multiple files at once
this also adds the progress flag that was missing previously.
2020-09-04 13:09:49 +02:00
92ee219ffc make database syncing asynchronous 2020-09-04 13:08:04 +02:00
db9eb0236b replace some IPs with a single subnet check 2020-09-03 15:02:59 +02:00
989304a7e9 update GFW IPs 2020-09-03 13:49:19 +02:00
94d2c0c112 remove "new" checks 2020-09-03 13:31:40 +02:00
08b6b775e2 reword the comment on censorship 2020-09-03 13:31:21 +02:00
1ee3ccf724 only add a couple IPs and no kinds during database creation 2020-09-03 13:24:38 +02:00
d8fb3b5e62 add Failed column to view 2020-09-03 13:16:58 +02:00
134e87cb4b update China IPs 2020-09-03 13:08:30 +02:00
3a3c1340a9 assume IP info is the same for any /24 subnet 2020-09-03 12:57:09 +02:00
0603081c49 rewrite ipinfo into a class 2020-09-03 12:41:47 +02:00
d0d29bd0d4 improve approximate duration of one month
what a silly-sounding commit message
2020-09-03 11:37:28 +02:00
51df54be80 add country code column with remote lookup
this needs work
2020-09-03 11:28:38 +02:00
24338417a8 split and abstract block ranges into a function 2020-09-03 11:24:39 +02:00
1c85e7b329 increase default timeout duration 2020-09-02 10:38:38 +02:00
a0ad19ed54 update GFW IPs again 2020-09-02 09:16:26 +02:00