Commit Graph

86 Commits

Author SHA1 Message Date
Connor Olding 70308230e6 write and use async iterator for IpReader
also fixes the counter in the blocking version when progress is enabled
2020-09-04 14:17:04 +02:00
Connor Olding 853d25c51a always accumulate as much as possible 2020-09-04 13:50:08 +02:00
Connor Olding b26a4e7646 rewrite IpReader iterator to accumulate IPs before yielding
still needs work
2020-09-04 13:36:59 +02:00
Connor Olding e6c080bf32 support reading IPs from multiple files at once
this also adds the progress flag that was missing previously.
2020-09-04 13:09:49 +02:00
Connor Olding 92ee219ffc make database syncing asynchronous 2020-09-04 13:08:04 +02:00
Connor Olding db9eb0236b replace some IPs with a single subnet check 2020-09-03 15:02:59 +02:00
Connor Olding 989304a7e9 update GFW IPs 2020-09-03 13:49:19 +02:00
Connor Olding 94d2c0c112 remove "new" checks 2020-09-03 13:31:40 +02:00
Connor Olding 08b6b775e2 reword the comment on censorship 2020-09-03 13:31:21 +02:00
Connor Olding 1ee3ccf724 only add a couple IPs and no kinds during database creation 2020-09-03 13:24:38 +02:00
Connor Olding d8fb3b5e62 add Failed column to view 2020-09-03 13:16:58 +02:00
Connor Olding 134e87cb4b update China IPs 2020-09-03 13:08:30 +02:00
Connor Olding 3a3c1340a9 assume IP info is the same for any /24 subnet 2020-09-03 12:57:09 +02:00
Connor Olding 0603081c49 rewrite ipinfo into a class 2020-09-03 12:41:47 +02:00
Connor Olding d0d29bd0d4 improve approximate duration of one month
what a silly-sounding commit message
2020-09-03 11:37:28 +02:00
Connor Olding 51df54be80 add country code column with remote lookup
this needs work
2020-09-03 11:28:38 +02:00
Connor Olding 24338417a8 split and abstract block ranges into a function 2020-09-03 11:24:39 +02:00
Connor Olding 1c85e7b329 increase default timeout duration 2020-09-02 10:38:38 +02:00
Connor Olding a0ad19ed54 update GFW IPs again 2020-09-02 09:16:26 +02:00
Connor Olding 3a09d52345 update GFW IPs 2020-09-02 00:51:34 +02:00
Connor Olding d64db84783 write comment about a shock domain being parked 2020-09-01 08:31:35 +02:00
Connor Olding 660e37f8e3 add one more known blocking IP 2020-09-01 08:31:32 +02:00
Connor Olding 9a3598b599 fix pooler so finisher is optional 2020-09-01 08:31:27 +02:00
Connor Olding 3b31919f75 add more known GFW and China IPs 2020-09-01 08:30:53 +02:00
Connor Olding f3255fb1ba add a ton more known blocking IPs 2020-08-31 15:06:41 +02:00
Connor Olding 8dd0dbd382 remove needless comments from blocking IPs 2020-08-31 13:59:28 +02:00
Connor Olding 484de18d46 superficial cleanup 2020-08-30 12:19:42 +02:00
Connor Olding ca136b65a3 add Failed column to Messages table 2020-08-30 02:30:52 +02:00
Connor Olding de0d8f73f0 disable archive.is once more 2020-08-29 15:44:16 +02:00
Connor Olding 0b007120d8 fix code broken by previous commit 2020-08-29 15:38:29 +02:00
Connor Olding bdb2a88f40 abide to PEP 808 (passes pycodestyle) 2020-08-29 15:34:46 +02:00
Connor Olding 2a00288a9c even more reorganization 2020-08-29 15:13:59 +02:00
Connor Olding 85045f397f further reorganization 2020-08-29 15:04:56 +02:00
Connor Olding ecb2596090 begin reorganizing code 2020-08-29 14:54:07 +02:00
Connor Olding 93e7fa3431 reorganize checks 2020-08-29 10:28:26 +02:00
Connor Olding 3afeb5a3fd init 2020-08-29 10:16:06 +02:00