This simple tutorial permit to grab checked proxies of the type you want. Easy to automate with cron task for example and so obtain your own proxy provider.
As usual, this tutorial is made for Linux users, espcially Debian ones. If you want to use Windows, you must setup your env by yourself.
Dependencies: https://github.com/constverum/ProxyBroker
Setup:
1) Clone the git repo:
2) Install pip for Python3:
3) Install setuptools package with pip3:
4) Launch the installation:
5) Remove the repo folder:
Documentation:
1) Global:
2) Find process only:
Examples of usage:
Grab SOCKS5:
Result:
Grab 100 HTTP from US with Anonymous or High quality grade:
Result:
Extras:
If you want to use the default curl template for proxies, you can process like that for example.
For SOCKS5:
Result:
For HTTP:
Result:
Enjoy !
As usual, this tutorial is made for Linux users, espcially Debian ones. If you want to use Windows, you must setup your env by yourself.
Dependencies: https://github.com/constverum/ProxyBroker
Setup:
1) Clone the git repo:
Code:
git clone https://github.com/constverum/ProxyBroker
2) Install pip for Python3:
Code:
apt install python3-pip
3) Install setuptools package with pip3:
Code:
pip3 install setuptools
4) Launch the installation:
Code:
python3 ProxyBroker/setup.py install
5) Remove the repo folder:
Code:
rm -R ProxyBroker
Documentation:
1) Global:
Code:
usage: proxybroker [--max-conn MAX_CONN] [--max-tries MAX_TRIES]
[--timeout SECONDS] [--judge JUDGES] [--provider PROVIDERS]
[--verify-ssl]
[--log [{NOTSET,DEBUG,INFO,WARNING,ERROR,CRITICAL}]]
[--version] [--help]
{find,grab,serve,update-geo} ...
Proxy [Finder | Checker | Server]
Commands:
These are common commands used in various situations
{find,grab,serve,update-geo}
find Find and check proxies
grab Find proxies without a check
serve Run a local proxy server
update-geo Download and use a detailed GeoIP database
Options:
--max-conn MAX_CONN The maximum number of concurrent checks of proxies
--max-tries MAX_TRIES
The maximum number of attempts to check a proxy
--timeout SECONDS, -t SECONDS
Timeout of a request in seconds. The default value is
8 seconds
--judge JUDGES Urls of pages that show HTTP headers and IP address
--provider PROVIDERS Urls of pages where to find proxies
--verify-ssl, -ssl Flag indicating whether to check the SSL certificates
--log [{NOTSET,DEBUG,INFO,WARNING,ERROR,CRITICAL}]
Logging level
--version, -v Show program's version number and exit
--help, -h Show this help message and exit
Run 'proxybroker <command> --help' for more information on a command.
Suggestions and bug reports are greatly appreciated:
https://github.com/constverum/ProxyBroker/issues
2) Find process only:
Code:
usage: proxybroker find --types
{HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25}
[{HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} ...]
[--lvl {Transparent,Anonymous,High} [{Transparent,Anonymous,High} ...]]
[--data DATA] [--dnsbl DNSBL [DNSBL ...]] [--post]
[--strict] [--countries COUNTRIES [COUNTRIES ...]]
[--limit LIMIT] [--outfile OUTFILE]
[--format [FORMAT]] [--show-stats] [--help]
Find and check proxies with specified parameters
Options:
--types {HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} [{HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} ...]
Type(s) (protocols) that need to be check on support
by proxy
--lvl {Transparent,Anonymous,High} [{Transparent,Anonymous,High} ...]
Level(s) of anonymity (for HTTP only). By default, any
level
--data DATA Path to the file with proxies. If specified, used
instead of providers
--dnsbl DNSBL [DNSBL ...]
Spam databases for proxy checking
--post Flag indicating use POST instead of GET for requests
when checking proxies
--strict, -s Flag indicating that anonymity levels of the types
(protocols) supported by a proxy must be equal to the
requested types and levels of anonymity
--countries COUNTRIES [COUNTRIES ...], -c COUNTRIES [COUNTRIES ...]
List of ISO country codes where should be located
proxies
--limit LIMIT, -l LIMIT
The maximum number of working proxies
--outfile OUTFILE, -o OUTFILE
Save found proxies to file. By default, output to
console
--format [FORMAT], -f [FORMAT]
Flag indicating in what format the results will be
presented. Available formats: default and json
--show-stats Flag indicating whether to print verbose stats
--help, -h Show this help message and exit
Examples of usage:
Grab SOCKS5:
Code:
proxybroker find --types SOCKS5
Result:
Code:
<Proxy US 0.18s [SOCKS5] 96.96.1.165:1080>
<Proxy US 0.19s [SOCKS5] 96.44.133.110:58690>
<Proxy US 0.29s [SOCKS5] 72.210.252.143:46173>
<Proxy US 0.32s [SOCKS5] 208.113.222.239:45363>
<Proxy US 0.33s [SOCKS5] 208.113.152.215:44297>
<Proxy US 0.40s [SOCKS5] 72.210.252.152:46154>
<Proxy US 0.43s [SOCKS5] 173.245.239.177:16964>
<Proxy US 0.44s [SOCKS5] 96.113.166.133:1080>
<Proxy US 0.44s [SOCKS5] 66.110.216.105:39431>
<Proxy US 0.45s [SOCKS5] 96.96.33.133:1080>
<Proxy US 0.46s [SOCKS5] 98.143.145.30:62353>
<Proxy US 0.54s [SOCKS5] 192.169.139.161:8975>
<Proxy US 0.55s [SOCKS5] 184.185.2.146:47659>
<Proxy GR 0.57s [SOCKS5] 178.128.154.236:45761>
<Proxy US 0.58s [SOCKS5] 208.113.153.22:13361>
<Proxy US 0.58s [SOCKS5] 96.44.183.149:55225>
<Proxy US 0.59s [SOCKS5] 208.113.223.164:13361>
<Proxy US 0.61s [SOCKS5] 66.33.210.85:14148>
<Proxy US 0.61s [SOCKS5] 66.110.216.221:39603>
<Proxy US 0.62s [SOCKS5] 174.76.35.7:36171>
<Proxy US 0.62s [SOCKS5] 66.33.214.101:13959>
<Proxy US 0.64s [SOCKS5] 66.33.212.17:13959>
<Proxy US 0.63s [SOCKS5] 208.109.52.52:64783>
<Proxy US 0.64s [SOCKS5] 66.135.227.178:4145>
Grab 100 HTTP from US with Anonymous or High quality grade:
Code:
proxybroker find --types HTTP --lvl Anonymous High --countries US -l 100
Result:
Code:
<Proxy US 0.21s [HTTP: High] 23.235.228.204:8080>
<Proxy US 0.13s [HTTP: High] 206.189.202.230:80>
<Proxy US 0.21s [HTTP: High] 161.156.69.189:3128>
<Proxy US 0.08s [HTTP: High] 134.122.75.190:8080>
<Proxy US 0.17s [HTTP: High] 23.102.166.13:3128>
<Proxy US 0.21s [HTTP: High] 157.245.136.101:8080>
<Proxy US 0.22s [HTTP: High] 52.179.231.206:80>
<Proxy US 0.23s [HTTP: High] 165.227.182.151:8888>
<Proxy US 0.22s [HTTP: High] 192.241.245.207:3128>
<Proxy US 0.39s [HTTP: High] 174.138.54.49:8080>
<Proxy US 0.40s [HTTP: High] 165.227.215.71:8080>
<Proxy US 0.41s [HTTP: Anonymous] 165.22.41.190:80>
<Proxy US 0.56s [HTTP: High] 165.227.84.169:80>
<Proxy US 0.71s [HTTP: Anonymous] 196.52.80.75:80>
<Proxy US 0.64s [HTTP: High] 173.249.44.18:3128>
<Proxy US 1.80s [HTTP: High] 134.209.44.228:80>
<Proxy US 2.36s [HTTP: High] 96.87.184.101:43705>
Extras:
If you want to use the default curl template for proxies, you can process like that for example.
For SOCKS5:
Code:
proxybroker find --types SOCKS5 -l 25 | cut -d' ' -f5 | cut -d'>' -f1 | sed 's;^;socks5://;'
Result:
Code:
socks5://96.96.1.165:1080
socks5://96.113.166.133:1080
socks5://96.96.33.133:1080
socks5://208.113.222.239:45363
socks5://178.128.154.236:24629
socks5://72.221.164.35:60670
socks5://208.113.154.22:56365
socks5://173.245.239.12:17145
socks5://98.174.90.36:14474
socks5://96.44.133.110:58690
socks5://184.185.2.146:47659
socks5://173.245.239.177:16964
socks5://178.128.154.236:45761
socks5://208.113.152.215:44297
socks5://174.76.35.15:36163
socks5://69.163.160.197:50301
socks5://66.33.212.17:13959
socks5://98.181.99.197:10368
socks5://69.61.200.104:36181
socks5://174.76.48.233:4145
socks5://64.90.49.250:36596
socks5://66.110.216.105:39431
socks5://174.70.241.14:24392
socks5://208.109.52.52:64783
socks5://142.93.51.220:31651
For HTTP:
Code:
proxybroker find --types HTTP --lvl Anonymous High -l 50 | cut -d' ' -f6 | cut -d'>' -f1 | sed 's;^;http://;'
Result:
Code:
http://178.93.32.237:36636
http://23.235.228.204:8080
http://171.96.113.43:8118
http://212.220.216.70:8080
http://113.53.230.167:80
http://103.28.121.58:80
http://139.99.105.186:80
http://200.89.178.229:8080
http://195.181.210.160:8080
http://101.4.136.34:81
http://212.227.11.130:80
http://179.127.243.1:49465
http://187.111.160.29:40098
http://84.244.8.170:53281
http://200.73.128.5:8080
http://176.28.75.193:53737
http://182.48.81.222:46157
http://46.235.53.26:3128
http://220.247.174.13:32355
http://41.164.247.186:53281
http://117.196.236.219:47916
http://103.194.248.166:34448
http://113.53.91.12:53281
http://200.89.178.196:8080
http://1.20.97.122:44279
http://103.102.28.134:38166
http://118.174.220.152:31701
http://185.112.35.27:31696
http://77.66.203.114:33097
http://77.242.178.47:54669
http://103.212.93.225:53053
http://103.212.93.209:53053
http://200.236.221.242:52426
http://177.136.168.13:43626
http://43.229.26.227:37405
http://185.204.208.78:8080
http://39.137.69.6:80
http://109.167.113.9:59606
http://118.174.220.61:60070
http://115.124.92.154:43520
http://118.99.94.120:30399
http://195.182.22.178:46916
http://155.93.108.170:34997
http://37.120.192.154:8080
http://104.238.187.252:8080
http://186.232.15.9:45849
http://191.37.183.209:60139
http://1.20.101.221:55707
http://114.134.172.50:60664
http://182.52.51.43:49699
Enjoy !