ALERT!
Click here to register with a few steps and explore all our cool stuff we have to offer!
Home
Upgrade
Credits
Help
Search
Awards
Achievements
 1014

Get Proxies ( HTTP / HTTPS / SOCKS4 / SOCKS5 ) for Free

by Mizu - 03-24-2020 - 03:06 AM
#1
This simple tutorial permit to grab checked proxies of the type you want. Easy to automate with cron task for example and so obtain your own proxy provider.

As usual, this tutorial is made for Linux users, espcially Debian ones. If you want to use Windows, you must setup your env by yourself.

Dependencies: https://github.com/constverum/ProxyBroker

Setup:
1) Clone the git repo:
Code:
git clone https://github.com/constverum/ProxyBroker


2) Install pip for Python3:
Code:
apt install python3-pip


3) Install setuptools package with pip3:
Code:
pip3 install setuptools


4) Launch the installation:
Code:
python3 ProxyBroker/setup.py install


5) Remove the repo folder:
Code:
rm -R ProxyBroker


Documentation:
1) Global:
Code:
usage: proxybroker [--max-conn MAX_CONN] [--max-tries MAX_TRIES]
                  [--timeout SECONDS] [--judge JUDGES] [--provider PROVIDERS]
                  [--verify-ssl]
                  [--log [{NOTSET,DEBUG,INFO,WARNING,ERROR,CRITICAL}]]
                  [--version] [--help]
                  {find,grab,serve,update-geo} ...

Proxy [Finder | Checker | Server]

Commands:
  These are common commands used in various situations

  {find,grab,serve,update-geo}
    find                Find and check proxies
    grab                Find proxies without a check
    serve              Run a local proxy server
    update-geo          Download and use a detailed GeoIP database

Options:
  --max-conn MAX_CONN  The maximum number of concurrent checks of proxies
  --max-tries MAX_TRIES
                        The maximum number of attempts to check a proxy
  --timeout SECONDS, -t SECONDS
                        Timeout of a request in seconds. The default value is
                        8 seconds
  --judge JUDGES        Urls of pages that show HTTP headers and IP address
  --provider PROVIDERS  Urls of pages where to find proxies
  --verify-ssl, -ssl    Flag indicating whether to check the SSL certificates
  --log [{NOTSET,DEBUG,INFO,WARNING,ERROR,CRITICAL}]
                        Logging level
  --version, -v        Show program's version number and exit
  --help, -h            Show this help message and exit

Run 'proxybroker <command> --help' for more information on a command.
Suggestions and bug reports are greatly appreciated:
https://github.com/constverum/ProxyBroker/issues


2) Find process only:
Code:
usage: proxybroker find --types
                        {HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25}
                        [{HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} ...]
                        [--lvl {Transparent,Anonymous,High} [{Transparent,Anonymous,High} ...]]
                        [--data DATA] [--dnsbl DNSBL [DNSBL ...]] [--post]
                        [--strict] [--countries COUNTRIES [COUNTRIES ...]]
                        [--limit LIMIT] [--outfile OUTFILE]
                        [--format [FORMAT]] [--show-stats] [--help]

Find and check proxies with specified parameters

Options:
  --types {HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} [{HTTP,HTTPS,SOCKS4,SOCKS5,CONNECT:80,CONNECT:25} ...]
                        Type(s) (protocols) that need to be check on support
                        by proxy
  --lvl {Transparent,Anonymous,High} [{Transparent,Anonymous,High} ...]
                        Level(s) of anonymity (for HTTP only). By default, any
                        level
  --data DATA          Path to the file with proxies. If specified, used
                        instead of providers
  --dnsbl DNSBL [DNSBL ...]
                        Spam databases for proxy checking
  --post                Flag indicating use POST instead of GET for requests
                        when checking proxies
  --strict, -s          Flag indicating that anonymity levels of the types
                        (protocols) supported by a proxy must be equal to the
                        requested types and levels of anonymity
  --countries COUNTRIES [COUNTRIES ...], -c COUNTRIES [COUNTRIES ...]
                        List of ISO country codes where should be located
                        proxies
  --limit LIMIT, -l LIMIT
                        The maximum number of working proxies
  --outfile OUTFILE, -o OUTFILE
                        Save found proxies to file. By default, output to
                        console
  --format [FORMAT], -f [FORMAT]
                        Flag indicating in what format the results will be
                        presented. Available formats: default and json
  --show-stats          Flag indicating whether to print verbose stats
  --help, -h            Show this help message and exit


Examples of usage:

Grab SOCKS5:
Code:
proxybroker find --types SOCKS5

Result:
Code:
<Proxy US 0.18s [SOCKS5] 96.96.1.165:1080>
<Proxy US 0.19s [SOCKS5] 96.44.133.110:58690>
<Proxy US 0.29s [SOCKS5] 72.210.252.143:46173>
<Proxy US 0.32s [SOCKS5] 208.113.222.239:45363>
<Proxy US 0.33s [SOCKS5] 208.113.152.215:44297>
<Proxy US 0.40s [SOCKS5] 72.210.252.152:46154>
<Proxy US 0.43s [SOCKS5] 173.245.239.177:16964>
<Proxy US 0.44s [SOCKS5] 96.113.166.133:1080>
<Proxy US 0.44s [SOCKS5] 66.110.216.105:39431>
<Proxy US 0.45s [SOCKS5] 96.96.33.133:1080>
<Proxy US 0.46s [SOCKS5] 98.143.145.30:62353>
<Proxy US 0.54s [SOCKS5] 192.169.139.161:8975>
<Proxy US 0.55s [SOCKS5] 184.185.2.146:47659>
<Proxy GR 0.57s [SOCKS5] 178.128.154.236:45761>
<Proxy US 0.58s [SOCKS5] 208.113.153.22:13361>
<Proxy US 0.58s [SOCKS5] 96.44.183.149:55225>
<Proxy US 0.59s [SOCKS5] 208.113.223.164:13361>
<Proxy US 0.61s [SOCKS5] 66.33.210.85:14148>
<Proxy US 0.61s [SOCKS5] 66.110.216.221:39603>
<Proxy US 0.62s [SOCKS5] 174.76.35.7:36171>
<Proxy US 0.62s [SOCKS5] 66.33.214.101:13959>
<Proxy US 0.64s [SOCKS5] 66.33.212.17:13959>
<Proxy US 0.63s [SOCKS5] 208.109.52.52:64783>
<Proxy US 0.64s [SOCKS5] 66.135.227.178:4145>


Grab 100 HTTP from US with Anonymous or High quality grade:
Code:
proxybroker find --types HTTP --lvl Anonymous High --countries US -l 100

Result:
Code:
<Proxy US 0.21s [HTTP: High] 23.235.228.204:8080>
<Proxy US 0.13s [HTTP: High] 206.189.202.230:80>
<Proxy US 0.21s [HTTP: High] 161.156.69.189:3128>
<Proxy US 0.08s [HTTP: High] 134.122.75.190:8080>
<Proxy US 0.17s [HTTP: High] 23.102.166.13:3128>
<Proxy US 0.21s [HTTP: High] 157.245.136.101:8080>
<Proxy US 0.22s [HTTP: High] 52.179.231.206:80>
<Proxy US 0.23s [HTTP: High] 165.227.182.151:8888>
<Proxy US 0.22s [HTTP: High] 192.241.245.207:3128>
<Proxy US 0.39s [HTTP: High] 174.138.54.49:8080>
<Proxy US 0.40s [HTTP: High] 165.227.215.71:8080>
<Proxy US 0.41s [HTTP: Anonymous] 165.22.41.190:80>
<Proxy US 0.56s [HTTP: High] 165.227.84.169:80>
<Proxy US 0.71s [HTTP: Anonymous] 196.52.80.75:80>
<Proxy US 0.64s [HTTP: High] 173.249.44.18:3128>
<Proxy US 1.80s [HTTP: High] 134.209.44.228:80>
<Proxy US 2.36s [HTTP: High] 96.87.184.101:43705>

Extras:

If you want to use the default curl template for proxies, you can process like that for example.

For SOCKS5:
Code:
proxybroker find --types SOCKS5 -l 25 | cut -d' ' -f5 | cut -d'>' -f1 | sed 's;^;socks5://;'

Result:
Code:
socks5://96.96.1.165:1080
socks5://96.113.166.133:1080
socks5://96.96.33.133:1080
socks5://208.113.222.239:45363
socks5://178.128.154.236:24629
socks5://72.221.164.35:60670
socks5://208.113.154.22:56365
socks5://173.245.239.12:17145
socks5://98.174.90.36:14474
socks5://96.44.133.110:58690
socks5://184.185.2.146:47659
socks5://173.245.239.177:16964
socks5://178.128.154.236:45761
socks5://208.113.152.215:44297
socks5://174.76.35.15:36163
socks5://69.163.160.197:50301
socks5://66.33.212.17:13959
socks5://98.181.99.197:10368
socks5://69.61.200.104:36181
socks5://174.76.48.233:4145
socks5://64.90.49.250:36596
socks5://66.110.216.105:39431
socks5://174.70.241.14:24392
socks5://208.109.52.52:64783
socks5://142.93.51.220:31651


For HTTP:
Code:
proxybroker find --types HTTP --lvl Anonymous High -l 50 | cut -d' ' -f6 | cut -d'>' -f1 | sed 's;^;http://;'

Result:
Code:
http://178.93.32.237:36636
http://23.235.228.204:8080
http://171.96.113.43:8118
http://212.220.216.70:8080
http://113.53.230.167:80
http://103.28.121.58:80
http://139.99.105.186:80
http://200.89.178.229:8080
http://195.181.210.160:8080
http://101.4.136.34:81
http://212.227.11.130:80
http://179.127.243.1:49465
http://187.111.160.29:40098
http://84.244.8.170:53281
http://200.73.128.5:8080
http://176.28.75.193:53737
http://182.48.81.222:46157
http://46.235.53.26:3128
http://220.247.174.13:32355
http://41.164.247.186:53281
http://117.196.236.219:47916
http://103.194.248.166:34448
http://113.53.91.12:53281
http://200.89.178.196:8080
http://1.20.97.122:44279
http://103.102.28.134:38166
http://118.174.220.152:31701
http://185.112.35.27:31696
http://77.66.203.114:33097
http://77.242.178.47:54669
http://103.212.93.225:53053
http://103.212.93.209:53053
http://200.236.221.242:52426
http://177.136.168.13:43626
http://43.229.26.227:37405
http://185.204.208.78:8080
http://39.137.69.6:80
http://109.167.113.9:59606
http://118.174.220.61:60070
http://115.124.92.154:43520
http://118.99.94.120:30399
http://195.182.22.178:46916
http://155.93.108.170:34997
http://37.120.192.154:8080
http://104.238.187.252:8080
http://186.232.15.9:45849
http://191.37.183.209:60139
http://1.20.101.221:55707
http://114.134.172.50:60664
http://182.52.51.43:49699


Enjoy !
Reply

Users browsing: 1 Guest(s)