How to Set Up Residential Proxies: Step by Step Guide
Learn how to set up and configure residential proxies for web scraping, browser automation, and data collection. Covers authentication, proxy formats, and integration with popular tools.
Setting up residential proxies for the first time can feel complicated, but the process is straightforward once you understand the basics. This guide walks you through everything from choosing the right proxy format to integrating proxies with popular tools and browsers.
What You Need Before Starting
Before configuring your proxies, make sure you have the following ready:
A proxy provider account. You will need active residential proxy access with either bandwidth-based or subscription-based billing. At Carbon Proxies, you can purchase residential bandwidth and start generating proxy lists immediately from your dashboard.
Your proxy credentials. Depending on your provider, this will be either a username and password combination, or IP whitelist authentication where your home IP is pre-authorized.
The tool you plan to use. Whether it is a browser, scraping framework, bot software, or custom script, know which tool you will be configuring before you start.
Understanding Proxy Formats
Residential proxies are typically provided in one of these formats:
IP:Port:Username:Password is the most common format. For example: 45.127.98.12:8080:user123:pass456. This includes everything needed to connect in a single line.
IP:Port is used when your provider uses IP whitelist authentication. Your IP address is pre-approved on the provider's system, so no username or password is needed. Example: 45.127.98.12:8080
Backconnect gateway format uses a single hostname that rotates IPs on the backend. Example: gate.provider.com:10000:user123:pass456. Each connection through the gateway receives a different residential IP automatically.
If you are scraping or running automated tasks, the backconnect gateway format is usually the easiest. For sneaker bots and tools that need specific IPs, use the IP:Port:Username:Password format with a generated proxy list.
Authentication Methods
Username and Password Authentication
This is the most flexible method. Your provider gives you credentials that you include with every proxy connection. It works from any device or IP address, making it ideal for cloud servers, shared machines, and situations where your IP changes frequently.
IP Whitelist Authentication
With this method, you register your device's public IP address with your proxy provider. Any connection from that IP is automatically authenticated without needing a username or password. This is simpler to configure but only works from the whitelisted IP. If your home IP changes, you will need to update the whitelist.
Setting Up Proxies in Your Browser
Chrome with a Proxy Extension
The easiest way to use residential proxies in Chrome is with an extension like FoxyProxy or Proxy SwitchyOmega. Install the extension from the Chrome Web Store, then add your proxy details (IP, port, username, password). You can create profiles for different proxy configurations and switch between them with one click.
Firefox Built-in Proxy Settings
Firefox has native proxy support. Go to Settings, search for "proxy", and click "Settings" under Network Settings. Select "Manual proxy configuration" and enter your proxy IP and port. For SOCKS5 proxies, use the SOCKS Host field instead of the HTTP Proxy field.
Using Proxies with Scraping Tools
Python with Requests
The Python requests library supports proxies natively. Set the proxies parameter with your proxy URL in the format http://user:pass@ip:port. For rotating proxies, load a list of proxies and cycle through them with each request to distribute your traffic across multiple IPs.
Node.js with Axios or Puppeteer
For Axios, use the proxy config option or an HTTP agent like https-proxy-agent. For Puppeteer (headless browser automation), pass the --proxy-server argument when launching the browser, then authenticate using page.authenticate() with your proxy credentials.
Scrapy
Scrapy supports proxy middleware out of the box. Add your proxy list to a custom middleware that rotates proxies per request. For residential proxies with a backconnect gateway, you can set a single proxy URL in your settings and the provider handles rotation automatically.
Testing Your Proxy Connection
After configuring your proxies, verify that they are working correctly:
Check your visible IP. Visit a site like httpbin.org/ip or ifconfig.me through your proxy. The IP shown should be the proxy IP, not your real IP.
Verify the location. Use an IP geolocation service to confirm the proxy IP shows the expected country and region.
Test speed. Run a few requests and measure response times. Residential proxies typically have response times between 50ms and 300ms. If you are seeing times above 500ms consistently, there may be a routing issue.
Check for DNS leaks. Some proxy configurations only route HTTP traffic through the proxy while DNS requests go through your real connection. Use a DNS leak test to make sure all traffic is properly proxied.
Troubleshooting Common Issues
Connection refused or timeout. Double check the proxy IP, port, username, and password. Make sure you are using the correct protocol (HTTP vs SOCKS5). Some proxies only support one protocol.
407 Proxy Authentication Required. Your credentials are wrong or the authentication method does not match. If you are using IP whitelist auth, make sure your current public IP is whitelisted with your provider.
Slow response times. Try connecting to a proxy in a closer geographic location. Residential proxies routed through distant countries will naturally be slower. If all proxies are slow, check if your provider is experiencing service issues.
Getting blocked despite using proxies. Websites may be detecting your browser fingerprint, request headers, or behavioral patterns rather than your IP. Consider using anti-detect browsers or randomizing your request headers alongside your proxies.