Menu
Article Performance Hacks

python requests user agent

Narkw Brahma

Narkw Brahma

• 1 min read

Python Requests User Agent

When making web requests using Python, it is important to include a user agent header in the request. The user agent header is a string that identifies the client making the request. This is necessary because servers use this information to determine how to respond to the request.

Python's requests library is a popular choice for making HTTP requests in Python. To set the user agent header in a request made with requests, you can use the headers parameter.

Example:


import requests

url = "https://example.com"
headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'
}

response = requests.get(url, headers=headers)

In the above example, we are setting the user agent header to a common user agent string used by the Google Chrome web browser on Windows 10. This is just an example, and you should use a user agent string that is appropriate for your specific use case.

If you want to set a default user agent for all requests made with requests, you can use the Session object and set the default headers.

Example:


import requests

s = requests.Session()
s.headers.update({'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'})

response = s.get('https://example.com')

In this example, we are creating a Session object and setting the default user agent to the same string as before. This user agent will be used for all requests made with this session.

It is important to note that some websites may block requests that have user agents that do not match those of popular web browsers. In this case, you may need to use a user agent string from a popular web browser to avoid being blocked.

Share