Menu
Article Security Check

python requests data

Narkw Brahma

Narkw Brahma

• 3 min read

Python Requests Data

Python is an incredibly versatile language that can be used for a wide range of tasks, including web scraping and data analysis. One of the most popular libraries for working with web data in Python is requests. The requests library allows you to send HTTP requests from your Python code and receive responses from web servers.

Sending a GET Request

If you want to retrieve data from a server, you can use the get method of the requests library. Here's an example:


import requests

response = requests.get('https://www.example.com')
print(response.text)

In this example, we're sending a GET request to the URL 'https://www.example.com'. The response from the server is stored in the response variable. We then print out the text of the response using the text attribute of the response object.

Sending a POST Request

If you need to send data to a server, you can use the post method of the requests library. Here's an example:


import requests

url = 'https://www.example.com/login'
data = {'username': 'myusername', 'password': 'mypassword'}
response = requests.post(url, data=data)

print(response.content)

In this example, we're sending a POST request to the URL 'https://www.example.com/login' with a dictionary of data containing a username and password. The response from the server is stored in the response variable. We then print out the content of the response using the content attribute of the response object.

Sending Headers

If you need to send headers with your request, you can pass them as a dictionary to the headers parameter of the get or post method. Here's an example:


import requests

url = 'https://www.example.com'
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36'}
response = requests.get(url, headers=headers)

print(response.text)

In this example, we're sending a GET request to the URL 'https://www.example.com' with a customized user agent header. The response from the server is stored in the response variable. We then print out the text of the response using the text attribute of the response object.

Sending Query Parameters

If you need to send query parameters with your request, you can pass them as a dictionary to the params parameter of the get method. Here's an example:


import requests

url = 'https://www.example.com/search'
params = {'q': 'python'}
response = requests.get(url, params=params)

print(response.text)

In this example, we're sending a GET request to the URL 'https://www.example.com/search' with a query parameter of 'q' set to 'python'. The response from the server is stored in the response variable. We then print out the text of the response using the text attribute of the response object.

Sending Cookies

If you need to send cookies with your request, you can pass them as a dictionary to the cookies parameter of the get or post method. Here's an example:


import requests

url = 'https://www.example.com'
cookies = {'session_id': '12345'}
response = requests.get(url, cookies=cookies)

print(response.text)

In this example, we're sending a GET request to the URL 'https://www.example.com' with a session ID cookie. The response from the server is stored in the response variable. We then print out the text of the response using the text attribute of the response object.

Error Handling

If there's an error with your request, the requests library will raise an exception. You can catch these exceptions using a try-except block. Here's an example:


import requests

url = 'https://www.example.com'
try:
    response = requests.get(url)
    response.raise_for_status()
except requests.exceptions.HTTPError as err:
    print(err)
else:
    print(response.text)

In this example, we're sending a GET request to the URL 'https://www.example.com'. If there's an HTTP error with the request, the raise_for_status method will raise an exception. We catch this exception using a try-except block and print out the error message. If there's no error, we print out the text of the response using the text attribute of the response object.

Share