Menu
Article Tutorials

python requests url example

Narkw Brahma

Narkw Brahma

• 2 min read

Python Requests URL Example

Python is a versatile programming language that can be used for various purposes. One of the most common use cases of Python is web development. In order to interact with web pages and web services, Python provides a powerful library called Requests. In this article, we will demonstrate how to use Requests library to make HTTP requests to URLs.

Using Requests to Make HTTP Requests

Requests library provides a simple and elegant way to interact with the web. It abstracts away the complexities of HTTP protocol and provides a human-friendly interface to work with URLs. Here is a simple example of how to make an HTTP GET request using Requests:


import requests

response = requests.get('https://www.example.com')
print(response.text)

In this example, we have imported the Requests library and used the get method to fetch the contents of the URL https://www.example.com. The response variable contains the HTTP response object, which has various attributes and methods to work with the response.

Passing Query Parameters

Sometimes, we need to pass query parameters along with the URL, such as when making a search request or filtering data. Requests library provides an easy way to pass query parameters using the params keyword argument. Here is an example:


import requests

payload = {'q': 'python'}
response = requests.get('https://www.google.com/search', params=payload)
print(response.url)

In this example, we have passed a dictionary of query parameters using the params keyword argument. The resulting URL will be https://www.google.com/search?q=python. We have then printed the URL to verify that the query parameters have been correctly encoded in the URL.

Sending Request Headers

HTTP headers provide additional information about the request or response, such as the content type, encoding, user agent, etc. Requests library provides an easy way to send custom headers using the headers keyword argument. Here is an example:


import requests

headers = {'User-Agent': 'Mozilla/5.0'}
response = requests.get('https://www.example.com', headers=headers)
print(response.text)

In this example, we have passed a dictionary of headers using the headers keyword argument. The User-Agent header is used to identify the client making the request. In this case, we have set it to Mozilla/5.0, which is a common user agent string used by web browsers.

Sending POST Requests

HTTP POST requests are used to submit data to the server, such as when submitting a form or creating a resource. Requests library provides a simple way to send POST requests using the post method. Here is an example:


import requests

payload = {'username': 'john', 'password': '1234'}
response = requests.post('https://www.example.com/login', data=payload)
print(response.text)

In this example, we have passed a dictionary of form data using the data keyword argument. The post method automatically sets the Content-Type header to application/x-www-form-urlencoded, which is the default content type for HTML forms. The server can then read the form data from the request body.

Sending JSON Data

JSON (JavaScript Object Notation) is a lightweight data format that is widely used for exchanging data between web services. Requests library provides an easy way to send JSON data using the json keyword argument. Here is an example:


import requests

payload = {'name': 'John', 'age': 30}
response = requests.post('https://www.example.com/api/users', json=payload)
print(response.text)

In this example, we have passed a dictionary of data as JSON using the json keyword argument. The post method automatically sets the Content-Type header to application/json, which is the default content type for JSON data. The server can then read the JSON data from the request body.

Conclusion

Requests library provides a simple and elegant way to interact with the web using Python. It supports various HTTP methods, query parameters, headers, and data formats. By using Requests, you can easily automate web interactions, scrape web pages, and build web services.

Share