History attribute from httpx response object

[DanielOX]

Have you searched if there an existing feature request for this?

• I have searched the existing requests

Feature description

Hi,

As of today, There is no way of getting history of redirects made by the Response Adapter. The httpx module provides an history attribute. This attribute keeps track of responses made by each re-direct responses.

I am working on PR but wanted to get @D4Vinci opinion on it.

example: https://wikipedia.com redirects you to https://wikipedia.org.

from scrapling import Fetcher

url = 'https://wikipedia.com'

# init fetcher
https_fetcher = Fetcher()

# returns a response adapter
response = https_fetcher.get(url=url , stealthy_headers=True, follow_redirects=True)

# see re-direct history responses

print(r.history)

-- output
[<Response [301 Moved Permanently]>]

I am thinking of implementing it this way:

• in Scrapling/Fetchers.py update the last return: comment of each POST,GET,PUT,DELETE method
• in Scrapling/engines/static.py add history attribute from httpx object while returning Response Adapter in _prepare_response method
• in Response adapter i define a new property self.history

[D4Vinci]

Thanks for the idea, I will try to add it with version 0.3 but might look different than this - will see when I work on it