Allow to customize scrape.do proxy/api endpoints

[Verz1Lka]

No description provided.

[codebeaver-ai]

CodeBeaver PR Summary

I opened a Pull Request with the following:

🔄 1 test added.
🐛 No bugs detected in your changes
🛠️ 0/2 tests passed

🔄 Test Updates

I've added 1 tests. They all pass ☑️
New Tests:

• tests/test_scrape_do.py

No existing tests required updates.

🐛 Bug Detection

No bugs detected in your changes. Good job!

🛠️ Test Results

0/2 tests passed ⚠️

tests/graphs/scrape_graph_test.py

View error

ImportError while importing test module '/app/temp_workspace/tests/graphs/scrape_graph_test.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/local/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/graphs/scrape_graph_test.py:10: in <module>
    from scrapegraphai.graphs import ScrapeGraph
E   ImportError: cannot import name 'ScrapeGraph' from 'scrapegraphai.graphs' (/app/temp_workspace/scrapegraphai/graphs/__init__.py)

_{tests/graphs/scrape_graph_test.py}

tests/graphs/xml_scraper_openai_test.py

View error

ImportError while importing test module '/app/temp_workspace/tests/graphs/xml_scraper_openai_test.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/local/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/graphs/xml_scraper_openai_test.py:10: in <module>
    from scrapegraphai.utils import convert_to_csv, convert_to_json, prettify_exec_info
E   ImportError: cannot import name 'convert_to_csv' from 'scrapegraphai.utils' (/app/temp_workspace/scrapegraphai/utils/__init__.py)

_{tests/graphs/xml_scraper_openai_test.py}

☂️ Coverage Improvements

Coverage improvements by file:

• tests/test_scrape_do.py

  New coverage: 82.35%
  Improvement: +82.35%

🎨 Final Touches

• I ran the hooks included in the pre-commit config.

---

_{Settings | Logs | CodeBeaver}

[github-actions]

🎉 This PR is included in version 1.38.0 🎉

The release is available on:

• v1.38.0
• GitHub release

Your semantic-release bot 📦🚀