GitHub - davidaragoncode/COCoders-Lead-Scraper

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
.idea		.idea
__pycache__		__pycache__
engineer_consultants_search_1.0		engineer_consultants_search_1.0
machine_shop_search_1.0		machine_shop_search_1.0
engineer_consultants_search_1.0.zip		engineer_consultants_search_1.0.zip
engineering_keywords.csv		engineering_keywords.csv
first_big_search.txt		first_big_search.txt
keywords.csv		keywords.csv
keywords_short.csv		keywords_short.csv
list_of_places_details.csv		list_of_places_details.csv
list_of_places_with_websites_with_career_sections_keyword_fast_food		list_of_places_with_websites_with_career_sections_keyword_fast_food
machine_shop_keywords.csv		machine_shop_keywords.csv
main.py		main.py
readme.text		readme.text
web_stuff.py		web_stuff.py

Repository files navigation

REMOVE THE GOOGLE API KEY BEFORE COMMITTING

Documentation
https://developers.google.com/maps/documentation/places/web-service/search-find-place
https://developers.google.com/maps/documentation/places/web-service/search-nearby#Place
https://developers.google.com/maps/documentation/places/web-service/place-data-fields

TO DO
    - The Error handling Structure in exception_finder triggers on a no-phone or no-site
    - Look at other programs that achieve the same objectives on github.
    - Store Exceptions in a different json
    - !convert to pandas!
    option to delete data.json
    - Learn what and how to use gitbash
    - convert to OOP -?
    - Comment
    - Prettify
    - stop doing so many API requests

    Make update_json_file accept a panda object to update the json file with and also make it create a panda dataframe