There are 3 problems here
The medios is the dict. Hence, you will have to loop through the keys and values to send it to the method as the method only accepts the URL string.
BeautifulSoup finds method needs the tag name for it to search else it will return None. If you want to count a number of occurrences of the word, then use count on the string.
You have to send User-Agent in a requests code else you will get 403 or 301.
import requests
from bs4 import BeautifulSoup
headers = {'user-agent':"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36"}
def count_words(url, the_word):
r = requests.get(url, headers=headers)
return r.text.lower().count(the_word)
def main():
url = '
https://www.nytimes.com/'
medios = {
'Los Angeles Times': ['
http://www.latimes.com/'],
'New York Times' : ['
http://www.nytimes.com/']
}
word = 'trump'
for web_name, urls in medios.items():
for url in urls:
cuenta = count_words(url, word)
print('La palabra: {} aparece {} occurrencias en el {}'.format(word, cuenta, web_name))
if __name__ == '__main__':
main()
Output:
La palabra: trump aparece 47 occurrencias en el Los Angeles Times
La palabra: trump aparece 194 occurrencias en el New York Times
If you want to know more about the Data Science then do check out the following Data Science which will help you in understanding Data Science from scratch
