Hi there! This is my first post and I'm fairly new to Python, especially when it comes to sending emails from it. My current objective is to scrape the first 5 articles from a website and send them to my email address. Right now, all I need is for it to work once, sending from one email address to another. Scheduling can come later - let's focus on solving this issue first. Below you'll find the code that scrapes articles using Selenium. Is there any way to modify it so that it prints out 5 different news stories instead of the same story repeated?
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
import time
from webdriver_manager.chrome import ChromeDriverManager
def getnews():
driver = webdriver.Chrome(ChromeDriverManager().install())
driver.get("https://community.elitedangerous.com/en/")
driver.implicitly_wait(5)
news = driver.find_element_by_class_name("article")
divider =("_____________________________________________________________________________________________________")
for i in range(0,6):
print(news.text)
print(divider)
driver.quit()
getnews()
If you run this code, you'll receive nerdy news. I also have an email code snippet that works well with basic text:
import smtplib
with smtplib.SMTP('smtp.gmail.com', 587) as smtp:
smtp.ehlo()
smtp.starttls()
smtp.ehlo()
smtp.login('mysendingemail.gmail.com', 'myverysecurepassword')
subject = "this is the title"
body = "this is the body of the email"
msg = f'Subject: {subject}\n\n{body}'
smtp.sendmail('mysendingemail.gmailcom', '<a href="/cdn-cgi/l/email-protection" class="__cf_email__" data-cfemail="fc9185938894998e99919d9590bc9b919d9590d29f9391">[email protected]</a>',msg)
My question is: How can I extract text from a website and send it via email? Any pointers on scheduling weekly emails would be much appreciated.
After receiving some feedback about creating a list, I made some updates to the code:
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
import time
from webdriver_manager.chrome import ChromeDriverManager
import smtplib
def get_news():
driver = webdriver.Chrome(ChromeDriverManager().install())
driver.get("https://community.elitedangerous.com/en/")
driver.implicitly_wait(5)
v=2
divider =("_____________________________________________________________________________________________________")
news_list = []
for x in range(0, 5):
if v <= 7:
xpath = (str('//*[@id="block-system-main"]/div[' + str(v) + ']'))
news = driver.find_element_by_xpath(xpath)
body = news.text
news_list.append(news.text)
v += 1
else:
break
with smtplib.SMTP('smtp.gmail.com', 587) as smtp:
smtp.ehlo()
smtp.starttls()
smtp.ehlo()
smtp.login('<a href="/cdn-cgi/l/email-protection" class="__cf_email__" data-cfemail="4a392f242e2f382f272b23262a38073977">[email protected]</a>', 'password for email')
subject = "news"
body = str(news_list)
msg = f'Subject: {subject}\n\n{body}'
smtp.sendmail('sender email.com', 'recieveremail.com', msg)
get_news()
Upon running this updated code, I encountered a UnicodeEncodeError. Is this because the list isn't converting into a string properly?