Currently, I am exploring the process of creating a website monitoring script (which will eventually be set up as a cron job) that can access a specified URL, verify the presence of a specific tag. If the tag is not found or does not contain the expected information, the script should record the issue in a log file or send an email notification.
The tag to be checked for could look like or something along those lines.
Does anyone have any suggestions on how to accomplish this task?
If you're looking for a reliable solution, I recommend checking out BeautifulSoup. Here's a quick example:
import urllib2
from BeautifulSoup import BeautifulSoup
page = urllib2.urlopen("http://yoursite.com")
soup = BeautifulSoup(page)
# Consult the documentation on how to navigate through the soup. For now, this is just a basic example.
Once you have extracted the data, sending it via email or logging it should be straightforward.
Below is a sample snippet of Python code (not tested) that logs and sends an email:
#!/usr/bin/env python
import logging
import urllib2
import smtplib
# Log configuration
logging.basicConfig(filename='/tmp/yourscript.log', level=logging.INFO)
# Open requested URL
url = "http://yoursite.com/tags/yourTag"
data = urllib2.urlopen(url)
if check_content(data):
# Report to log
logging.info('Content found')
else:
# Send email
send_mail('Content not found')
def check_content(data):
# Implement your BeautifulSoup logic here
return content_found
def send_mail(message_body):
server = 'localhost'
recipients = ['email@example.com']
sender = 'sender@example.com'
message = 'From: %s \n Subject: Script Result \n\n %s' % (sender, message_body)
session = smtplib.SMTP(server)
session.sendmail(sender, recipients, message);
I recommend using check_content() function with the help of BeautifulSoup
Check out this (untested) code that utilizes urllib2 to retrieve the webpage and re to search within it.
import urllib2,StringIO
pageString = urllib2.urlopen('**insert url here**').read()
m = re.search(r'**insert regex for the desired tag here**', pageString)
if m == None:
#take action when NOT found
else:
#take action when found
Take a look at this (untested) code that uses pycurl and StringIO to fetch the webpage and re to search through it.
import pycurl,re,StringIO
b = StringIO.StringIO()
c = pycurl.Curl()
c.setopt(pycurl.URL, '**insert url here**')
c.setopt(pycurl.WRITEFUNCTION, b.write)
c.perform()
c.close()
m = re.search(r'**insert regex for the tag you want to find here**', b.getvalue())
if m == None:
#take action when NOT found
else:
#take action when found
In Safari, I understand that audio context needs to be created after user interaction. Despite this knowledge, the code below still didn't produce the desired result. HTML <button onclick="play">Play</button> Javascript functio ...
How can I open a new tab with the 'https://www.gmail.com' url, extract some information, and then return to the original page using Python 3.8.5? I am currently opening the new tab with CTRL + t command, but I'm unsure how to switch between ...
Having issues with my contact form that has 3 fields and a textarea... I've used jQuery for validation and PHP to handle email sending. The contact form is functioning correctly, but the From field in the received emails is not displaying as expect ...
I am trying to implement a feature where an input field shows as required, but once the user enters text, it indicates that the input is valid by changing the border color from red to green. I am facing an issue with this line of code always returning fal ...
I am currently having difficulty in figuring out the correct way to execute a right click. Below is an example of my code: click_Menu = driver.find_element_by_id("Menu") print(click_Menu.text) action.move_to_element(click_Menu) action.context_cl ...
<!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="initial-scale=1, maximum-scale=1, user-scalable=no, width=device-width"> <title>App Title</title> <!-- Framework's CSS Fil ...
Is there a way to dynamically change the itemTpl in a Sencha list to adjust the visibility of a column based on certain conditions? Your assistance would be greatly appreciated. ...
My project consists of three main files - an HTML, a CSS, and a JS file. I have developed the HTML using the Bootstrap 5.1.3 framework. The issue I am facing pertains to the alignment of the clothing brand logo within the header section. Despite multiple ...
I am currently working on building a responsive website and I need two divs to switch positions depending on the screen width, both on initial load and when resizing. Despite my efforts in researching and trying various options, I have not been successful ...
Issue Summary I am experiencing an issue with the positioning of my sidebar, which is initially located 66% offscreen using -translate-x-2/3. The sidebar is meant to be pulled into view onmouseover, however, the main body content remains stuck in place. I ...
In search of a secure and flexible solution for storing credentials in a config file for database connections and other private information within a Python module. This module is responsible for logging user activity in the system through different handler ...
I currently have price span tags displayed on my website: <div> <span class="priceTitle">10.00</span> </div> <div> <span class="priceTitle">15.00</span> </div> <div> <span class="priceTitle">20.0 ...
I've been experiencing some difficulties with PHP echoing a label element that contains an ID attribute within an HTML form. My intention was to utilize the ID attribute in order to avoid having to modify the JS code to use the name attribute instead. ...
I came across this code snippet (you can find it here) and have been struggling with the issue where the .update method only adds the last value to the dictionary. I tried different solutions found online but still couldn't resolve it. import json ...
I'm struggling with a loop that is responsible for displaying <li> elements, and I need to incorporate a new class into the first item, as well as every sixth subsequent <li> element. For example: while ($db_field = mysql_fetch_assoc($re ...
I am having an issue with my page where I display 3 images in a row using Ng-repeat. When I click on any image, it only shows the first image that was displayed in that particular row. Template: <div id="galscrolldiv" class="row" ng-repeat="image in i ...
I am encountering an issue with this particular piece of javascript. Every time I attempt to use it, nothing is displayed in my div. Instead, it simply adds ?weight=NumberInputed&measure=lbsOrkgs&submit=Submit to the URL. <h2>What size d ...
I am just starting to learn jQuery and I want to create a menu similar to the one on this website Specifically, I would like the menu to slide down from the viewport to the header, as shown in the template in the link. I have searched through the jQuery ...
I am facing an issue with my code .name-bar, .email-bar { border-color: gray; border-style: solid; display: inline-block; } .email-bar { margin-top: 5px; } .div-one, .div-two { border-color: gray; border-style: solid; width: 200px; h ...
I am new to XSL. I am attempting to organize a list of books based on the 'number of pages'. I have created a simple XSL file for this purpose, but the output is not as expected. Some elements are sorted while others remain unsorted. What could b ...