My current project involves automating the extraction and printing of infobox data from Wikipedia pages. For example, I am currently working on scraping the Star Trek Wikipedia page (https://en.wikipedia.org/wiki/Star_Trek) to extract the infobox section displayed on the right-hand side. Using Python, I aim to print each piece of information row by row on the screen. So far, my code looks like this:
from bs4 import BeautifulSoup
import urllib.request
urlpage = 'https://en.wikipedia.org/wiki/Star_Trek'
page = urllib.request.urlopen(urlpage)
soup = BeautifulSoup(page, 'html.parser')
table = soup.find('table', attrs={'class': 'infobox vevent'})
results = table.find_all('tr')
print(type(results))
print('Number of results', len(results))
print(results)
The above code successfully retrieves all the contents of the infobox. Here is a snippet:
[<tr><th class="summary" colspan="2" style="text-align:center;font-
size:125%;font-weight:bold;font-style: italic; background: lavender;">
<i>Star Trek</i></th></tr>, <tr><td colspan="2" style="text-align:center">
<a class="image" href="/wiki/File:Star_Trek_TOS_logo.svg"><img alt="Star
Trek TOS logo.svg" data-file-height="132" data-file-width="560" height="59"
My objective now is to extract only the data and print it on the screen in a structured manner. I would like the output to include details such as the creator, original work, and other relevant information present in the infobox.
I want to find a way to automatically extract and print every row of data from an infobox so that I can apply this process to any Wikipedia page containing an infobox with the class "infobox vevent".