Beautifulsoup4 Dylan and Jalen.
For our midterm assignment, we will show how to use beautifulsoup4 to extract chart data from Billboard's top 200. Chart data reveals what people consume and enjoy, providing insights into consumer preferences and behaviors.
What is beautifulsoup4? BeautifulSoup4 is a strong, flexible package inside the Python library, used for web scraping, parsing HTML or XML documents, and extracting data from web pages. Thanks to its beautiful, human-readable API(Application Programming Interface), BeautifulSoup is, well, beautiful like a Swiss Army knife because of its web scraping ability to navigate and extract data from web pages efficiently. How is it efficient? It is beginner friendly and easy to set up while the library functions without relying on browsers and of course it is fast.
First, install the package 'beautifulsoup4'
In [1]:
pip install requests beautifulsoup4
Requirement already satisfied: requests in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (2.32.3) Requirement already satisfied: beautifulsoup4 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (4.12.3) Requirement already satisfied: charset-normalizer<4,>=2 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (3.7) Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (2.2.2) Requirement already satisfied: certifi>=2017.4.17 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (2024.7.4) Requirement already satisfied: soupsieve>1.2 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from beautifulsoup4) (2.6) Note: you may need to restart the kernel to use updated packages.
Import package and Fetch html website from Billboard 200 and request content.
In [31]:
import requests
from bs4 import BeautifulSoup
url = 'https://www.billboard.com/charts/billboard-200'
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36'}
response = requests.get(url,headers = headers)
html_content = response.content
After this, parse the HTML Content.
In [ ]:
soup = BeautifulSoup(html_content, 'html.parser')
soup
Extract Data from Billboard 200 using Beautiful Soup to find and extract the relevant data. For example, to get the top 200 list of album titles and artists:
In [35]:
albums = soup.find_all('h3', class_='c-title')
artists = soup.find_all('span', class_='c-label')
for album, artist in zip(albums, artists):
print(f"Album: {album.text.strip()}, Artist: {artist.text.strip()}")
Album: Moon Music, Artist: 1 Album: Imprint/Promotion Label:, Artist: NEW Album: Charli XCX's 'Brat' Tops U.K. Album Charts Following Star-Studded Remixes, Artist: NEW Album: Gains in Weekly Performance, Artist: Coldplay Album: Additional Awards, Artist: - Album: Moon Music, Artist: 1 Album: Imprint/Promotion Label:, Artist: 1 Album: Short n' Sweet, Artist: - Album: Imprint/Promotion Label:, Artist: 1 Album: The Rise And Fall Of A Midwest Princess, Artist: 1 Album: Imprint/Promotion Label:, Artist: 2 Album: One Thing At A Time, Artist: Sabrina Carpenter Album: Imprint/Promotion Label:, Artist: 1 Album: Hit Me Hard And Soft, Artist: 1 Album: Imprint/Promotion Label:, Artist: 7 Album: The Tortured Poets Department, Artist: 1 Album: Imprint/Promotion Label:, Artist: 1 Album: F-1 Trillion, Artist: 7 Album: Imprint/Promotion Label:, Artist: 3 Album: Mixtape Pluto, Artist: Chappell Roan Album: Imprint/Promotion Label:, Artist: 2 Album: Stick Season, Artist: 2 Album: Imprint/Promotion Label:, Artist: 29 Album: Dangerous: The Double Album, Artist: 2 Album: Imprint/Promotion Label:, Artist: 2 Album: Incomodo, Artist: 29 Album: Imprint/Promotion Label:, Artist: 4 Album: SOS, Artist: Morgan Wallen Album: Imprint/Promotion Label:, Artist: 4 Album: The Great American Bar Scene, Artist: 1 Album: Imprint/Promotion Label:, Artist: 84 Album: Brat, Artist: 4 Album: Imprint/Promotion Label:, Artist: 1 Album: Zach Bryan, Artist: 84 Album: Imprint/Promotion Label:, Artist: 5 Album: Fireworks & Rollerblades, Artist: Billie Eilish Album: Imprint/Promotion Label:, Artist: 5 Album: Exodo, Artist: 2 Album: Imprint/Promotion Label:, Artist: 21 Album: American Heartbreak, Artist: 5 Album: Imprint/Promotion Label:, Artist: 2 Album: Where I've Been, Isn't Where I'm Going, Artist: 21 Album: Imprint/Promotion Label:, Artist: 6 Album: The Secret Of Us, Artist: Taylor Swift Album: Imprint/Promotion Label:, Artist: 7 Album: Am I Okay?, Artist: 1 Album: Imprint/Promotion Label:, Artist: 25 Album: The Death Of Slim Shady (Coup de Grace), Artist: 7 Album: Imprint/Promotion Label:, Artist: 1 Album: I've Tried Everything But Therapy (Part I), Artist: 25 Album: Imprint/Promotion Label:, Artist: 7 Album: Folklore, Artist: Post Malone Album: Imprint/Promotion Label:, Artist: 6 Album: Lover, Artist: 1 Album: Imprint/Promotion Label:, Artist: 8 Album: Utopia, Artist: 6 Album: Imprint/Promotion Label:, Artist: 1 Album: Curtain Call: The Hits, Artist: 8 Album: Imprint/Promotion Label:, Artist: 8 Album: +-=÷x (Tour Collection), Artist: Future Album: Imprint/Promotion Label:, Artist: 3 Album: Guts, Artist: 1 Album: Imprint/Promotion Label:, Artist: 3 Album: For All The Dogs, Artist: 3 Album: Imprint/Promotion Label:, Artist: 1 Album: Midnights, Artist: 3 Album: Imprint/Promotion Label:, Artist: 9 Album: Blonde, Artist: Noah Kahan Album: Imprint/Promotion Label:, Artist: 8 Album: We Don't Trust You, Artist: 2 Album: Imprint/Promotion Label:, Artist: 98 Album: Eternal Sunshine, Artist: 8 Album: Imprint/Promotion Label:, Artist: 2 Album: The Diamond Collection, Artist: 98 Album: Imprint/Promotion Label:, Artist: 10 Album: Twisters: The Album, Artist: Morgan Wallen Album: Imprint/Promotion Label:, Artist: 10 Album: Rumours, Artist: 1 Album: Imprint/Promotion Label:, Artist: 196 Album: 1989 (Taylor's Version), Artist: 10 Album: Imprint/Promotion Label:, Artist: 1 Album: This One's For You, Artist: 196 Album: Imprint/Promotion Label:, Artist: 11 Album: Chronicle: The 20 Greatest Hits, Artist: Tito Double P Album: Imprint/Promotion Label:, Artist: 13 Album: Genesis, Artist: 11 Album: Imprint/Promotion Label:, Artist: 7 Album: Diamonds, Artist: 13 Album: Imprint/Promotion Label:, Artist: 11 Album: DAMN., Artist: 7 Album: Imprint/Promotion Label:, Artist: 12 Album: Sour, Artist: SZA Album: Imprint/Promotion Label:, Artist: 12 Album: Hardstone Psycho, Artist: 1 Album: Imprint/Promotion Label:, Artist: 96 Album: Papercuts, Artist: 12 Album: Imprint/Promotion Label:, Artist: 1 Album: The Highlights, Artist: 96 Album: Imprint/Promotion Label:, Artist: 13 Album: Un Verano Sin Ti, Artist: Zach Bryan Album: Imprint/Promotion Label:, Artist: 9 Album: good kid, m.A.A.d city, Artist: 2 Album: Imprint/Promotion Label:, Artist: 15 Album: Jaded, Artist: 9 Album: Imprint/Promotion Label:, Artist: 2 Album: Emails I Can't Send, Artist: 15 Album: Imprint/Promotion Label:, Artist: 14 Album: Cutouts, Artist: Charli xcx Album: Imprint/Promotion Label:, Artist: 15 Album: Speak Now, Artist: 3 Album: Imprint/Promotion Label:, Artist: 18 Album: A Great Chaos, Artist: 15 Album: Imprint/Promotion Label:, Artist: 3 Album: Take Care, Artist: 18 Album: Imprint/Promotion Label:, Artist: 15 Album: Ctrl, Artist: Zach Bryan Album: Imprint/Promotion Label:, Artist: 14 Album: Hozier, Artist: 1 Album: Imprint/Promotion Label:, Artist: 59 Album: Leon, Artist: 14 Album: Imprint/Promotion Label:, Artist: 1 Album: Greatest Hits, Artist: 59 Album: Imprint/Promotion Label:, Artist: 16 Album: Post Traumatic, Artist: Benson Boone Album: Imprint/Promotion Label:, Artist: 19 Album: Graduation, Artist: 6 Album: Imprint/Promotion Label:, Artist: 27 Album: Hollywood's Bleeding, Artist: 19 Album: Imprint/Promotion Label:, Artist: 6 Album: The First Time, Artist: 27 Album: Imprint/Promotion Label:, Artist: 17 Album: Red (Taylor's Version), Artist: Peso Pluma Album: Imprint/Promotion Label:, Artist: 18 Album: California Gold, Artist: 5 Album: Imprint/Promotion Label:, Artist: 16 Album: Gettin' Old, Artist: 18 Album: Imprint/Promotion Label:, Artist: 5 Album: reputation, Artist: 16 Album: Imprint/Promotion Label:, Artist: 18 Album: Pa Las Baby's y Belikeada, Artist: Zach Bryan Album: Imprint/Promotion Label:, Artist: 17 Album: Channel Orange, Artist: 5 Album: Imprint/Promotion Label:, Artist: 125 Album: My Turn, Artist: 17 Album: Imprint/Promotion Label:, Artist: 5 Album: One Of Wun, Artist: 125 Album: Imprint/Promotion Label:, Artist: 19 Album: Cold Beer & Country Music, Artist: Shaboozey Album: Imprint/Promotion Label:, Artist: 16 Album: $ad Boyz 4 Life II, Artist: 5 Album: Imprint/Promotion Label:, Artist: 19 Album: Starboy, Artist: 16 Album: Imprint/Promotion Label:, Artist: 5 Album: I Never Liked You, Artist: 19 Album: Imprint/Promotion Label:, Artist: 20 Album: ASTROWORLD, Artist: Gracie Abrams Album: Imprint/Promotion Label:, Artist: 27 Album: The Best Of Nickelback: Volume 1, Artist: 2 Album: Imprint/Promotion Label:, Artist: 16 Album: If I Know Me, Artist: 27 Album: Imprint/Promotion Label:, Artist: 2 Album: Certified Lover Boy, Artist: 16 Album: Imprint/Promotion Label:, Artist: 21 Album: When We All Fall Asleep, Where Do We Go?, Artist: Megan Moroney Album: Imprint/Promotion Label:, Artist: 77 Album: Greatest Hits, Artist: 9 Album: Imprint/Promotion Label:, Artist: 13 Album: For Cryin' Out Loud!, Artist: 77 Album: Imprint/Promotion Label:, Artist: 9 Album: Heroes & Villains, Artist: 13 Album: Imprint/Promotion Label:, Artist: 22 Album: Traveller, Artist: Eminem Album: Imprint/Promotion Label:, Artist: 24 Album: Hamilton: An American Musical, Artist: 1 Album: Imprint/Promotion Label:, Artist: 13 Album: Religiously. The Album., Artist: 24 Album: Imprint/Promotion Label:, Artist: 1 Album: Waves On A Sunset, Artist: 13 Album: Imprint/Promotion Label:, Artist: 23 Album: [Hybrid Theory], Artist: Teddy Swims Album: Imprint/Promotion Label:, Artist: 23 Album: Thriller, Artist: 17 Album: Imprint/Promotion Label:, Artist: 53 Album: T R A P S O U L, Artist: 23 Album: Imprint/Promotion Label:, Artist: 17 Album: Journey's Greatest Hits, Artist: 53 Album: Imprint/Promotion Label:, Artist: 24 Album: Born To Die, Artist: Taylor Swift Album: Imprint/Promotion Label:, Artist: 21 Album: Legend: The Best Of Bob Marley And The Wailers, Artist: 1 Album: Imprint/Promotion Label:, Artist: 220 Album: Evermore, Artist: 21 Album: Imprint/Promotion Label:, Artist: 1 Album: Nostalgia, Artist: 220 Album: Imprint/Promotion Label:, Artist: 25 Album: Nevermind, Artist: Taylor Swift Album: Imprint/Promotion Label:, Artist: 26 Album: Goodbye & Good Riddance, Artist: 1 Album: Imprint/Promotion Label:, Artist: 268 Album: Think Later, Artist: 26 Album: Imprint/Promotion Label:, Artist: 1 Album: Greatest Hits, Artist: 268 Album: Imprint/Promotion Label:, Artist: 26 Album: Cardinals At The Window:A Benefit For Flood Relief In Western NorthCarolina, Artist: Travis Scott Album: Imprint/Promotion Label:, Artist: 32 Album: Views, Artist: 1 Album: Imprint/Promotion Label:, Artist: 63 Album: Ate: Mini Album (EP), Artist: 32 Album: Imprint/Promotion Label:, Artist: 1 Album: The Very Best Of Daryl Hall John Oates, Artist: 63 Album: Imprint/Promotion Label:, Artist: 27 Album: 2014 Forest Hills Drive, Artist: Eminem Album: Imprint/Promotion Label:, Artist: 38 Album: What You See Is What You Get, Artist: 1 Album: Imprint/Promotion Label:, Artist: 705 Album: Muse, Artist: 38 Album: Imprint/Promotion Label:, Artist: 1 Album: After Hours, Artist: 705 Album: Imprint/Promotion Label:, Artist: 28 Album: ANTI, Artist: Ed Sheeran Album: Imprint/Promotion Label:, Artist: 28 Album: The Fame, Artist: 28 Album: Imprint/Promotion Label:, Artist: 2 Album: Greatest Hits, Artist: 28 Album: Imprint/Promotion Label:, Artist: 28 Album: Happier Than Ever, Artist: 2 Album: Imprint/Promotion Label:, Artist: 29 Album: Teenage Dream, Artist: Olivia Rodrigo Album: Imprint/Promotion Label:, Artist: 35 Album: You'll Be Alright, Kid (Chapter 1), Artist: 1 Album: Imprint/Promotion Label:, Artist: 57 Album: 35 Biggest Hits, Artist: 35 Album: Imprint/Promotion Label:, Artist: 1 Album: Sugar Honey Iced Tea, Artist: 57 Album: Imprint/Promotion Label:, Artist: 30 Album: IGOR, Artist: Drake Album: Imprint/Promotion Label:, Artist: 33 Album: New World Depression, Artist: 1 Album: Imprint/Promotion Label:, Artist: 53 Album: Pero No Te Enamores, Artist: 33 Album: Imprint/Promotion Label:, Artist: 1 Album: Plan A, Artist: 53 Album: Imprint/Promotion Label:, Artist: 31 Album: Scorpion, Artist: Taylor Swift Album: Imprint/Promotion Label:, Artist: 34 Album: Greatest Hits, Artist: 1 Album: Imprint/Promotion Label:, Artist: 103 Album: Over It, Artist: 34 Album: Imprint/Promotion Label:, Artist: 1 Album: AM, Artist: 103 Album: Imprint/Promotion Label:, Artist: 32 Album: Starting Over, Artist: Frank Ocean Album: Imprint/Promotion Label:, Artist: 31 Album: Whitsitt Chapel, Artist: 1 Album: Imprint/Promotion Label:, Artist: 403 Album: Beauty Behind The Madness, Artist: 31 Album: Imprint/Promotion Label:, Artist: 1 Album: Cigarettes After Sex, Artist: 403 Album: Imprint/Promotion Label:, Artist: 33 Album: Nadie Sabe Lo Que Va A Pasar Manana, Artist: Future & Metro Boomin Album: Imprint/Promotion Label:, Artist: 29 Album: Doo-Wops & Hooligans, Artist: 1 Album: Imprint/Promotion Label:, Artist: 29 Album: 50 Number Ones, Artist: 29 Album: Imprint/Promotion Label:, Artist: 1 Album: Higher, Artist: 29 Album: Imprint/Promotion Label:, Artist: 34 Album: Greatest Hits, Artist: Ariana Grande Album: Imprint/Promotion Label:, Artist: 45 Album: Mirada, Artist: 1 Album: Imprint/Promotion Label:, Artist: 31 Album: 11:11, Artist: 45 Album: Imprint/Promotion Label:, Artist: 1 Album: Selected Ambient Works, Volume II, Artist: 31 Album: Imprint/Promotion Label:, Artist: 35 Album: 9 Lives, Artist: Post Malone Album: Imprint/Promotion Label:, Artist: 11 Album: Ehhthang Ehhthang, Artist: 11 Album: Imprint/Promotion Label:, Artist: 47 Album: Get Rich Or Die Tryin', Artist: 11 Album: Imprint/Promotion Label:, Artist: 11 Album: Amar, Artist: 47 Album: Imprint/Promotion Label:, Artist: 36 Album: Elisabeth, Artist: Soundtrack Album: Imprint/Promotion Label:, Artist: 30 Album: Charm, Artist: 7 Album: Imprint/Promotion Label:, Artist: 12 Album: 7220, Artist: 30 Album: Imprint/Promotion Label:, Artist: 7 Album: My Beautiful Dark Twisted Fantasy, Artist: 12 Album: Imprint/Promotion Label:, Artist: 37 Album: Speak Now (Taylor's Version), Artist: Fleetwood Mac Album: Imprint/Promotion Label:, Artist: 40 Album: 20 Number Ones, Artist: 1 Album: Imprint/Promotion Label:, Artist: 602 Album: Flower Boy, Artist: 40 Album: Imprint/Promotion Label:, Artist: 1 Album: SoulFly, Artist: 602 Album: Imprint/Promotion Label:, Artist: 38 Album: Planet Her, Artist: Taylor Swift Album: Imprint/Promotion Label:, Artist: 41 Album: Freudian, Artist: 1 Album: Imprint/Promotion Label:, Artist: 50 Album: American Dream, Artist: 41 Album: Imprint/Promotion Label:, Artist: 1 Album: Her Loss, Artist: 50 Album: Imprint/Promotion Label:, Artist: 39 Album: Gold: Greatest Hits, Artist: Luke Combs Album: Imprint/Promotion Label:, Artist: 36 Album: Primera Musa, Artist: 4 Album: Imprint/Promotion Label:, Artist: 384 Album: Greatest Hits, Artist: 36 Album: Imprint/Promotion Label:, Artist: 4 Album: PARTYNEXTDOOR 4 (P4), Artist: 384 Album: Imprint/Promotion Label:, Artist: 40 Album: All Time Greatest Hits, Artist: Creedence Clearwater Revival Album: Imprint/Promotion Label:, Artist: 39 Album: Greatest Hits, Artist: 18 Album: Imprint/Promotion Label:, Artist: 715 Album: Confessions, Artist: 39 Album: Imprint/Promotion Label:, Artist: 18 Album: DS2, Artist: 715 Album: Imprint/Promotion Label:, Artist: 41 Album: Tha Carter III, Artist: Peso Pluma Album: Imprint/Promotion Label:, Artist: 37 Album: ?, Artist: 3 Album: Imprint/Promotion Label:, Artist: 68 Album: Tim Burton's The Nightmare Before Christmas, Artist: 37 Album: Imprint/Promotion Label:, Artist: 3 Album: El Comienzo, Artist: 68 Album: Imprint/Promotion Label:, Artist: 42 Album: Their Greatest Hits 1971-1975, Artist: Elton John Album: Imprint/Promotion Label:, Artist: 42 Album: Summertime Blues, Artist: 7 Album: Imprint/Promotion Label:, Artist: 361 Album: Future Nostalgia, Artist: 42 Album: Imprint/Promotion Label:, Artist: 7 Album: Scarlet, Artist: 361 Album: Imprint/Promotion Label:, Artist: 43 Album: Child Of God, Artist: Kendrick Lamar Album: Imprint/Promotion Label:, Artist: 46 Album: Manana Sera Bonito, Artist: 1 Album: Imprint/Promotion Label:, Artist: 391 Album: Hungover, Artist: 46 Album: Imprint/Promotion Label:, Artist: 1 Album: Greatest Hits, Artist: 391 Album: Imprint/Promotion Label:, Artist: 44 Album: Luv Is Rage 2, Artist: Olivia Rodrigo Album: Imprint/Promotion Label:, Artist: 44 Album: Greatest Hits: The Ultimate Collection, Artist: 1 Album: Imprint/Promotion Label:, Artist: 177 Album: Megan, Artist: 44 Album: Imprint/Promotion Label:, Artist: 1 Album: Bewitched, Artist: 177 Album: Imprint/Promotion Label:, Artist: 45 Album: Greatest Hits, Artist: Don Toliver Album: Imprint/Promotion Label:, Artist: 49 Album: I Will Always Love You: The Best Of Whitney Houston, Artist: 3 Album: Imprint/Promotion Label:, Artist: 17 Album: Currents, Artist: 49 Album: Imprint/Promotion Label:, Artist: 3 Album: Dont Smile At Me, Artist: 17 Album: Imprint/Promotion Label:, Artist: 46 Album: Unheard (EP), Artist: Linkin Park Album: Imprint/Promotion Label:, Artist: 43 Album: Greatest Hits Vol. I, Artist: 6 Album: Imprint/Promotion Label:, Artist: 24 Album: Purgatory, Artist: 43 Album: Imprint/Promotion Label:, Artist: 6 Album: Good Girl Gone Bad, Artist: 24 Album: Imprint/Promotion Label:, Artist: 47 Album: Livin' My Best Life, Artist: The Weeknd Album: Imprint/Promotion Label:, Artist: 135 Album: Metallica, Artist: 2 Album: Imprint/Promotion Label:, Artist: 186 Album: Greatest Hits, Artist: 135 Album: Imprint/Promotion Label:, Artist: 2 Album: Romance : Untold, Artist: 186 Album: Imprint/Promotion Label:, Artist: 48 Album: Todavia Me Amas: Lo Mejor de Aventura, Artist: Bad Bunny Album: Imprint/Promotion Label:, Artist: 47 Album: Toxicity, Artist: 1 Album: Imprint/Promotion Label:, Artist: 127 Album: Cowboy Carter, Artist: 47 Album: Imprint/Promotion Label:, Artist: 1 Album: Submarine, Artist: 127 Album: Imprint/Promotion Label:, Artist: 49 Album: Larger Than Life, Artist: Kendrick Lamar Album: Imprint/Promotion Label:, Artist: 48 Album: Odies But Goodies, Artist: 2 Album: Imprint/Promotion Label:, Artist: 624 Album: Elv1s: 30 #1 Hits, Artist: 48 Album: Imprint/Promotion Label:, Artist: 2 Album: T-Pain Presents Happy Hour: The Greatest Hits, Artist: 624 Album: Imprint/Promotion Label:, Artist: 50 Album: We Still Don't Trust You, Artist: NEW Album: Imprint/Promotion Label:, Artist: NEW Album: 4 (EP), Artist: Toosii Album: Imprint/Promotion Label:, Artist: - Album: Mr. Beat The Road, Artist: 50 Album: Imprint/Promotion Label:, Artist: 1 Album: Slut SZN, Artist: - Album: Imprint/Promotion Label:, Artist: 50 Album: Barbie: The Album, Artist: 1 Album: Imprint/Promotion Label:, Artist: 51 Album: TMZ Posts, Then Removes, Liam Payne Death Photos After Backlash, Artist: Sabrina Carpenter Album: Serena Williams’ Daughters Are Beautiful in Bows as They Model for Their Mama in Adorable New Photos, Artist: 50 Album: Jason Lee Claims Beyoncé, JAY-Z Called Him Over Diddy Allegations, Artist: 23 Album: Deshaun Watson Achilles Injury Has Contractual Implications, Artist: 55 Album: ABC News Ups Chris Dinan to EP of ‘World News Tonight’, Artist: 50 Album: Young Thug Pleads For Peace Treaty Among Metro Boomin, Drake, And Future, Artist: 23 Album: Pamela Anderson Favors Subdued Elegance in The Row’s Boxy Column Gown at Academy Museum Gala 2024, Artist: 55 Album: Sportradar Buying Saturday Down South, Other U.S. Publications, Artist: 52 Album: Morgan Wallen Unveils ‘Sand in My Boots’ Music Festival Lineup With Post Malone, Hardy, T-Pain, Artist: NEW Album: Follow Us, Artist: NEW Album: Have a Tip?, Artist: The Smile Album: The Daily, Artist: - Album: Have a Tip?, Artist: 52
Now, let's extract data for a specific artist using beautifulsoup4
In [37]:
chart_data = []
for row in soup.find_all('li', class_='o-chart-results-list__item'):
title_tag = row.find('h3', class_='c-title')
artist_tag = row.find('span', class_='c-label')
if title_tag and artist_tag:
title = title_tag.text.strip()
artist = artist_tag.text.strip()
chart_data.append([title, artist])
Create a DataFrame. Creating a DataFrame using pandas(pd) helps to organize and manipulate the extracted data efficiently. You can perform statistical analyses and generate visualizations to identify trends and patterns.
In [39]:
import pandas as pd
df = pd.DataFrame(chart_data, columns=['Title', 'Artist'])
Filter Data for Future: This could be helpful for labels, artists, and even fans to see the trend in the popularity of one of their favorite artists. Tracking specific artists like Future allows for an understanding of their impact and how their music shapes and reflects listener preferences.
In [41]:
artist_search = 'Future'
future_data = df[df['Artist'].str.contains(artist_search, case=False)]
print(future_data)
Title Artist 7 Mixtape Pluto Future 32 We Don't Trust You Future & Metro Boomin 74 I Never Liked You Future 158 DS2 Future 195 We Still Don't Trust You Future & Metro Boomin
Save Data; By saving data periodically, you can track trends and changes in listening habits over time, offering a longitudinal perspective.
In [67]:
future_data.to_csv('future_chart_data.csv', index=False)