Beautifulsoup4 Dylan and Jalen.

For our midterm assignment, we will show how to use beautifulsoup4 to extract chart data from Billboard's top 200. Chart data reveals what people consume and enjoy, providing insights into consumer preferences and behaviors.

What is beautifulsoup4? BeautifulSoup4 is a strong, flexible package inside the Python library, used for web scraping, parsing HTML or XML documents, and extracting data from web pages. Thanks to its beautiful, human-readable API(Application Programming Interface), BeautifulSoup is, well, beautiful like a Swiss Army knife because of its web scraping ability to navigate and extract data from web pages efficiently. How is it efficient? It is beginner friendly and easy to set up while the library functions without relying on browsers and of course it is fast.

First, install the package 'beautifulsoup4'

In [1]:
pip install requests beautifulsoup4

Requirement already satisfied: requests in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (2.32.3)
Requirement already satisfied: beautifulsoup4 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (4.12.3)
Requirement already satisfied: charset-normalizer<4,>=2 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from requests) (2024.7.4)
Requirement already satisfied: soupsieve>1.2 in /opt/anaconda3/2024.06/envs/PSYC3830/lib/python3.12/site-packages (from beautifulsoup4) (2.6)
Note: you may need to restart the kernel to use updated packages.

Import package and Fetch html website from Billboard 200 and request content.

In [31]:
import requests
from bs4 import BeautifulSoup
url = 'https://www.billboard.com/charts/billboard-200'
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36'}
response = requests.get(url,headers = headers)
html_content = response.content

After this, parse the HTML Content.

In [ ]:
soup = BeautifulSoup(html_content, 'html.parser')
soup

Extract Data from Billboard 200 using Beautiful Soup to find and extract the relevant data. For example, to get the top 200 list of album titles and artists:

In [35]:
albums = soup.find_all('h3', class_='c-title')
artists = soup.find_all('span', class_='c-label')

for album, artist in zip(albums, artists):
    print(f"Album: {album.text.strip()}, Artist: {artist.text.strip()}")

Album: Moon Music, Artist: 1
Album: Imprint/Promotion Label:, Artist: NEW
Album: Charli XCX's 'Brat' Tops U.K. Album Charts Following Star-Studded Remixes, Artist: NEW
Album: Gains in Weekly Performance, Artist: Coldplay
Album: Additional Awards, Artist: -
Album: Moon Music, Artist: 1
Album: Imprint/Promotion Label:, Artist: 1
Album: Short n' Sweet, Artist: -
Album: Imprint/Promotion Label:, Artist: 1
Album: The Rise And Fall Of A Midwest Princess, Artist: 1
Album: Imprint/Promotion Label:, Artist: 2
Album: One Thing At A Time, Artist: Sabrina Carpenter
Album: Imprint/Promotion Label:, Artist: 1
Album: Hit Me Hard And Soft, Artist: 1
Album: Imprint/Promotion Label:, Artist: 7
Album: The Tortured Poets Department, Artist: 1
Album: Imprint/Promotion Label:, Artist: 1
Album: F-1 Trillion, Artist: 7
Album: Imprint/Promotion Label:, Artist: 3
Album: Mixtape Pluto, Artist: Chappell Roan
Album: Imprint/Promotion Label:, Artist: 2
Album: Stick Season, Artist: 2
Album: Imprint/Promotion Label:, Artist: 29
Album: Dangerous: The Double Album, Artist: 2
Album: Imprint/Promotion Label:, Artist: 2
Album: Incomodo, Artist: 29
Album: Imprint/Promotion Label:, Artist: 4
Album: SOS, Artist: Morgan Wallen
Album: Imprint/Promotion Label:, Artist: 4
Album: The Great American Bar Scene, Artist: 1
Album: Imprint/Promotion Label:, Artist: 84
Album: Brat, Artist: 4
Album: Imprint/Promotion Label:, Artist: 1
Album: Zach Bryan, Artist: 84
Album: Imprint/Promotion Label:, Artist: 5
Album: Fireworks & Rollerblades, Artist: Billie Eilish
Album: Imprint/Promotion Label:, Artist: 5
Album: Exodo, Artist: 2
Album: Imprint/Promotion Label:, Artist: 21
Album: American Heartbreak, Artist: 5
Album: Imprint/Promotion Label:, Artist: 2
Album: Where I've Been, Isn't Where I'm Going, Artist: 21
Album: Imprint/Promotion Label:, Artist: 6
Album: The Secret Of Us, Artist: Taylor Swift
Album: Imprint/Promotion Label:, Artist: 7
Album: Am I Okay?, Artist: 1
Album: Imprint/Promotion Label:, Artist: 25
Album: The Death Of Slim Shady (Coup de Grace), Artist: 7
Album: Imprint/Promotion Label:, Artist: 1
Album: I've Tried Everything But Therapy (Part I), Artist: 25
Album: Imprint/Promotion Label:, Artist: 7
Album: Folklore, Artist: Post Malone
Album: Imprint/Promotion Label:, Artist: 6
Album: Lover, Artist: 1
Album: Imprint/Promotion Label:, Artist: 8
Album: Utopia, Artist: 6
Album: Imprint/Promotion Label:, Artist: 1
Album: Curtain Call: The Hits, Artist: 8
Album: Imprint/Promotion Label:, Artist: 8
Album: +-=÷x (Tour Collection), Artist: Future
Album: Imprint/Promotion Label:, Artist: 3
Album: Guts, Artist: 1
Album: Imprint/Promotion Label:, Artist: 3
Album: For All The Dogs, Artist: 3
Album: Imprint/Promotion Label:, Artist: 1
Album: Midnights, Artist: 3
Album: Imprint/Promotion Label:, Artist: 9
Album: Blonde, Artist: Noah Kahan
Album: Imprint/Promotion Label:, Artist: 8
Album: We Don't Trust You, Artist: 2
Album: Imprint/Promotion Label:, Artist: 98
Album: Eternal Sunshine, Artist: 8
Album: Imprint/Promotion Label:, Artist: 2
Album: The Diamond Collection, Artist: 98
Album: Imprint/Promotion Label:, Artist: 10
Album: Twisters: The Album, Artist: Morgan Wallen
Album: Imprint/Promotion Label:, Artist: 10
Album: Rumours, Artist: 1
Album: Imprint/Promotion Label:, Artist: 196
Album: 1989 (Taylor's Version), Artist: 10
Album: Imprint/Promotion Label:, Artist: 1
Album: This One's For You, Artist: 196
Album: Imprint/Promotion Label:, Artist: 11
Album: Chronicle: The 20 Greatest Hits, Artist: Tito Double P
Album: Imprint/Promotion Label:, Artist: 13
Album: Genesis, Artist: 11
Album: Imprint/Promotion Label:, Artist: 7
Album: Diamonds, Artist: 13
Album: Imprint/Promotion Label:, Artist: 11
Album: DAMN., Artist: 7
Album: Imprint/Promotion Label:, Artist: 12
Album: Sour, Artist: SZA
Album: Imprint/Promotion Label:, Artist: 12
Album: Hardstone Psycho, Artist: 1
Album: Imprint/Promotion Label:, Artist: 96
Album: Papercuts, Artist: 12
Album: Imprint/Promotion Label:, Artist: 1
Album: The Highlights, Artist: 96
Album: Imprint/Promotion Label:, Artist: 13
Album: Un Verano Sin Ti, Artist: Zach Bryan
Album: Imprint/Promotion Label:, Artist: 9
Album: good kid, m.A.A.d city, Artist: 2
Album: Imprint/Promotion Label:, Artist: 15
Album: Jaded, Artist: 9
Album: Imprint/Promotion Label:, Artist: 2
Album: Emails I Can't Send, Artist: 15
Album: Imprint/Promotion Label:, Artist: 14
Album: Cutouts, Artist: Charli xcx
Album: Imprint/Promotion Label:, Artist: 15
Album: Speak Now, Artist: 3
Album: Imprint/Promotion Label:, Artist: 18
Album: A Great Chaos, Artist: 15
Album: Imprint/Promotion Label:, Artist: 3
Album: Take Care, Artist: 18
Album: Imprint/Promotion Label:, Artist: 15
Album: Ctrl, Artist: Zach Bryan
Album: Imprint/Promotion Label:, Artist: 14
Album: Hozier, Artist: 1
Album: Imprint/Promotion Label:, Artist: 59
Album: Leon, Artist: 14
Album: Imprint/Promotion Label:, Artist: 1
Album: Greatest Hits, Artist: 59
Album: Imprint/Promotion Label:, Artist: 16
Album: Post Traumatic, Artist: Benson Boone
Album: Imprint/Promotion Label:, Artist: 19
Album: Graduation, Artist: 6
Album: Imprint/Promotion Label:, Artist: 27
Album: Hollywood's Bleeding, Artist: 19
Album: Imprint/Promotion Label:, Artist: 6
Album: The First Time, Artist: 27
Album: Imprint/Promotion Label:, Artist: 17
Album: Red (Taylor's Version), Artist: Peso Pluma
Album: Imprint/Promotion Label:, Artist: 18
Album: California Gold, Artist: 5
Album: Imprint/Promotion Label:, Artist: 16
Album: Gettin' Old, Artist: 18
Album: Imprint/Promotion Label:, Artist: 5
Album: reputation, Artist: 16
Album: Imprint/Promotion Label:, Artist: 18
Album: Pa Las Baby's y Belikeada, Artist: Zach Bryan
Album: Imprint/Promotion Label:, Artist: 17
Album: Channel Orange, Artist: 5
Album: Imprint/Promotion Label:, Artist: 125
Album: My Turn, Artist: 17
Album: Imprint/Promotion Label:, Artist: 5
Album: One Of Wun, Artist: 125
Album: Imprint/Promotion Label:, Artist: 19
Album: Cold Beer & Country Music, Artist: Shaboozey
Album: Imprint/Promotion Label:, Artist: 16
Album: $ad Boyz 4 Life II, Artist: 5
Album: Imprint/Promotion Label:, Artist: 19
Album: Starboy, Artist: 16
Album: Imprint/Promotion Label:, Artist: 5
Album: I Never Liked You, Artist: 19
Album: Imprint/Promotion Label:, Artist: 20
Album: ASTROWORLD, Artist: Gracie Abrams
Album: Imprint/Promotion Label:, Artist: 27
Album: The Best Of Nickelback: Volume 1, Artist: 2
Album: Imprint/Promotion Label:, Artist: 16
Album: If I Know Me, Artist: 27
Album: Imprint/Promotion Label:, Artist: 2
Album: Certified Lover Boy, Artist: 16
Album: Imprint/Promotion Label:, Artist: 21
Album: When We All Fall Asleep, Where Do We Go?, Artist: Megan Moroney
Album: Imprint/Promotion Label:, Artist: 77
Album: Greatest Hits, Artist: 9
Album: Imprint/Promotion Label:, Artist: 13
Album: For Cryin' Out Loud!, Artist: 77
Album: Imprint/Promotion Label:, Artist: 9
Album: Heroes & Villains, Artist: 13
Album: Imprint/Promotion Label:, Artist: 22
Album: Traveller, Artist: Eminem
Album: Imprint/Promotion Label:, Artist: 24
Album: Hamilton: An American Musical, Artist: 1
Album: Imprint/Promotion Label:, Artist: 13
Album: Religiously. The Album., Artist: 24
Album: Imprint/Promotion Label:, Artist: 1
Album: Waves On A Sunset, Artist: 13
Album: Imprint/Promotion Label:, Artist: 23
Album: [Hybrid Theory], Artist: Teddy Swims
Album: Imprint/Promotion Label:, Artist: 23
Album: Thriller, Artist: 17
Album: Imprint/Promotion Label:, Artist: 53
Album: T R A P S O U L, Artist: 23
Album: Imprint/Promotion Label:, Artist: 17
Album: Journey's Greatest Hits, Artist: 53
Album: Imprint/Promotion Label:, Artist: 24
Album: Born To Die, Artist: Taylor Swift
Album: Imprint/Promotion Label:, Artist: 21
Album: Legend: The Best Of Bob Marley And The Wailers, Artist: 1
Album: Imprint/Promotion Label:, Artist: 220
Album: Evermore, Artist: 21
Album: Imprint/Promotion Label:, Artist: 1
Album: Nostalgia, Artist: 220
Album: Imprint/Promotion Label:, Artist: 25
Album: Nevermind, Artist: Taylor Swift
Album: Imprint/Promotion Label:, Artist: 26
Album: Goodbye & Good Riddance, Artist: 1
Album: Imprint/Promotion Label:, Artist: 268
Album: Think Later, Artist: 26
Album: Imprint/Promotion Label:, Artist: 1
Album: Greatest Hits, Artist: 268
Album: Imprint/Promotion Label:, Artist: 26
Album: Cardinals At The Window:A Benefit For Flood Relief In Western NorthCarolina, Artist: Travis Scott
Album: Imprint/Promotion Label:, Artist: 32
Album: Views, Artist: 1
Album: Imprint/Promotion Label:, Artist: 63
Album: Ate: Mini Album (EP), Artist: 32
Album: Imprint/Promotion Label:, Artist: 1
Album: The Very Best Of Daryl Hall  John Oates, Artist: 63
Album: Imprint/Promotion Label:, Artist: 27
Album: 2014 Forest Hills Drive, Artist: Eminem
Album: Imprint/Promotion Label:, Artist: 38
Album: What You See Is What You Get, Artist: 1
Album: Imprint/Promotion Label:, Artist: 705
Album: Muse, Artist: 38
Album: Imprint/Promotion Label:, Artist: 1
Album: After Hours, Artist: 705
Album: Imprint/Promotion Label:, Artist: 28
Album: ANTI, Artist: Ed Sheeran
Album: Imprint/Promotion Label:, Artist: 28
Album: The Fame, Artist: 28
Album: Imprint/Promotion Label:, Artist: 2
Album: Greatest Hits, Artist: 28
Album: Imprint/Promotion Label:, Artist: 28
Album: Happier Than Ever, Artist: 2
Album: Imprint/Promotion Label:, Artist: 29
Album: Teenage Dream, Artist: Olivia Rodrigo
Album: Imprint/Promotion Label:, Artist: 35
Album: You'll Be Alright, Kid (Chapter 1), Artist: 1
Album: Imprint/Promotion Label:, Artist: 57
Album: 35 Biggest Hits, Artist: 35
Album: Imprint/Promotion Label:, Artist: 1
Album: Sugar Honey Iced Tea, Artist: 57
Album: Imprint/Promotion Label:, Artist: 30
Album: IGOR, Artist: Drake
Album: Imprint/Promotion Label:, Artist: 33
Album: New World Depression, Artist: 1
Album: Imprint/Promotion Label:, Artist: 53
Album: Pero No Te Enamores, Artist: 33
Album: Imprint/Promotion Label:, Artist: 1
Album: Plan A, Artist: 53
Album: Imprint/Promotion Label:, Artist: 31
Album: Scorpion, Artist: Taylor Swift
Album: Imprint/Promotion Label:, Artist: 34
Album: Greatest Hits, Artist: 1
Album: Imprint/Promotion Label:, Artist: 103
Album: Over It, Artist: 34
Album: Imprint/Promotion Label:, Artist: 1
Album: AM, Artist: 103
Album: Imprint/Promotion Label:, Artist: 32
Album: Starting Over, Artist: Frank Ocean
Album: Imprint/Promotion Label:, Artist: 31
Album: Whitsitt Chapel, Artist: 1
Album: Imprint/Promotion Label:, Artist: 403
Album: Beauty Behind The Madness, Artist: 31
Album: Imprint/Promotion Label:, Artist: 1
Album: Cigarettes After Sex, Artist: 403
Album: Imprint/Promotion Label:, Artist: 33
Album: Nadie Sabe Lo Que Va A Pasar Manana, Artist: Future & Metro Boomin
Album: Imprint/Promotion Label:, Artist: 29
Album: Doo-Wops & Hooligans, Artist: 1
Album: Imprint/Promotion Label:, Artist: 29
Album: 50 Number Ones, Artist: 29
Album: Imprint/Promotion Label:, Artist: 1
Album: Higher, Artist: 29
Album: Imprint/Promotion Label:, Artist: 34
Album: Greatest Hits, Artist: Ariana Grande
Album: Imprint/Promotion Label:, Artist: 45
Album: Mirada, Artist: 1
Album: Imprint/Promotion Label:, Artist: 31
Album: 11:11, Artist: 45
Album: Imprint/Promotion Label:, Artist: 1
Album: Selected Ambient Works, Volume II, Artist: 31
Album: Imprint/Promotion Label:, Artist: 35
Album: 9 Lives, Artist: Post Malone
Album: Imprint/Promotion Label:, Artist: 11
Album: Ehhthang Ehhthang, Artist: 11
Album: Imprint/Promotion Label:, Artist: 47
Album: Get Rich Or Die Tryin', Artist: 11
Album: Imprint/Promotion Label:, Artist: 11
Album: Amar, Artist: 47
Album: Imprint/Promotion Label:, Artist: 36
Album: Elisabeth, Artist: Soundtrack
Album: Imprint/Promotion Label:, Artist: 30
Album: Charm, Artist: 7
Album: Imprint/Promotion Label:, Artist: 12
Album: 7220, Artist: 30
Album: Imprint/Promotion Label:, Artist: 7
Album: My Beautiful Dark Twisted Fantasy, Artist: 12
Album: Imprint/Promotion Label:, Artist: 37
Album: Speak Now (Taylor's Version), Artist: Fleetwood Mac
Album: Imprint/Promotion Label:, Artist: 40
Album: 20 Number Ones, Artist: 1
Album: Imprint/Promotion Label:, Artist: 602
Album: Flower Boy, Artist: 40
Album: Imprint/Promotion Label:, Artist: 1
Album: SoulFly, Artist: 602
Album: Imprint/Promotion Label:, Artist: 38
Album: Planet Her, Artist: Taylor Swift
Album: Imprint/Promotion Label:, Artist: 41
Album: Freudian, Artist: 1
Album: Imprint/Promotion Label:, Artist: 50
Album: American Dream, Artist: 41
Album: Imprint/Promotion Label:, Artist: 1
Album: Her Loss, Artist: 50
Album: Imprint/Promotion Label:, Artist: 39
Album: Gold: Greatest Hits, Artist: Luke Combs
Album: Imprint/Promotion Label:, Artist: 36
Album: Primera Musa, Artist: 4
Album: Imprint/Promotion Label:, Artist: 384
Album: Greatest Hits, Artist: 36
Album: Imprint/Promotion Label:, Artist: 4
Album: PARTYNEXTDOOR 4 (P4), Artist: 384
Album: Imprint/Promotion Label:, Artist: 40
Album: All Time Greatest Hits, Artist: Creedence Clearwater Revival
Album: Imprint/Promotion Label:, Artist: 39
Album: Greatest Hits, Artist: 18
Album: Imprint/Promotion Label:, Artist: 715
Album: Confessions, Artist: 39
Album: Imprint/Promotion Label:, Artist: 18
Album: DS2, Artist: 715
Album: Imprint/Promotion Label:, Artist: 41
Album: Tha Carter III, Artist: Peso Pluma
Album: Imprint/Promotion Label:, Artist: 37
Album: ?, Artist: 3
Album: Imprint/Promotion Label:, Artist: 68
Album: Tim Burton's The Nightmare Before Christmas, Artist: 37
Album: Imprint/Promotion Label:, Artist: 3
Album: El Comienzo, Artist: 68
Album: Imprint/Promotion Label:, Artist: 42
Album: Their Greatest Hits 1971-1975, Artist: Elton John
Album: Imprint/Promotion Label:, Artist: 42
Album: Summertime Blues, Artist: 7
Album: Imprint/Promotion Label:, Artist: 361
Album: Future Nostalgia, Artist: 42
Album: Imprint/Promotion Label:, Artist: 7
Album: Scarlet, Artist: 361
Album: Imprint/Promotion Label:, Artist: 43
Album: Child Of God, Artist: Kendrick Lamar
Album: Imprint/Promotion Label:, Artist: 46
Album: Manana Sera Bonito, Artist: 1
Album: Imprint/Promotion Label:, Artist: 391
Album: Hungover, Artist: 46
Album: Imprint/Promotion Label:, Artist: 1
Album: Greatest Hits, Artist: 391
Album: Imprint/Promotion Label:, Artist: 44
Album: Luv Is Rage 2, Artist: Olivia Rodrigo
Album: Imprint/Promotion Label:, Artist: 44
Album: Greatest Hits: The Ultimate Collection, Artist: 1
Album: Imprint/Promotion Label:, Artist: 177
Album: Megan, Artist: 44
Album: Imprint/Promotion Label:, Artist: 1
Album: Bewitched, Artist: 177
Album: Imprint/Promotion Label:, Artist: 45
Album: Greatest Hits, Artist: Don Toliver
Album: Imprint/Promotion Label:, Artist: 49
Album: I Will Always Love You: The Best Of Whitney Houston, Artist: 3
Album: Imprint/Promotion Label:, Artist: 17
Album: Currents, Artist: 49
Album: Imprint/Promotion Label:, Artist: 3
Album: Dont Smile At Me, Artist: 17
Album: Imprint/Promotion Label:, Artist: 46
Album: Unheard (EP), Artist: Linkin Park
Album: Imprint/Promotion Label:, Artist: 43
Album: Greatest Hits Vol. I, Artist: 6
Album: Imprint/Promotion Label:, Artist: 24
Album: Purgatory, Artist: 43
Album: Imprint/Promotion Label:, Artist: 6
Album: Good Girl Gone Bad, Artist: 24
Album: Imprint/Promotion Label:, Artist: 47
Album: Livin' My Best Life, Artist: The Weeknd
Album: Imprint/Promotion Label:, Artist: 135
Album: Metallica, Artist: 2
Album: Imprint/Promotion Label:, Artist: 186
Album: Greatest Hits, Artist: 135
Album: Imprint/Promotion Label:, Artist: 2
Album: Romance : Untold, Artist: 186
Album: Imprint/Promotion Label:, Artist: 48
Album: Todavia Me Amas: Lo Mejor de Aventura, Artist: Bad Bunny
Album: Imprint/Promotion Label:, Artist: 47
Album: Toxicity, Artist: 1
Album: Imprint/Promotion Label:, Artist: 127
Album: Cowboy Carter, Artist: 47
Album: Imprint/Promotion Label:, Artist: 1
Album: Submarine, Artist: 127
Album: Imprint/Promotion Label:, Artist: 49
Album: Larger Than Life, Artist: Kendrick Lamar
Album: Imprint/Promotion Label:, Artist: 48
Album: Odies But Goodies, Artist: 2
Album: Imprint/Promotion Label:, Artist: 624
Album: Elv1s: 30 #1 Hits, Artist: 48
Album: Imprint/Promotion Label:, Artist: 2
Album: T-Pain Presents Happy Hour: The Greatest Hits, Artist: 624
Album: Imprint/Promotion Label:, Artist: 50
Album: We Still Don't Trust You, Artist: NEW
Album: Imprint/Promotion Label:, Artist: NEW
Album: 4 (EP), Artist: Toosii
Album: Imprint/Promotion Label:, Artist: -
Album: Mr. Beat The Road, Artist: 50
Album: Imprint/Promotion Label:, Artist: 1
Album: Slut SZN, Artist: -
Album: Imprint/Promotion Label:, Artist: 50
Album: Barbie: The Album, Artist: 1
Album: Imprint/Promotion Label:, Artist: 51
Album: TMZ Posts, Then Removes, Liam Payne Death Photos After Backlash, Artist: Sabrina Carpenter
Album: Serena Williams’ Daughters Are Beautiful in Bows as They Model for Their Mama in Adorable New Photos, Artist: 50
Album: Jason Lee Claims Beyoncé, JAY-Z Called Him Over Diddy Allegations, Artist: 23
Album: Deshaun Watson Achilles Injury Has Contractual Implications, Artist: 55
Album: ABC News Ups Chris Dinan to EP of ‘World News Tonight’, Artist: 50
Album: Young Thug Pleads For Peace Treaty Among Metro Boomin, Drake, And Future, Artist: 23
Album: Pamela Anderson Favors Subdued Elegance in The Row’s Boxy Column Gown at Academy Museum Gala 2024, Artist: 55
Album: Sportradar Buying Saturday Down South, Other U.S. Publications, Artist: 52
Album: Morgan Wallen Unveils ‘Sand in My Boots’ Music Festival Lineup With Post Malone, Hardy, T-Pain, Artist: NEW
Album: Follow Us, Artist: NEW
Album: Have a Tip?, Artist: The Smile
Album: The Daily, Artist: -
Album: Have a Tip?, Artist: 52

Now, let's extract data for a specific artist using beautifulsoup4

In [37]:
chart_data = []
for row in soup.find_all('li', class_='o-chart-results-list__item'):
    title_tag = row.find('h3', class_='c-title')
    artist_tag = row.find('span', class_='c-label')
    if title_tag and artist_tag:
        title = title_tag.text.strip()
        artist = artist_tag.text.strip()
        chart_data.append([title, artist])

Create a DataFrame. Creating a DataFrame using pandas(pd) helps to organize and manipulate the extracted data efficiently. You can perform statistical analyses and generate visualizations to identify trends and patterns.

In [39]:
import pandas as pd
df = pd.DataFrame(chart_data, columns=['Title', 'Artist'])

Filter Data for Future: This could be helpful for labels, artists, and even fans to see the trend in the popularity of one of their favorite artists. Tracking specific artists like Future allows for an understanding of their impact and how their music shapes and reflects listener preferences.

In [41]:
artist_search = 'Future'
future_data = df[df['Artist'].str.contains(artist_search, case=False)]
print(future_data)

                        Title                 Artist
7               Mixtape Pluto                 Future
32         We Don't Trust You  Future & Metro Boomin
74          I Never Liked You                 Future
158                       DS2                 Future
195  We Still Don't Trust You  Future & Metro Boomin

Save Data; By saving data periodically, you can track trends and changes in listening habits over time, offering a longitudinal perspective.

In [67]:
future_data.to_csv('future_chart_data.csv', index=False)