What is RedditExtractoR?

RedditExtractoR is a package that allows us to scrape data from Reddit, including the names of subrredits, their threads, the information related to the threads (such as the usernames of authors), and information on the users themselves. We can use the information collected to study in-group vs. out-group dynamics on social media. Do housewives fans join a particular “team” based around their opinions of a certain cast member?

Functions To Be Used

  1. find_thread_urls(subreddit=, sort_by=, keywords=)
  2. get_thread_content
  3. get_user_content
  4. find_subreddits

Installing the Package

Before we begin coding, I will install and import RedditExtractoR. To install the package, we will use the “install.packages()” function. Once we have installed the function, we will upload it to our library, using “library()”

# main package
install.packages("RedditExtractoR")
## Installing package into '/Users/benjaminsilver/Library/R/x86_64/4.2/library'
## (as 'lib' is unspecified)
## 
## The downloaded binary packages are in
##  /var/folders/pp/lk19kb4d6_g2vn0f30qf_zv40000gn/T//RtmpjMHPcY/downloaded_packages
library(RedditExtractoR)

Finding Subreddits

Now that we have installed and imported RedditExtractoR, we will use it to find potential subreddits to study. I am interested in the Real Housewives franchise, so let’s find all the subreddits that contain “Real Housewives of”. We will load this list of subreddits into the variable “rh_subreddits”. We can use “str()” to print our data frame, or we can access the list in the “Environment” tab.

rh_subreddits<- find_subreddits("RealHousewivesof")
## parsing URLs on page 1...
str(rh_subreddits)
## 'data.frame':    8 obs. of  7 variables:
##  $ id         : chr  "7kubgx" "5qzwq9" "2lkt4f" "a3jlzc" ...
##  $ date_utc   : chr  "2022-12-14" "2022-01-27" "2020-04-22" "2023-11-24" ...
##  $ timestamp  : num  1.67e+09 1.64e+09 1.59e+09 1.70e+09 1.65e+09 ...
##  $ subreddit  : chr  "realhousewivesofSLC" "RealHousewivesofOC" "RealHousewivesofATL" "RealHousewivesofBUDAP" ...
##  $ title      : chr  "realhousewivesofSLC" "The Real Housewives of Orange County" "RealHousewivesofATL" "RealHousewivesofBUDAP" ...
##  $ description: chr  "Anything goes! Let\031s discuss, chat, talk shit, predict, and enjoy all the drama of the Salt Lake City housewives! " "The Real Housewives of Orange County. Let's discuss episodes :) \nCurrently: Season 18!" "A sub dedicated to the Bravo TV show, The Real Housewives of Atlanta" "" ...
##  $ subscribers: num  16197 5556 3777 20 244 ...

Retrieving Data on a Subreddit

There are 8 subreddits dedicated to the Real Housewives franchise. After looking over the subreddits, I will choose Real Housewives of Dubai as my subreddit of interest because they’ve recently had a reunion for season 2, so fans will be more inclined to comment and share their agreements/disagreements with each other and certain cast members.

First, let’s find all the URLs for threads related to either season 2 or the season 2 reunion with the function “find_thread_urls()”. We will store this list of URLs under the variable “rhod_url”, and will use the keywords “season 2” and “season 2 reunion” to filter the threads.

rhod_url <- find_thread_urls(subreddit = "RealHousewivesofDubai", keywords = "season 2, season 2 reunion")
## parsing URLs on page 1...
str(rhod_url)
## 'data.frame':    14 obs. of  7 variables:
##  $ date_utc : chr  "2024-09-25" "2024-10-03" "2024-09-18" "2024-10-03" ...
##  $ timestamp: num  1.73e+09 1.73e+09 1.73e+09 1.73e+09 1.73e+09 ...
##  $ title    : chr  "Season 3 cancelled?? Really?" "Stanbury now and then..." "Now that the season is over&do you think there will be a season 3?" "Season 3 Cast " ...
##  $ text     : chr  "Does anyone know if the rumors are true that there won't be a third season if Dubai due to bad audience figures"| __truncated__ "I'm currently watching the second season of Ladies of London. I'm a big fan of Caroline Stanbury in the Dubai s"| __truncated__ "\nI have to admit I do think Dubai is underrated. I also think if they would have actually showed it when it wa"| __truncated__ "Do you guys think that Saba will join for season 3? I personally hope not she\031s just as boring as Sara if no"| __truncated__ ...
##  $ subreddit: chr  "RealHousewivesOfDubai" "RealHousewivesOfDubai" "RealHousewivesOfDubai" "RealHousewivesOfDubai" ...
##  $ comments : num  99 49 36 23 16 7 6 10 1 5 ...
##  $ url      : chr  "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fp5m6y/season_3_cancelled_really/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fv41pp/stanbury_now_and_then/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fjiaxm/now_that_the_season_is_overdo_you_think_there/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fvhcz2/season_3_cast/" ...

There are 14 relevant threads (i.e match the criteria of being a part of the Real Housewives of Dubai subreddit and being about season 2 and/or its reunion). We can access the following data on these threads: their urls, number of comments, the title of the subreddit they belong to, their body text, and their date and timestamp.

Now, let’s dive deeper into the content of each thread.

Retrieving the Content of Threads

Now that we have the URLs of threads referencing season 2 and/or its reunion, we can look deeper at the content within this thread, such as the responses and their authors, using the function “get_thread_content”. I will store this list of content in “rhod_season2_content”.

rhod_season2_content <- get_thread_content(rhod_url$url[1:14]) # make sure to set the numbers to include the number of observations in "rhod_url". 
str(rhod_season2_content$threads)
## 'data.frame':    14 obs. of  15 variables:
##  $ url                  : chr  "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fp5m6y/season_3_cancelled_really/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fv41pp/stanbury_now_and_then/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fjiaxm/now_that_the_season_is_overdo_you_think_there/" "https://www.reddit.com/r/RealHousewivesOfDubai/comments/1fvhcz2/season_3_cast/" ...
##  $ author               : chr  "Veggie_Bunnie" "Veggie_Bunnie" "BuckinCrzy" "Frankiedelsol" ...
##  $ date                 : chr  "2024-09-25" "2024-10-03" "2024-09-18" "2024-10-03" ...
##  $ timestamp            : num  1.73e+09 1.73e+09 1.73e+09 1.73e+09 1.73e+09 ...
##  $ title                : chr  "Season 3 cancelled?? Really?" "Stanbury now and then..." "Now that the season is over&do you think there will be a season 3?" "Season 3 Cast " ...
##  $ text                 : chr  "Does anyone know if the rumors are true that there won't be a third season if Dubai due to bad audience figures? I can't find a "I'm currently watching the second season of Ladies of London. I'm a big fan of Caroline Stanbury in the Dubai show. I think she "\nI have to admit I do think Dubai is underrated. I also think if they would have actually showed it when it was ready vs us wa "Do you guys think that Saba will join for season 3? I personally hope not she\031s just as boring as Sara if not more. \n\nOn S ...
##  $ subreddit            : chr  "RealHousewivesOfDubai" "RealHousewivesOfDubai" "RealHousewivesOfDubai" "RealHousewivesOfDubai" ...
##  $ score                : num  81 71 59 40 32 24 18 13 7 6 ...
##  $ upvotes              : num  81 71 59 40 32 24 18 13 7 6 ...
##  $ downvotes            : num  0 0 0 0 0 0 0 0 0 0 ...
##  $ up_ratio             : num  0.99 1 0.97 1 0.93 0.97 0.95 0.88 1 0.81 ...
##  $ total_awards_received: num  0 0 0 0 0 0 0 0 0 0 ...
##  $ golds                : num  0 0 0 0 0 0 0 0 0 0 ...
##  $ cross_posts          : num  0 0 0 0 0 0 0 0 0 0 ...
##  $ comments             : num  99 49 36 23 16 7 6 10 1 5 ...

Now, let’s look at the different content we can access:

# First, the usernames of the authors of the posts with season 2 content
rhod_season2_content[["threads"]][["author"]]
##  [1] "Veggie_Bunnie"      "Veggie_Bunnie"      "BuckinCrzy"        
##  [4] "Frankiedelsol"      "brickwallnyc"       "TheLastBiteee"     
##  [7] "Flamingofy"         "Veggie_Bunnie"      "Frankiedelsol"     
## [10] "KathCobb"           "Upbeat_Command1979" "Easy-Mind910"      
## [13] "Randomer1222"       "Main_Screen8766"
# The titles of the authors' posts
rhod_season2_content[["threads"]][["title"]]
##  [1] "Season 3 cancelled?? Really?"                                                                                                          
##  [2] "Stanbury now and then..."                                                                                                              
##  [3] "Now that the season is over&do you think there will be a season 3?"                                                                    
##  [4] "Season 3 Cast "                                                                                                                        
##  [5] "Watching reunion. My take on the season. Starting w/ Ayaans \"I'm the most beautiful\" \"I'm the best\" jokes...I find it exhausting. "
##  [6] "The last few minutes of the season 2 part 2 reunion took a turn"                                                                       
##  [7] "Ayan on Traitors?!?!?!"                                                                                                                
##  [8] "Ayan and Lesas friendship ..."                                                                                                         
##  [9] "Season 2 Reunion "                                                                                                                     
## [10] "Season 2 "                                                                                                                             
## [11] "reunion part 2"                                                                                                                        
## [12] "Lesa and Ayan\031s friendship breakup is really sad (I blame Ayan) "                                                                   
## [13] "Taleen\031s husband&"                                                                                                                  
## [14] "Taleen's main character syndrome"
#The number of comments
rhod_season2_content[["threads"]][["upvotes"]]
##  [1] 81 71 59 40 32 24 18 13  7  6  5  3  5  0
# The texts in these reddit posts
rhod_season2_content[["threads"]][["text"]]
##  [1] "Does anyone know if the rumors are true that there won't be a third season if Dubai due to bad audience figures? I can't find anything concrete about it online and it would be so sad because to me it is one of the best shows.\n\nIt has so much more class than many other shows. "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
##  [2] "I'm currently watching the second season of Ladies of London. I'm a big fan of Caroline Stanbury in the Dubai show. I think she has developed for the better. In ladies of London she seemed much more distant and also harder with less empathy towards the others. \nWhat do you think?"                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         
##  [3] "\nI have to admit I do think Dubai is underrated. I also think if they would have actually showed it when it was ready vs us waiting over a year+, there wouldn\031t be such a disconnect.\n\nSome thoughts from the reunion:\n- Sara was just there. Honestly I would\031ve rather Nina been on the show instead of her.\n- Stanbury surgery did well. She looks younger and refreshed but now her smile is so big for her face, idk.\n- Brooks is the villain of the show and tbh I\031m okay with that. I\031d rather have someone who I know is a victim instead of the behind the scene crap \n- Lesa\031s journal prop really didn\031t land. The way i see it is there are so many journals out there how is her or Stanbury special?\n- Taleen apologized to Brooks as a way of manipulation. Brooks said let\031s move forward but instead Taleen wanted to dwell on the past.\n- Anytime Ayan is guilty or does not like what\031s being said she yells or gets loud. (Turns out she\031s the bird she\031s called Taleen)\n- The fact that the ladies were more mad about Brooks calling Ayan on speaker rather than what she said is annoying AF\n- Lastly, the demise of Ayan &amp; Lesa\031s friendship was petty. HOWEVER if I heard you with my own ear say \034F that B.\035 then there\031s nothing else I need to say to you.   "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
##  [4] "Do you guys think that Saba will join for season 3? I personally hope not she\031s just as boring as Sara if not more. \n\nOn Stanburry\031s podcast Taleen was talking about bringing her sister on to the next season& any thoughts on that? \n\nAlso do you guys think Lesa will keep filming for the show or completely leave ? \n\n"                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
##  [5] "So, Ayaan is really pretty-reminds me of the great Iman-and clearly has been through a lot but her constant joking about how gorgeous she is,  how much better she looks than everyone else and better she is, is just really tiring. It has echoes of Ramona from NY. In fact, it has makes her less attractive. I wish she'd stop. (And I get she's joking, it might be a defense mechanism etc etc but she's a grown woman and it's annoying). Also her shrill screaming and crying grate on my nerves. But, I do think she is a good friend, sensitive and is basically a decent person.\n\nLeesa...by midway in I began to detest her. When she freaked out about \"their\" religion in Bali \"Its not christian\" I was disgusted.  It's like girl, you don't freaking insult a major religion because it isn't yours and you're ignorant when you're in \"their\" country. Good reminder that \"money can't buy you class\"..(thank you Luann) wealth does not equal education, class or even manners. Next, no debate, she manipulates Ayaan. And when she couldn't control her anymore freaked out. Clearly jealous of the Ayaan / Stanbury friendship. Also her brand seems low brow, everything about it including that weird party. No thanks.\n\nStanbury seems to have really grown as a person. I've always thought she was hilarious. She has been on an apology tour for some things that I don't think she needs to apologize for but she clearly means it. And that counts. Somehow I feel like she has been lighter since her first divorce and remarriage, she seems freer, more normal, funny as always and just more down to earth and real (well for RH and Dubai) and behaving, ironically, like the most normal person there. And I'm sorry but I love how she treats Sergio like a little lap dog; I do think she loves him but she is clearly in control. She is one of my favorites.\n\nCaroline B I wasn't feeling her last season but I was really happy when she made up with Stanbury and Taleen. They're a great trio. In fact, they have the most fun and would be the group I'd want to hang out with. Sad to see that Taleen and Brooks had a falling out and I'm catching up on it now.\n\nSara. Total ignoramus. Yet always enlightening everyone with her spiritual, light and love, holier than thou garbage. She fronts like she's so anti-materialistic but obsessed with $$ ALWAYS talking non-existent \"deals\" she's doing. And she's a liar. No way she got a $40K/episode podcast deal b/c, um, she's a nobody and no one's paying that much unless you Beyonce. Which she is not.  Finally for one so spiritual she too disparaged the Balinese religion by saying \"it seemed like a good one\"...Um it's called Hinduism and it's the oldest \"religion\" in the world you dolt. What's wrong with these women? Are they all that dumb? Sara claims to be a spiritual gangster and student of all that is divine. And calls herself \"dr\". Sigh. Closing the loop, she's very fake. In fact all I can see is her old nose when she speaks...\n\nSaba is a wanna be. Boring. Thirsty. Lame.  The golf episode where she bragged about how good she was and then was the worst player? Revealing.  Also I know there's some controversy with her disowning Sara due some scandal publicly but that seems in character...super tacky.\n\nTaleen I just don't have too much interest in, but enjoy watching her fights (LOL). She's OK.. I don't mind her but if she left it wouldn't matter to me.\n\nPS, I forgot Andy. Does he seem even more disengaged (like eye rolls, non-sigh sighs, frustration) than ever? I don't know if it's RH or RHODub or him but he seems subdued. and over it. "
##  [6] "I don\031t know if anyone already spoke about this but earlier in the season, Brooks was so excited when Lesa and Ayan started arguing. \n\nYou can see her satisfaction here-photo #1\n\nTaleen clocks her about stirring the in photo, one of the ladies even call Brooks evil - photo #2\n\nBrooks realizes she\031s not going to fly under the radar for encouraging their division- photo #3\n\nSara slowly realizing that she, or any of the other women, can not freely talk on the phone with Brooks ever again - photo #4 \n\nI think Lesa realized she got played so she walked off. I\031m glad they apologized I hope they can move forward. I hope girls don\031t throw away 7 years of friendship. I don\031t think Andy is going to allow another stalemate to be televised, we saw how that went with RHOP. He seemed very fed up with the bickering. I love seeing all the ladies and the drama they bring but they (Brooks, Lesa, Taleen, Ayan) need to relax "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
##  [7] "Traitors is one of my favorite shows and I just saw my favorite RHOD will be on season 3!!!"                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       
##  [8] "I am just rewatching the second season and I was wondering what happened with all these friendships???\n\nHow can it be that this close friendship between Ajan and Lisa suddenly falls apart like this?\n\nI wonder if this was a really honest friendship from both sides or just a facade? I'm still on Ayan's side and think that Lesa is totally jealous of everyone else Ayan gets on well with. Maybe also jealous in a way.\n\nI felt the same way about Taileen and Brooks. They've supposedly been besties for 11 years and then suddenly such differences come to light!!!\n\nWhat do you think?"                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       
##  [9] "Favorite \034gifts\035 that were given at the end of the season 2 reunion? I found the ventriloquist doll to be hilarious "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
## [10] "Does anyone know why they waited so long between filming and airing season two? I\031ve seen mention this was filmed over a year and a half ago and the women are still at each other\031s throats on social media. Isn\031t that an unusually long wait between filming and airing for any Housewives Franchise? "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
## [11] "can someone plzzz send a link to where to watch the second part of the reunion pretty please \xe1\b "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
## [12] "I\031m not sure if anybody else is picking up on the fact that Ayan is clearly the one to blame for this friendship falling out or not. It\031s clear that Ayan is so focused on being memorable and one of the star housewives of this show and realizes that she has to be close to Stanbury in order to achieve that. She clearly wanted to distance herself from Lesa when she realized that she wasn\031t willing to kiss Stanbury\031s butt to get there. \n\nAs someone who is a first gen American with immigrant parents from Africa I can understand that there is sometimes a gap in understanding how detrimental microagressions can be for a Black woman\031s reputation. When Stanbury called Lesa a former escort that was truly something I don\031t think Lesa was willing to come back from but Ayan dismissed it as housewife banter. \n\nFor Ayan to call Lesa her sister and best friend but not understand how the claims made during last seasons reunion could make Lesa not want to be close to Stanbury is off putting. Until Lesa fully explained why it was hurtful to Stanbury I don\031t think she got it either. \n\nIt\031s very clear that when Ayan gets upset she sees red and react/says things impulsively (for example after the voice note scene). I can 100% believe that Ayan said those things about Lesa but didn\031t want to be caught liable on international television for making vile remarks. \n\nAll the other housewives (on this season) are able to take accountability for their wrong doings so how long do people really expect Lesa to blindly forgive Ayan if she isn\031t willing to change her behavior? \n\nEdit: you all are using this subreddit and this post to make racist remarks and spew microagressions. I\031m not saying I expected more from Reddit but check yourselves. "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
## [13] "i can\031t put my finger on it but there\031s something super weird and sketchy about Raffi.\nfrom him always complimenting Caroline S, calling her gorgeous etc, to Caroline S jumping into bed with him when she was drunk and Taleen not saying anything&. hmm \nAlso the tweet they showed at the Reunion Part 2 of Caroline Brooks saying that Taleen uses other women to please her husband. Hmmm something weird about that marriage? "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
## [14] "She talked non-stop during the reunion. It was such a turn off, even though I thought she was right most of the time. Nonnnnnnnn-stop!!!! Even on issues that had nothing to do with her. And then she'd immediately talk over whoever was trying to answer, Brooks, Sara, Lesa, even her new idol Stanbury! Girl! You are new! You were featured on 20% of the season, why are you talking for 150% of the reunion????\n\nWhen you talk so much and never let anyone get a word in edgewise, it ends up having the opposite effect. She should've sit back and let Brooks do what Brooks does best, which is be her own worst enemy. Instead she ended up making Brooks a semi-sympathetic character, because she just sat there and took an onslaught of verbal abuse without having the opportunity to fully defend herself. Let. People. Dig. Their Own. Graves. And my god, give the pumped-up lips a rest. Sheesh.\n\nCredit where credit is due, the \"bada bing\" moment is the only time in Housewives reunion history I haven't rolled my eyes at someone pulling out blown-up text messages. Zero crumbs."

We could filter the information in the title or body text further to analyze it for keywords, such as “vs” or “versus”, “team”. We can also compare the number of upvotes, or search cast members names to see if the threads/comments are of a positive or negative valence, and chart these findings for each cast member.

Retrieving Data on Users

We can see from the following code chunk a list of comment authors:

rhod_season2_content[["threads"]][["author"]]
##  [1] "Veggie_Bunnie"      "Veggie_Bunnie"      "BuckinCrzy"        
##  [4] "Frankiedelsol"      "brickwallnyc"       "TheLastBiteee"     
##  [7] "Flamingofy"         "Veggie_Bunnie"      "Frankiedelsol"     
## [10] "KathCobb"           "Upbeat_Command1979" "Easy-Mind910"      
## [13] "Randomer1222"       "Main_Screen8766"

Let’s pick one, and explore their profile using “get_user_content” function, which will retrieve information such as the subrreddits they have threads on, the names of these threads, the upvotes of these threads, etc . We’ll use the user “BuckinCrzy” (#3; num may change).

# First, let's attribute "BuckinCrzy" to a varaible called "user" so that we can access the username more fluently throughout the code
user <- "BuckinCrzy"
# Now, the function
user_buckin_crzy <- get_user_content(user) 
## parsing user BuckinCrzy...
## parsing URLs on page 1...
## parsing URLs on page 2...
## parsing URLs on page 3...
## parsing URLs on page 4...
str(user_buckin_crzy)
## List of 1
##  $ BuckinCrzy:List of 3
##   ..$ about   :List of 8
##   .. ..$ created_utc  : chr "2022-08-14"
##   .. ..$ timestamp    : num 1.66e+09
##   .. ..$ name         : chr "BuckinCrzy"
##   .. ..$ is_employee  : logi FALSE
##   .. ..$ is_mod       : logi FALSE
##   .. ..$ is_gold      : logi FALSE
##   .. ..$ thread_karma : num 8158
##   .. ..$ comment_karma: num 5178
##   ..$ comments:'data.frame': 260 obs. of  12 variables:
##   .. ..$ url           : chr [1:260] "https://www.reddit.com/r/LoveIslandUSA/comments/x4fu74/chazz_on_the_reunion/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3p21n/season_5_predictions/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3o177/who_is_dming_tyler/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3o177/who_is_dming_tyler/" ...
##   .. ..$ date_utc      : chr [1:260] "2022-09-03" "2022-09-02" "2022-09-02" "2022-09-02" ...
##   .. ..$ timestamp     : num [1:260] 1.66e+09 1.66e+09 1.66e+09 1.66e+09 1.66e+09 ...
##   .. ..$ subreddit     : chr [1:260] "LoveIslandUSA" "LoveIslandUSA" "LoveIslandUSA" "LoveIslandUSA" ...
##   .. ..$ thread_author : chr [1:260] "realitytvjunkiee" "BuckinCrzy" "Sunflowerr90" "Sunflowerr90" ...
##   .. ..$ comment_author: chr [1:260] "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" ...
##   .. ..$ thread_title  : chr [1:260] "Chazz on the reunion" "Season 5 Predictions" "Who is DMing Tyler" "Who is DMing Tyler" ...
##   .. ..$ comment       : chr [1:260] "I would say the difference is Courtney was up front with her intentions. She didn\031t tell 1 guy I see a futur"| __truncated__ "Yeah that\031s definitely a fear. The plus size women may get the title of \034oh you\031re just a friend\035 &amp; be dumped" "Lol, they all joined after Tyler left. But more than likely they saw him on TV for the time he was there &amp; "| __truncated__ "She mentioned it was someone who wasn\031t there so could be Gabby, Tigerlily, Avery or Mackenzie" ...
##   .. ..$ score         : num [1:260] 10 2 57 68 1 23 2 1 2 49 ...
##   .. ..$ up            : num [1:260] 10 2 57 68 1 23 2 1 2 49 ...
##   .. ..$ downs         : num [1:260] 0 0 0 0 0 0 0 0 0 0 ...
##   .. ..$ golds         : num [1:260] 0 0 0 0 0 0 0 0 0 0 ...
##   ..$ threads :'data.frame': 51 obs. of  11 variables:
##   .. ..$ url      : chr [1:51] "https://i.redd.it/cdqg2dxi04u91.jpg" "https://www.reddit.com/r/LoveIslandUSA/comments/x3p21n/season_5_predictions/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3ml0v/isaiah_tiktok/" "https://www.reddit.com/r/RHOP/comments/1bsrgxw/reunion_episode_pt_1/" ...
##   .. ..$ date_utc : chr [1:51] "2022-10-16" "2022-09-02" "2022-09-01" "2024-04-01" ...
##   .. ..$ timestamp: num [1:51] 1.67e+09 1.66e+09 1.66e+09 1.71e+09 1.71e+09 ...
##   .. ..$ subreddit: chr [1:51] "LoveIslandUSA" "LoveIslandUSA" "LoveIslandUSA" "RHOP" ...
##   .. ..$ author   : chr [1:51] "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" ...
##   .. ..$ title    : chr [1:51] "Zimmy =\u0095" "Season 5 Predictions" "Isaiah TikTok" "Reunion Episode Pt. 1" ...
##   .. ..$ text     : chr [1:51] "I just love the way they are together" "What do you think the likelihood of LIUSA showcasing plus size contestants?\nWho do you think will pull a Macke"| __truncated__ "Now I wasn\031t a big fan of Isaiah on the show but I did think he was attractive. However, now that I\031m see"| __truncated__ "If you haven\031t seen the reunion yet, keep scrolling! \n\nSo what is everyone\031s thoughts on part 1? I have"| __truncated__ ...
##   .. ..$ golds    : num [1:51] 0 0 0 0 0 0 0 0 0 0 ...
##   .. ..$ score    : num [1:51] 114 12 74 74 35 111 54 114 169 84 ...
##   .. ..$ ups      : num [1:51] 114 12 74 74 35 111 54 114 169 84 ...
##   .. ..$ downs    : num [1:51] 0 0 0 0 0 0 0 0 0 0 ...

Now, we can pull specific information about Buckin_Crzy, using str(var[[user]]$inserthere), specifically, if they engage in in-group vs. out-group dynamics on any other subreddits beyond Real Housewives of Dubai.

# Using str(var[[user]]$comments)
str(user_buckin_crzy[[user]]$comments)
## 'data.frame':    260 obs. of  12 variables:
##  $ url           : chr  "https://www.reddit.com/r/LoveIslandUSA/comments/x4fu74/chazz_on_the_reunion/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3p21n/season_5_predictions/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3o177/who_is_dming_tyler/" "https://www.reddit.com/r/LoveIslandUSA/comments/x3o177/who_is_dming_tyler/" ...
##  $ date_utc      : chr  "2022-09-03" "2022-09-02" "2022-09-02" "2022-09-02" ...
##  $ timestamp     : num  1.66e+09 1.66e+09 1.66e+09 1.66e+09 1.66e+09 ...
##  $ subreddit     : chr  "LoveIslandUSA" "LoveIslandUSA" "LoveIslandUSA" "LoveIslandUSA" ...
##  $ thread_author : chr  "realitytvjunkiee" "BuckinCrzy" "Sunflowerr90" "Sunflowerr90" ...
##  $ comment_author: chr  "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" "BuckinCrzy" ...
##  $ thread_title  : chr  "Chazz on the reunion" "Season 5 Predictions" "Who is DMing Tyler" "Who is DMing Tyler" ...
##  $ comment       : chr  "I would say the difference is Courtney was up front with her intentions. She didn\031t tell 1 guy I see a futur"| __truncated__ "Yeah that\031s definitely a fear. The plus size women may get the title of \034oh you\031re just a friend\035 &amp; be dumped" "Lol, they all joined after Tyler left. But more than likely they saw him on TV for the time he was there &amp; "| __truncated__ "She mentioned it was someone who wasn\031t there so could be Gabby, Tigerlily, Avery or Mackenzie" ...
##  $ score         : num  10 2 57 68 1 23 2 1 2 49 ...
##  $ up            : num  10 2 57 68 1 23 2 1 2 49 ...
##  $ downs         : num  0 0 0 0 0 0 0 0 0 0 ...
##  $ golds         : num  0 0 0 0 0 0 0 0 0 0 ...
str(user_buckin_crzy[["BuckinCrzy"]][["comments"]][["thread_title"]])
##  chr [1:260] "Chazz on the reunion" "Season 5 Predictions" ...
str(user_buckin_crzy[["BuckinCrzy"]][["comments"]][["comment"]])
##  chr [1:260] "I would say the difference is Courtney was up front with her intentions. She didn\031t tell 1 guy I see a futur"| __truncated__ ...

Conclusion

In this tutorial, we can extract information about the content posted on Reddit, including the names of subreddits, specific threads, the names of the authors of said threads, and information about the author’s presence on Reddit. With this information, we can filter through the data and examine how psychological phenomena (in this case, in-group vs. out-group dynamics) play out in niche online groups like the Real Housewives subreddits.