Analyzing Twitter data with R (part 1: connecting to Twitter API )


All "Smart" Businesses are looking to understand the social media trends , to analyze the massive amount of public data available online and to make insightful decisions based on these analysis.


Source :http://www.slashgear.com/twitter-data-grants-introduced-to-offer-select-institutes-data-trove-05315867/


For any statistician or future data scientist freshly graduating out of the university, it is very important to be able to have certain skills with the statistical modeling and mathematical knowledge.

In this series of posts, I will detail the necessary steps for that you will need to access Twitter, import data, clean it and analyze it and have a conclusion based on the data you have extracted.

It will be a simple step-by-step tutorial if you'd like to call it that way.

This series of posts is destined to students, currently taking data science classes, and to anyone interested in R language and social media in particular .

I've been asked to make the same thing with Python also. I will try to make time and share some Python practices for those using it for data analysis. But I encourage you to learn R !




Let's start! 



The way Twitter allows users to connect to its API  is to have an authentication parameters that gives developers access to its database.

To have you access parameters, you need to have a Twitter account.





Login to you account and go to  https://apps.Twitter.com. You will find a create a new application button and click that:



Name : give you application any name you'd like to give. Keep it fun! Twitter limits the name to 32 characters length.

Description : it's required that you give a quick description for your application. It is useful when you have many applications and you can not re-call what does this application do exactly.

Website : The Twitter descriptive text is very clear, if your have a website where your work/application can be available , put it. Otherwise, just put a placeholder, your github site or your blog address.

Callback URL: at your level now, you do not need to put any callback URLs, so skip that part.




Now if you have some time, you can read the stuff in the Developer Agreement. But like most of us (99.99%) we will agree because we are going to use the service anyways. 



And Bam! Now you have your application ready!




The next step is to go to the application management interface and get the Keys and Access Tokens we will need to the second part of your work:








Now all you need to do is to copy/paste these keys to a file and get to your Rstudio, because in the next part we will use these keys to access the Twitter data!


PART 2 HERE !

Popular posts from this blog

Mathematical Symbols in LATEX

Image
I have been going through my hard drive and organizing some of the files I have, PDF's, eBooks and articles and I found a very interesting documents about LATEX math symbols. Please deactivate ad-blockers to be able to see the pdf document ! UPDATE : I have published this article a few years and it has attracted the most attention of all my blogposts, so I'd like to thank all of the visitors that shared this post. Please take some time to check out other articles I have shared about Data Science, Machine learning and Big Data: Data Mining basic and advanced concepts - Part 2 : Describing Data Here are some of the most interesting parts of it:
Read More >>

Analyzing Twitter data with R (part 3: Cleaning & organizing the Data)

Image
After we have explained in the previous parts, how to set up the access to Twitter's API and how to import tweets with a simple R command, in this third part we will try to organize and clean the data we have imported in good reusable format. So let's pick up from where we left off , after finishing the authentication process, now we want to import certain tweets. the command  searchTwitter  from the package twitteR will do the job for us.  we need to create a new object that will contain the data we are about to import and give it the result of our  searchTwitter function. In our example, we will be querying Twitter for the tweets containing the hashtag #Tunisia , we will import 1000 English tweets. and we will have a preview of the imported data with the head()  function:
Read More >>

Linkin Park: Analyzing the causes of death of Rock band members

Image
Being a part of the Y generation, I grew up listening to various types and genres of music, from Rap to RnB, to Rock and electronic music. I was personally choked to hear about the death of the lead singer of the Linkin Park band. Their music was and still is popular until today. The news was as choking to me as to anyone else who knew that band. After knowing about the news, I had a discussion about this tragedy , and a question popped up about the fact that rock band members mostly die of suicide or drug over-dose. I wasn't really sure that this information is true, so I really couldn't have a real argument to say that it is maybe (or not ) the most commun reason of death for Rock stars. And since I love playing with data, I decided to fact-check the hypothesis stating that:  "The most commun cause of death among rock band members is suicide" . To start, we have to get  some data! and since there is no available data-set to analyse , I had to be creativ...
Read More >>