Collecting tweets related to the stock market
Objectives
Gain experience of collecting data from Twitter using Twitter API
Gain experience of data storage to store the data and query
Gain experience of collecting real-time data
Gain experience of data cleaning
Important Notes
Work in groups of 4 students
All reports must be submitted as a PDF, with source code as an archive (e.g. zip, gz)
Save the submission as “Assignment-1_Group-#.zip”
Assignment Details
This assignment consists of four parts:
Collecting data: In this assignment, you need to collect data related to the stock market from Twitter for one week. In Twitter, ticker symbols like #gold are used for stocks and companies. You are requested to collect the tweets with some specific keywords and store them in different files. The following keywords should be used:
a. Altcoin
Bitcoin
Coindesk
Cryptocurrency
Gold
APPL
GOOG
YHOO
Each tweet is a json file with the following format:
{"created_at":”.......... ”,
"id":”…........ ”,
"text":" Time to buy some ether!\n#ethereum #investing #cryptocurrency” “user_id”:”…........ ”
…
}
Saving data: You need to save the requested data into csv format of 8 files where data related to each keyword is saved. Each file consist of four columns: tweet id, time of tweet, user id and text
Cleaning data: remove duplication, remove punctuations, remove numbers in tweets, and remove words with length less than 2
Visualizing data: You need to present the daily number of tweets for each keyword as well as the daily number of users
CS 340 Milestone One Guidelines and Rubric Overview: For this assignment, you will implement the fundamental operations of create, read, update,
Retail Transaction Programming Project Project Requirements: Develop a program to emulate a purchase transaction at a retail store. This
7COM1028 Secure Systems Programming Referral Coursework: Secure
Create a GUI program that:Accepts the following from a user:Item NameItem QuantityItem PriceAllows the user to create a file to store the sales receip
CS 340 Final Project Guidelines and Rubric Overview The final project will encompass developing a web service using a software stack and impleme