this assignment, you need to collect data related to the stock market from Twitter for one week.

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Collecting tweets related to stock market

Objectives

Gain experience of collecting data from Twitter using Twitter API

Gain experience of data storage to store the data and query

Gain experience of collecting real-time data

Gain experience of data cleaning

 

Important Notes

Work in groups of 4 students

All reports must be submitted as a PDF, with source code as an archive (e.g. zip, tar.gz)

Save the submission as “Assignment-1_Group-#.zip”

Assignment Details

This assignment consists of four parts:

1. Collecting data: In this assignment, you need to collect data related to the stock market from Twitter for one week. In Twitter, ticker symbols like #gold are used for stocks and companies. You are requested to collect the tweets with some specific keywords and store them in different files. The following keywords should be used:

a. Altcoin

b. Bitcoin

c. Coindesk

d. Cryptocurrency

e. Gold

f. APPL

g. GOOG

h. YHOO

Each tweet is a json file with the following format:

{"created_at":” ”,

"id":”… ”,

"text":" Time to buy some ether!\n#ethereum #investing #cryptocurrency” “user_id”:”… ”

…

}

2. Saving data: You need to save the requested data into csv format of 8 files where data related to each keyword is saved. Each file consists of four columns: tweet id, time of tweet, user id and text.

3. Cleaning data: remove duplication, remove punctuations, remove numbers in tweets, and remove words with length less than 2.

4. Visualizing data: You need to present the daily number of tweets for each keyword as well as the daily number of users.

Recourses

It is recommended for this assignment to use Python for programming with Tweepy.

The following resources are helpful. https://dev.twitter.com/overview/documentation https://www.python.org/doc/

Attachments:

Related Questions

. The fundamental operations of create, read, update, and delete (CRUD) in either Python or Java

CS 340 Milestone One Guidelines and Rubric  Overview: For this assignment, you will implement the fundamental operations of create, read, update,

. Develop a program to emulate a purchase transaction at a retail store. This  program will have two classes, a LineItem class and a Transaction class

Retail Transaction Programming Project  Project Requirements:  Develop a program to emulate a purchase transaction at a retail store. This

. The following program contains five errors. Identify the errors and fix them

7COM1028   Secure Systems Programming   Referral Coursework: Secure

. Accepts the following from a user: Item Name Item Quantity Item Price Allows the user to create a file to store the sales receipt contents

Create a GUI program that:Accepts the following from a user:Item NameItem QuantityItem PriceAllows the user to create a file to store the sales receip

. The final project will encompass developing a web service using a software stack and implementing an industry-standard interface. Regardless of whether you choose to pursue application development goals as a pure developer or as a software engineer

CS 340 Final Project Guidelines and Rubric  Overview The final project will encompass developing a web service using a software stack and impleme