Activity, language use and social interactions in an on-line community. Analyse the metadata and linguistic summary from a real on-line forum and submit a report of your findings. Do the following:
a. Analyse activity and language on the forum over time. Some starting points:
• Describe your data: How active are participants, and are there periods where this increases or decreases? Is there a trend over time?
• Looking at the linguistic variables, do these change over time? Is there a relationship between variables?
b. Analyse the language used by groups. Some starting points:
• Threads indicate groups of participants communicating on the same topic. Describe the threads present in your data.
• By analysing the linguistic variables for all or some of the threads, is it possible to see a difference in the language used by different groups?
• Does the language used within threads (or between threads) change over time? How consistent or variable is the language used within threads?
c. Challenge: Social networks online. We can think of participants posting to the same thread at similar times (for example during the same month) as forming a social network. When these participants also post to other threads over the same period, their social network extends.
• Can you define, graph and describe the social network that exists at a particular point in time, for example over one month? How does this change in the following months?
• Note: you only need to analyse a small portion of the social network over a short time period. We will cover social network analysis in Lecture 5.
d. Reflection on your investigation. What did you first investigate? How did you then modify your research based on the results of your first investigation?
• Using one of the data science methodologies in Lecture 4, illustrate your research process.
over the years 2002 to 2011. You will each work with 20,000 posts, randomly selected from the original file. The linguistic analysis was conducted using Linguistic Inquiry and Word Count (LIWC), which assesses the prevalence of certain thoughts, feelings and motivations by calculating the proportion of key words used in communication. See http://liwc.wpengine.com/ for more information, including the language manual
rm(list = ls())
set.seed(XXXXXXXX) # XXXXXXXX = your student ID webforum <- read.csv("webforum.csv")
webforum <- webforum [sample(nrow(webforum), 20000), ] # 20000 rows
Data fields are (see the language manual for more detail and examples):
|
Column |
Brief Descriptor |
|
ThreadID |
Unique ID for each thread |
|
AuthorID |
Unique ID for each author |
|
Date |
Date |
|
Time |
Time |
|
WC |
Word count of the text of the post |
|
Analytic |
LIWC Summary (Analytical thinking) |
|
Clout |
LIWC Summary (Power, force, impact) |
|
Authentic |
LIWC Summary (Using an authentic tone of voice) |
|
Tone |
LIWC Summary (Emotional tone) |
|
WPS |
LIWC (Words per sentence) |
|
i |
LIWC ("I, me, mine" words) First person singular |
|
we |
LIWC ("We, us, our" words) First person plural |
|
you |
LIWC ("You" words) Second person |
|
they |
LIWC ("They" words) Third person plural |
|
number |
LIWC(Quantities and ranks) |
|
affect |
LIWC (Expressing sentiment) |
|
posemo |
LIWC (Positive emotions) |
|
negemo |
LIWC (Negative emotions) |
|
anx |
LIWC (Indicating anxiety) |
Suggested length: 6–8 A4 pages + appendix.
Submit the results of your analysis, answering the research questions and report anything else you discover of relevance. If you choose to analyse only a subset of your data, you should explain why.
You are expected to include at least one multivariate graphic summarising key results. You may also include simpler graphs and tables. Report any assumptions you’ve made in modelling, and include your R code as an appendix. Submit your report as a single PDF with the file name FirstnameSecondnameID.pdf on Moodle.
It is expected that you will use R for your data analysis and graphics and tables. You are free to use any R packages you need but please document these in your report and include in your R code.
The quality of your analysis and description of your analytical process; Graphics and tables supporting your analysis; The quality of graphics used in the report. Justification of your findings and the degree of proof you can offer (for example statistical tests); Readability and quality of your written report; Insights gained from the data; Novelty of your approach.
Factors you should consider (starting points, not a complete list):
Techniques: summary/descriptive statistics, identification of important variables, networks, etc. Major grouping variables: author, thread, date and/or time, or a combination of these.
Time window (days, weeks, months, years…); Subsets of the data to be analysed.
Graphics to communicate your analysis and insights (histograms, scatterplots, heat maps, time series are some basic starting points, but see for inspiration
CS 340 Milestone One Guidelines and Rubric Overview: For this assignment, you will implement the fundamental operations of create, read, update,
Retail Transaction Programming Project Project Requirements: Develop a program to emulate a purchase transaction at a retail store. This
7COM1028 Secure Systems Programming Referral Coursework: Secure
Create a GUI program that:Accepts the following from a user:Item NameItem QuantityItem PriceAllows the user to create a file to store the sales receip
CS 340 Final Project Guidelines and Rubric Overview The final project will encompass developing a web service using a software stack and impleme
