DEAN 690_Week 4

Dataset

This website provides 476 million twitter tweets. First idea is to set up categories to separate the tweets and then try to find any relation among these tweets. I am still thinking ideas of this dataset. If anyone has ideas, let me know, please.

Dataset link: https://snap.stanford.edu/data/twitter7.html

Question

13. What is logistic regression?

Statistics: Logistic regression which is also called logit regression or logit model is one specific type of regression model.

14. Compare R and python

Personal opinion: two of these software focus on different aspects.

R: statistics and graphic model

Python: high-level programming language

42. What is a local optimum?

Local optimum is an optimization problem among particular neighborhood of values.

News

Topic: Moving from R to Python: The Libraries You Need to Know

Useful package: R -> Python

Link: http://www.kdnuggets.com/2017/02/moving-r-python-libraries.html

Project Idea

•Explore dataset.

•Link diverse IT jobs to catalogue.

•Create relationship between IT jobs.

NLP learning Blog

http://ling-blogs.bu.edu/static/lx390f16/page5/

Natural Language Processing with Python

http://www.nltk.org/book/

PYTHON NLTK COOKBOOK

http://streamhacker.com/