script/program request

[Deleted member 82943]

Hello everyone,

I'm doing a research paper on bias and need a program to tally and read words in an article. for example the output should look like this:

the: 100 is: 100 obama: 20 etc

if money is needed I could front a some cash for this

Thanks!

 

[ShadowStriker]

What language?

In VBScript its pretty easy, just create an ADORRecordset with word and count as paramters, then pass the entire file as text to it and make it go through every word and check if its already in the Recordset, if it is, count++, if it isn't add a record and set the word paramter and count parameter.

 

[Deleted member 82943]

anything, it could be a webpage i.e written in javascript or c++ from the commandline just so long as I can see the output. it should take ideally a html webpage or a properly formatted txt file as input and then count the words and the frequency

 

[-BokkeN-]

The Natural Language Toolkit has a bunch of programs that support doing language and text processing. I believe there is a program included to perform word counts.

http://www.nltk.org/

 

[Brachy]

Try

http://gregmaxey.mvps.org/Word_Frequency.htm

 

[jiminator]

unix:
cat $FILE | tr '\t ' '\n\n' | sort | uniq -c | sort -rn

paypal $500 please, thanks!

 

[Tawnos]

unix:
cat $FILE | tr '\t ' '\n\n' | sort | uniq -c | sort -rn

paypal $500 please, thanks!

You should pay the man. This is a pretty easy way to do that, and should work on cygwin as well.

 

[jiminator]

lol, j/k.

Actually I love doing stuff like that. We have tons of log files at work and it is really easy to use various tools to slice and dice the data and generate reports from them.

 

[Deleted member 82943]

Wow does the unix line work oh HTML or formatted txt files?

 

[Whatsisname]

plain text

 

[Deleted member 82943]

thanks the word macro works great