About

My name is Hermit.. It really is!! Hermit Dave in all. I work on and am heavily opinionated around Microsoft stack. Federalist and a conservative in political inclination.. Atheist if you must know and i don’t really care about religious inclinations as long as you don’t bug me about it. I prefer dry humour – as dry as it gets.

I do almost everything (blogging as well) for the wrong reasons. What can i say people like me get their kicks in their own weird ways.. You have been warned!

13 thoughts on “About

  1. Hello Hermit Dave,

    My name is Kriya, I am a student at Reed College currently working on a psycholinguistics research project. As part of our project, I need to find the frequency of use of a certain set of Spanish words. We would like to use your site as a source of information, and I wanted to know if that was alright. If so, how would you like us to cite you? Thank you for all of your work!

    Kriya and team

  2. Excellent! Thank you so much. Also, we have a quick question: when creating your frequencies, what are they out of? That is, if the word cat appears 4000 times, does that mean 4000 times out of 50000 words, or perhaps 100000, etc.

    Thanks again,
    Kriya

    • okay each word has associated frequency if list had two words cat with value 400 and dog with 100. this woud imply that total words under consideration were 500 and the frequency of each gives their relative usage. if you sum frequency of each word you will get overall set / count. these were generated from unique subtitles

  3. Hi Hermit,
    I would like to use subtitles for a linguistic project.
    Can you give me some hint on how to obtain them from opensubtitles.org?
    I saw their API’s but it only allows 200 downloads a day. I would like to use subtitles from the same movie in many different languages.
    Best,
    Peter

  4. Hello Hermit David,
    I’m Sana, I have just moved to the UK to work on a project on Arabic language @ Univ but to start I need to know the frequency of Arabic word. I was reading what Kyria was asking you and I have to make the same question plus is possible to have your program on a Mac? I feel like an alien never use it but should learn.
    Thank you so much !

    S

  5. Hello Hermit Dave,

    I’m a PhD student in Linguistics and I’m working on words’ frequencies in Lithuanian and Latvian. I would like to use your site as a source of information. Do you agree? I would also like to learn more about how your lists were built. From which kind of corpora did you extract the words? Where those texts originally written, say, in Latvian, or just translations from another language?
    Thanks for your great work.
    Greetings from Italy!

    Adriano

    • Adriano,

      I consumed opensubtitles – repository of which is available here http://opus.lingfil.uu.se/OpenSubtitles2012.php (including a link to earlier one).

      The files are xml files that contain words relating to movie dialogs in native languages. I created a program to select a single set of files for a given movie and to pull words.

      The words are then added to a list and a count of how many times each word occurs is maintained.

      At the end of the process output file is create with word and its associated frequency.

      Feel free to consume this as you wish.. yes you can specify me as a source for this.

      Hermit

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s