Icelandic Parsed Historical Corpus (IcePaHC) - User contributions [en]

Download

2011-08-29T01:56:35Z

Anton: /* Download Version 0.9, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that has built a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.9, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.9 - Current release'''

The current release is version 0.9 of 1,002,390 words total from every century between the 12th and the 21st centuries inclusive. All of the text for version 1.0 is already included but some minor corrections remain to be finished.

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.9.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.9. LGPL. (zip, 11.8 MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.9. LGPL. (user friendly visual setup, 12.2 MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.9. LGPL. (manual setup, 12.7 MB, 1,002,390 words )

'''Version 0.5'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.9==
*1150: Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (4422 words)
*1150: Íslensk hómilíubók (Icelandic book of homilies) (40943 words)
*1210: Jarteinabók (10328 words)
*1210: Þorláks saga helga (10868 words)
*1250: Íslendinga saga (22805 words)
*1250: Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (3461 words)
*1260: Jómsvíkinga saga (21133 words)
*1270: Grágás. Lagasafn íslenska þjóðveldisins. (6203 words)
*1275: Morkinskinna (25064 words)
*1300: Alexanders saga (23356 words)
*1310: Grettis saga Ásmundarsonar (20563 words)
*1325: Árna saga biskups (19968 words)
*1350: Bandamanna saga (Möðruvallabók text) (13618 words)
*1350: Finnboga saga ramma (23036 words)
*1350: Mörtu saga og Maríu Magdalenu (17241 words)
*1400: Gunnars saga Keldugnúpsfífls (8770 words)
*1400: Gunnars saga Keldugnúpsfífls - Part 2 (3164 words)
*1400: Víglundar saga (13453 words)
*1450: Bandamanna saga (Konungsbók text) (11560 words)
*1450: Ectors saga (21063 words)
*1450: Júditarbók (6562 words)
*1450: Vilhjálms saga Sjóðs (23132 words)
*1475: Miðaldaævintýri (18084 words)
*1480: Jarlmanns saga og Hermanns (14482 words)
*1525: Erasmus saga (Reykjahólabók) (8589 words)
*1525: Georgíus saga (Reykjahólabók) (20092 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (16550 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (20925 words)
*1593: Eintal sálarinnar við sjálfa sig (23327 words)
*1611: Okur (15481 words)
*1628: Reisubók séra Ólafs Egilssonar (17199 words)
*1630: Fimmtíu heilagar hugvekjur Meditationes sacrae (12698 words)
*1650: Illuga saga Tagldarbana (20921 words)
*1659: Píslarsaga séra Jóns Magnússonar (9825 words)
*1661: Reisubók Jóns Ólafssonar Indíafara (23031 words)
*1675: Móðars þáttur (3845 words)
*1675: Söguþáttur af Ármanni og Þorsteini gála (11228 words)
*1675: Um ætt Magnúsar Jónssonar (3187 words)
*1680: Sögu-þáttur um Skálholts biskupa fyrir og um siðaskiptin. (10281 words)
*1720: Vídalínspostilla (23016 words)
*1725: Biskupasögur Jóns prófasts Halldórssonar í Hítardal (22297 words)
*1745: Nikulás Klím (22038 words)
*1790: Fimmbræðra saga (18860 words)
*1791: Ævisaga síra Jóns Steingrímssonar (22369 words)
*1830: Hellismanna saga (14988 words)
*1835: Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (3257 words)
*1850: Piltur og stúlka (17844 words)
*1859: Fimtíu hugvekjur út af pínu og dauða Drottins vors Jesú Krists (20530 words)
*1861: Sagan af Heljarslóðarorrustu (20336 words)
*1882: Brynjólfur Sveinsson biskup (27342 words)
*1883: Hans Vöggur (1927 words)
*1888: Grímur kaupmaður deyr (7241 words)
*1888: Vordraumur (10753 words)
*1902: Upp við fossa (20647 words)
*1907: Leysing (20613 words)
*1908: Ofurefli (20262 words)
*1920: Árin og eilífðin. Prédikanir eftir Harald Níelsson (21234 words)
*1985: Margsaga (22295 words)
*1985: Sagan öll (20980 words)
*2008: Ofsi (21144 words)
*2008: Segðu mömmu að mér líði vel - saga um ástir - (21958 words)

Total number of words: 1,002,390

==Directories included in Version 0.9==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.9 release (of August 26th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.9. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-29T01:41:10Z

Anton: /* Introduction */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that has built a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.9, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.9 - Current release'''

The current release is version 0.9 of 1,002,390 words total from every century between the 12th and the 21st centuries inclusive. All of the text for version 1.0 is already included but some minor corrections remain to be finished.

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.9.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.9. LGPL. (zip, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.9. LGPL. (user friendly visual setup, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.9. LGPL. (manual setup, XXX MB, 1,002,390 words )

'''Version 0.5'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.9==
*1150: Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (4422 words)
*1150: Íslensk hómilíubók (Icelandic book of homilies) (40943 words)
*1210: Jarteinabók (10328 words)
*1210: Þorláks saga helga (10868 words)
*1250: Íslendinga saga (22805 words)
*1250: Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (3461 words)
*1260: Jómsvíkinga saga (21133 words)
*1270: Grágás. Lagasafn íslenska þjóðveldisins. (6203 words)
*1275: Morkinskinna (25064 words)
*1300: Alexanders saga (23356 words)
*1310: Grettis saga Ásmundarsonar (20563 words)
*1325: Árna saga biskups (19968 words)
*1350: Bandamanna saga (Möðruvallabók text) (13618 words)
*1350: Finnboga saga ramma (23036 words)
*1350: Mörtu saga og Maríu Magdalenu (17241 words)
*1400: Gunnars saga Keldugnúpsfífls (8770 words)
*1400: Gunnars saga Keldugnúpsfífls - Part 2 (3164 words)
*1400: Víglundar saga (13453 words)
*1450: Bandamanna saga (Konungsbók text) (11560 words)
*1450: Ectors saga (21063 words)
*1450: Júditarbók (6562 words)
*1450: Vilhjálms saga Sjóðs (23132 words)
*1475: Miðaldaævintýri (18084 words)
*1480: Jarlmanns saga og Hermanns (14482 words)
*1525: Erasmus saga (Reykjahólabók) (8589 words)
*1525: Georgíus saga (Reykjahólabók) (20092 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (16550 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (20925 words)
*1593: Eintal sálarinnar við sjálfa sig (23327 words)
*1611: Okur (15481 words)
*1628: Reisubók séra Ólafs Egilssonar (17199 words)
*1630: Fimmtíu heilagar hugvekjur Meditationes sacrae (12698 words)
*1650: Illuga saga Tagldarbana (20921 words)
*1659: Píslarsaga séra Jóns Magnússonar (9825 words)
*1661: Reisubók Jóns Ólafssonar Indíafara (23031 words)
*1675: Móðars þáttur (3845 words)
*1675: Söguþáttur af Ármanni og Þorsteini gála (11228 words)
*1675: Um ætt Magnúsar Jónssonar (3187 words)
*1680: Sögu-þáttur um Skálholts biskupa fyrir og um siðaskiptin. (10281 words)
*1720: Vídalínspostilla (23016 words)
*1725: Biskupasögur Jóns prófasts Halldórssonar í Hítardal (22297 words)
*1745: Nikulás Klím (22038 words)
*1790: Fimmbræðra saga (18860 words)
*1791: Ævisaga síra Jóns Steingrímssonar (22369 words)
*1830: Hellismanna saga (14988 words)
*1835: Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (3257 words)
*1850: Piltur og stúlka (17844 words)
*1859: Fimtíu hugvekjur út af pínu og dauða Drottins vors Jesú Krists (20530 words)
*1861: Sagan af Heljarslóðarorrustu (20336 words)
*1882: Brynjólfur Sveinsson biskup (27342 words)
*1883: Hans Vöggur (1927 words)
*1888: Grímur kaupmaður deyr (7241 words)
*1888: Vordraumur (10753 words)
*1902: Upp við fossa (20647 words)
*1907: Leysing (20613 words)
*1908: Ofurefli (20262 words)
*1920: Árin og eilífðin. Prédikanir eftir Harald Níelsson (21234 words)
*1985: Margsaga (22295 words)
*1985: Sagan öll (20980 words)
*2008: Ofsi (21144 words)
*2008: Segðu mömmu að mér líði vel - saga um ástir - (21958 words)

Total number of words: 1,002,390

==Directories included in Version 0.9==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.9 release (of August 26th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.9. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-29T01:39:26Z

Anton: /* (VERSION 0.9 IS NOT ONLINE JUST YET!) Download Version 0.9, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that has built a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

Download Version 0.9, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.9 - Current release'''

The current release is version 0.9 of 1,002,390 words total from every century between the 12th and the 21st centuries inclusive. All of the text for version 1.0 is already included but some minor corrections remain to be finished.

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.9.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.9. LGPL. (zip, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.9. LGPL. (user friendly visual setup, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.9. LGPL. (manual setup, XXX MB, 1,002,390 words )

'''Version 0.5'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.9==
*1150: Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (4422 words)
*1150: Íslensk hómilíubók (Icelandic book of homilies) (40943 words)
*1210: Jarteinabók (10328 words)
*1210: Þorláks saga helga (10868 words)
*1250: Íslendinga saga (22805 words)
*1250: Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (3461 words)
*1260: Jómsvíkinga saga (21133 words)
*1270: Grágás. Lagasafn íslenska þjóðveldisins. (6203 words)
*1275: Morkinskinna (25064 words)
*1300: Alexanders saga (23356 words)
*1310: Grettis saga Ásmundarsonar (20563 words)
*1325: Árna saga biskups (19968 words)
*1350: Bandamanna saga (Möðruvallabók text) (13618 words)
*1350: Finnboga saga ramma (23036 words)
*1350: Mörtu saga og Maríu Magdalenu (17241 words)
*1400: Gunnars saga Keldugnúpsfífls (8770 words)
*1400: Gunnars saga Keldugnúpsfífls - Part 2 (3164 words)
*1400: Víglundar saga (13453 words)
*1450: Bandamanna saga (Konungsbók text) (11560 words)
*1450: Ectors saga (21063 words)
*1450: Júditarbók (6562 words)
*1450: Vilhjálms saga Sjóðs (23132 words)
*1475: Miðaldaævintýri (18084 words)
*1480: Jarlmanns saga og Hermanns (14482 words)
*1525: Erasmus saga (Reykjahólabók) (8589 words)
*1525: Georgíus saga (Reykjahólabók) (20092 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (16550 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (20925 words)
*1593: Eintal sálarinnar við sjálfa sig (23327 words)
*1611: Okur (15481 words)
*1628: Reisubók séra Ólafs Egilssonar (17199 words)
*1630: Fimmtíu heilagar hugvekjur Meditationes sacrae (12698 words)
*1650: Illuga saga Tagldarbana (20921 words)
*1659: Píslarsaga séra Jóns Magnússonar (9825 words)
*1661: Reisubók Jóns Ólafssonar Indíafara (23031 words)
*1675: Móðars þáttur (3845 words)
*1675: Söguþáttur af Ármanni og Þorsteini gála (11228 words)
*1675: Um ætt Magnúsar Jónssonar (3187 words)
*1680: Sögu-þáttur um Skálholts biskupa fyrir og um siðaskiptin. (10281 words)
*1720: Vídalínspostilla (23016 words)
*1725: Biskupasögur Jóns prófasts Halldórssonar í Hítardal (22297 words)
*1745: Nikulás Klím (22038 words)
*1790: Fimmbræðra saga (18860 words)
*1791: Ævisaga síra Jóns Steingrímssonar (22369 words)
*1830: Hellismanna saga (14988 words)
*1835: Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (3257 words)
*1850: Piltur og stúlka (17844 words)
*1859: Fimtíu hugvekjur út af pínu og dauða Drottins vors Jesú Krists (20530 words)
*1861: Sagan af Heljarslóðarorrustu (20336 words)
*1882: Brynjólfur Sveinsson biskup (27342 words)
*1883: Hans Vöggur (1927 words)
*1888: Grímur kaupmaður deyr (7241 words)
*1888: Vordraumur (10753 words)
*1902: Upp við fossa (20647 words)
*1907: Leysing (20613 words)
*1908: Ofurefli (20262 words)
*1920: Árin og eilífðin. Prédikanir eftir Harald Níelsson (21234 words)
*1985: Margsaga (22295 words)
*1985: Sagan öll (20980 words)
*2008: Ofsi (21144 words)
*2008: Segðu mömmu að mér líði vel - saga um ástir - (21958 words)

Total number of words: 1,002,390

==Directories included in Version 0.9==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.9 release (of August 26th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.9. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-29T01:36:33Z

Anton: Reverted edits by 222.130.86.182 (talk) to last revision by 89.160.136.159

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that has built a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==(VERSION 0.9 IS NOT ONLINE JUST YET!) Download Version 0.9, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.9 - Current release'''

The current release is version 0.9 of 1,002,390 words total from every century between the 12th and the 21st centuries inclusive. All of the text for version 1.0 is already included but some minor corrections remain to be finished.

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.9.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.9. LGPL. (zip, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.9. LGPL. (user friendly visual setup, XXX MB, 1,002,390 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.9-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.9. LGPL. (manual setup, XXX MB, 1,002,390 words )

'''Version 0.5'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.9==
*1150: Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (4422 words)
*1150: Íslensk hómilíubók (Icelandic book of homilies) (40943 words)
*1210: Jarteinabók (10328 words)
*1210: Þorláks saga helga (10868 words)
*1250: Íslendinga saga (22805 words)
*1250: Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (3461 words)
*1260: Jómsvíkinga saga (21133 words)
*1270: Grágás. Lagasafn íslenska þjóðveldisins. (6203 words)
*1275: Morkinskinna (25064 words)
*1300: Alexanders saga (23356 words)
*1310: Grettis saga Ásmundarsonar (20563 words)
*1325: Árna saga biskups (19968 words)
*1350: Bandamanna saga (Möðruvallabók text) (13618 words)
*1350: Finnboga saga ramma (23036 words)
*1350: Mörtu saga og Maríu Magdalenu (17241 words)
*1400: Gunnars saga Keldugnúpsfífls (8770 words)
*1400: Gunnars saga Keldugnúpsfífls - Part 2 (3164 words)
*1400: Víglundar saga (13453 words)
*1450: Bandamanna saga (Konungsbók text) (11560 words)
*1450: Ectors saga (21063 words)
*1450: Júditarbók (6562 words)
*1450: Vilhjálms saga Sjóðs (23132 words)
*1475: Miðaldaævintýri (18084 words)
*1480: Jarlmanns saga og Hermanns (14482 words)
*1525: Erasmus saga (Reykjahólabók) (8589 words)
*1525: Georgíus saga (Reykjahólabók) (20092 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (16550 words)
*1540: Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (20925 words)
*1593: Eintal sálarinnar við sjálfa sig (23327 words)
*1611: Okur (15481 words)
*1628: Reisubók séra Ólafs Egilssonar (17199 words)
*1630: Fimmtíu heilagar hugvekjur Meditationes sacrae (12698 words)
*1650: Illuga saga Tagldarbana (20921 words)
*1659: Píslarsaga séra Jóns Magnússonar (9825 words)
*1661: Reisubók Jóns Ólafssonar Indíafara (23031 words)
*1675: Móðars þáttur (3845 words)
*1675: Söguþáttur af Ármanni og Þorsteini gála (11228 words)
*1675: Um ætt Magnúsar Jónssonar (3187 words)
*1680: Sögu-þáttur um Skálholts biskupa fyrir og um siðaskiptin. (10281 words)
*1720: Vídalínspostilla (23016 words)
*1725: Biskupasögur Jóns prófasts Halldórssonar í Hítardal (22297 words)
*1745: Nikulás Klím (22038 words)
*1790: Fimmbræðra saga (18860 words)
*1791: Ævisaga síra Jóns Steingrímssonar (22369 words)
*1830: Hellismanna saga (14988 words)
*1835: Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (3257 words)
*1850: Piltur og stúlka (17844 words)
*1859: Fimtíu hugvekjur út af pínu og dauða Drottins vors Jesú Krists (20530 words)
*1861: Sagan af Heljarslóðarorrustu (20336 words)
*1882: Brynjólfur Sveinsson biskup (27342 words)
*1883: Hans Vöggur (1927 words)
*1888: Grímur kaupmaður deyr (7241 words)
*1888: Vordraumur (10753 words)
*1902: Upp við fossa (20647 words)
*1907: Leysing (20613 words)
*1908: Ofurefli (20262 words)
*1920: Árin og eilífðin. Prédikanir eftir Harald Níelsson (21234 words)
*1985: Margsaga (22295 words)
*1985: Sagan öll (20980 words)
*2008: Ofsi (21144 words)
*2008: Segðu mömmu að mér líði vel - saga um ástir - (21958 words)

Total number of words: 1,002,390

==Directories included in Version 0.9==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.9 release (of August 26th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.9. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-24T14:29:28Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-24T10:24:07Z

Anton:

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* '''Available soon: Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS'''. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-08-24T10:23:19Z

Anton: Reverted edits by 61.18.170.124 (talk) to last revision by 130.208.73.169

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-15T14:27:09Z

Anton: /* Annotation guidelines */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.5 which is a preview release of about 632.000 words from every century between the 12th and the 20th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

==Citation==
For the version 0.5 release of July 5th 2011.

<pre>
Wallenberg, Joel C., Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-15T13:21:15Z

Anton:

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.5 which is a preview release of about 632.000 words from every century between the 12th and the 20th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.5 release of July 5th 2011.

<pre>
Wallenberg, Joel C., Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Download

2011-07-05T17:33:53Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-windows-setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* '''Available soon: Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS'''. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T17:30:00Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, 8.0 MB, ca. 632.000 words)
* '''Available soon: Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS'''. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, 8.4 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T17:29:05Z

Anton:

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* '''Available soon: Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS'''. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T16:44:43Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T15:28:53Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent User Interface (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T15:22:28Z

Anton: /* Texts included in Version 0.5 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Earth) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T15:05:34Z

Anton: /* Texts included in Version 0.4 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.5==
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*40844 words from Íslensk hómilíubók (Icelandic book of homilies) (1150)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*22719 words from Íslendinga saga (1250)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*25017 words from Morkinskinna (1275)
*23347 words from Alexanders saga (1300)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23040 words from Finnboga saga ramma (1350)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*23040 words from Vilhjálms saga Sjóðs (1450)
*18042 words from Miðaldaævintýri (1475)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*8582 words from Erasmus saga (Reykjahólabók) (1525)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*3857 words from Móðars þáttur (1675)
*23032 words from Vídalínspostilla (1720)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*22290 words from Nikulás Klím (1745)
*18784 words from Fimmbræðra saga (1790)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Eart) (1835)
*17837 words from Piltur og stúlka (1850)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*20687 words from Upp við fossa (1902)
*20664 words from Leysing (1907)
*20305 words from Ofurefli (1908)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:47:14Z

Anton: /* Directories included in Version 0.4 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23032 words from Vídalínspostilla (1720)
*25017 words from Morkinskinna (1275)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*20687 words from Upp við fossa (1902)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*17837 words from Piltur og stúlka (1850)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Eart) (1835)
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*23346 words from Alexanders saga (1300)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*20305 words from Ofurefli (1908)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*18042 words from Miðaldaævintýri (1500)
*22719 words from Íslendinga saga (1250)
*20664 words from Leysing (1907)
*40844 words from No TextName defined in info file! (1150)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*23040 words from Finnboga saga ramma (1350)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*18784 words from Fimmbræðra saga (1790)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*23040 words from Vilhjálms saga Sjóðs (1450)
*22290 words from Nikulás Klím (1745)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*3857 words from Móðars þáttur (1675)
*8582 words from Erasmus saga (Reykjahólabók) (1525)

Total number of words: 632422

==Directories included in Version 0.5==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:46:42Z

Anton: /* Texts included in Version 0.4 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23032 words from Vídalínspostilla (1720)
*25017 words from Morkinskinna (1275)
*11485 words from Bandamanna saga (Konungsbók text) (1450)
*3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
*20687 words from Upp við fossa (1902)
*11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
*17837 words from Piltur og stúlka (1850)
*3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Eart) (1835)
*4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
*16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
*23346 words from Alexanders saga (1300)
*3204 words from Um ætt Magnúsar Jónssonar (1675)
*22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
*27191 words from Brynjólfur Sveinsson biskup (1882)
*9759 words from Píslarsaga séra Jóns Magnússonar (1659)
*20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
*6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
*20305 words from Ofurefli (1908)
*20380 words from Sagan af Heljarslóðarorrustu (1861)
*18042 words from Miðaldaævintýri (1500)
*22719 words from Íslendinga saga (1250)
*20664 words from Leysing (1907)
*40844 words from No TextName defined in info file! (1150)
*17126 words from Reisubók séra Ólafs Egilssonar (1628)
*23040 words from Finnboga saga ramma (1350)
*13151 words from Georgíus saga (Reykjahólabók) (1525)
*18784 words from Fimmbræðra saga (1790)
*22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
*12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
*23040 words from Vilhjálms saga Sjóðs (1450)
*22290 words from Nikulás Klím (1745)
*22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
*3857 words from Móðars þáttur (1675)
*8582 words from Erasmus saga (Reykjahólabók) (1525)

Total number of words: 632422

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:45:56Z

Anton: /* Texts included in Version 0.4 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
*23384 words from Eintal sálarinnar við sjálfa sig (1593)
*15445 words from Okur (1611)
*13541 words from Bandamanna saga (Möðruvallabók text) (1350)
*23032 words from Vídalínspostilla (1720)
25017 words from Morkinskinna (1275)
11485 words from Bandamanna saga (Konungsbók text) (1450)
3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
20687 words from Upp við fossa (1902)
11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
17837 words from Piltur og stúlka (1850)
3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Eart) (1835)
4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
23346 words from Alexanders saga (1300)
3204 words from Um ætt Magnúsar Jónssonar (1675)
22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
27191 words from Brynjólfur Sveinsson biskup (1882)
9759 words from Píslarsaga séra Jóns Magnússonar (1659)
20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
20305 words from Ofurefli (1908)
20380 words from Sagan af Heljarslóðarorrustu (1861)
18042 words from Miðaldaævintýri (1500)
22719 words from Íslendinga saga (1250)
20664 words from Leysing (1907)
40844 words from No TextName defined in info file! (1150)
17126 words from Reisubók séra Ólafs Egilssonar (1628)
23040 words from Finnboga saga ramma (1350)
13151 words from Georgíus saga (Reykjahólabók) (1525)
18784 words from Fimmbræðra saga (1790)
22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
23040 words from Vilhjálms saga Sjóðs (1450)
22290 words from Nikulás Klím (1745)
22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
3857 words from Móðars þáttur (1675)
8582 words from Erasmus saga (Reykjahólabók) (1525)

Total number of words: 632422

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:45:05Z

Anton: /* Texts included in Version 0.4 */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
23384 words from Eintal sálarinnar við sjálfa sig (1593)
15445 words from Okur (1611)
13541 words from Bandamanna saga (Möðruvallabók text) (1350)
23032 words from Vídalínspostilla (1720)
25017 words from Morkinskinna (1275)
11485 words from Bandamanna saga (Konungsbók text) (1450)
3458 words from Þetubrot Egils Sögu (Theta manuscript of Egils Saga) (1250)
20687 words from Upp við fossa (1902)
11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
17837 words from Piltur og stúlka (1850)
3268 words from Um eðli og uppruna jarðarinnar (On the Nature and Origin of the Eart) (1835)
4438 words from Fyrsta málfræðiritgerðin (The First Grammatical Treatise) (1150)
16420 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), Postulanna Gjörningar (Acts of the Apostles) (1540)
23346 words from Alexanders saga (1300)
3204 words from Um ætt Magnúsar Jónssonar (1675)
22098 words from Ævisaga síra Jóns Steingrímssonar (1791)
27191 words from Brynjólfur Sveinsson biskup (1882)
9759 words from Píslarsaga séra Jóns Magnússonar (1659)
20682 words from Nýja Testamenti Odds Gottskálkssonar (The New Testament of Oddur Gottskálksson), S. Jóhannis Guðspjöll (Gospel of St. John) (1540)
6194 words from Grágás. Lagasafn íslenska þjóðveldisins. (1270)
20305 words from Ofurefli (1908)
20380 words from Sagan af Heljarslóðarorrustu (1861)
18042 words from Miðaldaævintýri (1500)
22719 words from Íslendinga saga (1250)
20664 words from Leysing (1907)
40844 words from No TextName defined in info file! (1150)
17126 words from Reisubók séra Ólafs Egilssonar (1628)
23040 words from Finnboga saga ramma (1350)
13151 words from Georgíus saga (Reykjahólabók) (1525)
18784 words from Fimmbræðra saga (1790)
22297 words from Biskupasögur Jóns prófasts Halldórssonar í Hítardal (1725)
12690 words from Fimmtíu heilagar hugvekjur Meditationes sacrae (1630)
23040 words from Vilhjálms saga Sjóðs (1450)
22290 words from Nikulás Klím (1745)
22904 words from Reisubók Jóns Ólafssonar Indíafara (1661)
3857 words from Móðars þáttur (1675)
8582 words from Erasmus saga (Reykjahólabók) (1525)

Total number of words: 632422

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:06:45Z

Anton: /* Citation for the Version 0.4 release (of April 12th 2011) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.5 release (of July 5th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:02:24Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.5.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.5. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.5-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.5. LGPL. (user friendly visual setup, X MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.5-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.5. LGPL. (manual setup, X MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:01:34Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 632.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 632.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:01:05Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Version 0.5 - Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T13:00:40Z

Anton: /* Download Version 0.5, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.4'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Version 0.3'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)

'''Version 0.2'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)

'''Version 0.1'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-07-05T12:59:43Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.5, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''

* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-05T12:58:55Z

Anton: /* Citation */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.5 which is a preview release of about 632.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.5 release of July 5th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.5. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-05T12:58:32Z

Anton: /* Download */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.5 which is a preview release of about 632.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-05T12:58:15Z

Anton: /* Download */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.4 which is a preview release of about 632.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-07-05T12:58:00Z

Anton: /* Download */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.4 which is a preview release of about 630.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Annotald

2011-05-13T15:27:38Z

Anton: /* CoIndex (C) */

Annotald is a program that facilitates editing of phrase structure in labeled bracketing format. The program is tightly integrated with the Icelandic Parsed Historical Corpus (IcePaHC). The program, as well as this documentation, is a work in progress, and should be expected to be incomplete in various ways. Users are encouraged to save their files frequently and back them up to a repository to prevent loss of data.

==Installing and running==

In addition to the Annotald program files, included in the treedrawing directory of the IcePaHC git repository, the following 3rd party programs and libraries are required:

* Python 2 (not compatible with Python 3, yet)
* CherryPy 3 (not compatible with CherryPy 2)
* Google Chrome (not compatible with any other browser)

CherryPy is required in order to launch the Annotald web server that handles communication between the web-based Annotald user interface and manipulation of files on the hard drive. To install CherryPy 3 on Ubuntu, type in a terminal:

<code>sudo apt-get install python-cherrypy3</code>

To run Annotald from the IcePaHC parsing directory and open the file "filename.psd", type:

<code>./annotald filename.psd</code>

This is equivalent to:

<code>python ../treedrawing/treedrawing.py filename.psd</code>

When the program runs it starts a webserver on port 8080. You can then edit "filename.psd" by directing Google Chrome to the following path:

[http://localhost:8080 http://localhost:8080]

==General philosophy==

Annotald is designed to maximize the speed of phrase structure annotation. It is important for the understand the philosophy of the design to make the most of the program. First, most tasks can be performed without ever taking the right hand off the mouse and the left hand off its normal position at the left side of the keyboard. Sometimes it is possible to enter a phrase label or tag using the full keyboard, but this is rarely a good idea, since it takes the annotator's hands out of the previously described position where all the shortcuts are accessible.

==Selecting and unselecting nodes==

Nodes are selected by left clicking them. The first node selected becomes the "startnode" and the second node selected becomes the "endnode" for the purposes of commands that deal with more than one node at a time. Only two nodes can be selected at any one time. Clicking a selected node unselects the node. When one of two selected nodes is unselected, the remaining selected node becomes the "startnode", whether it had that status before or not.

====Clear selection with space bar====
The fastest way to clear the selection entirely, including both nodes if two are selected, is to press the space bar. Another way to unselect everything is to left click the highlighted area to each side of editing area where the sentences are displayed. Left clicking the area to the left of the editing area is a fairly fast way clear the selection.

==Moving nodes around==

====Left click + Right click====
A node that has been selected can be moved under another node by right clicking the target node. Clause level nodes are highlighted (using a different background color) to make it easier to identify the current "floor" of the sentence. Annotald will not allow the user to move nodes in a way that violates the linear order of the words in the sentence, or results in an otherwise ill-formed structure.

====Select 2 sisters + Right click====
Multiple nodes can be moved at once by making use of a "startnode" and an "endnode". Select two nodes that are sisters and right click a target to move the two sisters and all their sisters that are in between them. Annotald will again not allow movement that results in an ill-formed structure.

====Splitting and merging tokens====
Splitting and joining tokens is done like any other moving of nodes in Annotald. Move a node or nodes to the leftmost part of the editing area using the left click + right click method to split it away from its current token. Move the root node of a token the same way inside an adjacent token to merge tokens.

==Changing labels==
The label of a selected node can by changed using shortcuts or by typing it in. The latter method should be avoided for it takes a longer time for a trained user and introduces typing mistakes as a potential source of errors.

====Mouse shortcuts====
Many of the most common label changes can be performed using mouse shortcuts. To bring up a context menu for a node, right click the node. When no node is selected (no "startnode" or "endnode" by means of left clicking) any node can be right clicked to bring up its menu. When one node is selected, that node, and only that node, has an active context menu. The context menu is not active at all when two nodes are selected.

=====Simple relabeling from context menu=====
A simple relabeling of the node is done by selecting an option from the "Label" section of the context menu. A "label" section appears for all nodes. In most cases Annotald offers labels that belong to a set of labels related to the current label, but as a fallback it shows verb tags, when it doesn't have a definition for what amounts to a related label.

=====Changing the case of a phrase or tag=====
When a right click is used to bring up the context menu for a phrase that has case, most commonly a noun phrase, a special "case" section appears in the context menu. Selecting case from the context menu of a phrase changes all the case extensions on tags that are immediately dominated by the phrase. This saves time when correcting case on multiple items, like when an NP has a quantifier, an adjective and a noun. The "case" section is also displayed in the context menu for tag nodes that have case, but only one tag can be corrected at a time using that feature.

====Keyboard shortcuts====
Changing a label using keyboard shortcuts can be very fast. When a node is selected (always the "startnode"), an annotator can pick a label for it using shortcuts on the left side of the keyboard. For this reason, the left hand should always rest on the left side of the keyboard while annotating. Various keys on the left side of the keyboard represent a label group:

'''NOTE: The shortcuts might change a little bit as the program moves from beta to stable'''

* E = CP-ADV, CP-CMP
* R = CP-REL, CP-FRL, CP-CAR, CP-CLF
* S = IP-SUB, IP-MAT, IP-IMP
* V = IP-SMC, IP-INF, IP-INF-PRP
* T = CP-THT, CP-THT-PRN, CP-DEG, CP-QUE
* G = ADJP, ADJP-SPR, NP-MSR, QP
* F = PP, ADVP, ADVP-TMP, ADVP-LOC, ADVP-DIR
* 2 = NP, NP-PRN, NP-POS, NP-COM
* Q = CONJP, ALSO, FP
* W = NP-SBJ, NP-OB1, NP-OB2, NP-PRD

When one of the above shortcut keys is pressed, the selected (startnode) is updated. If the previous label is not in the group of the key just pressed, the label is set to the first item in the list. If the previous label is in the group of the key, then pressing the key repeatedly rotates through the labels in the group. Therefore, and XP can be changed into NP-OB1 by pressing the W key twice.

====L + Typing====
Pressing the L button triggers the edit label mode. This key is on the right side of the keyboard since the user will anyway have to do the rare move of the right hand away from the mouse to do the typing. When L is pressed an edit box is displayed with the current label selected. To replace the label entirely, type away and the previous label will disappear. To change only the last part of the label, like adding or changing an extension to the tag, press space bar while in edit mode, which will unselect label and place the caret at the end of it. Press Enter to confirm the label that has been typed.

==Creating nodes==

====X for XP====
Pressing X creates an XP over the currently selected node or nodes. The XP remains selected for further editing. To create an NP-SBJ over a selected node (or a span of nodes by selecting a starnode and an endnode), press X and then W. To create an NP-OB1, press XWW. A node with a label that is not accessible from the keyboard shortcuts can be created by using XL, which opens edit mode for the newly created node.

====Ctrl + Left Click====
When a startnode has been selected, holding down Ctrl and left clicking a sister of the startnode creates an XP that spans the area from the startnode to the node that was clicked. This has the same effect as left clicking to add an endnode to the selection an then pressing X to create the node.

====B and A for new leafs before and after====
B and A are shortcuts for creating arbitrary leafs before are after the selected node. This can be used for empty categories like expletive subjects. The edit mode for the new leaf works the same as the edit mode for labels. Typing away replaces the content of the box, spacebar moves the caret to the end for editing the last part. The tab key is used to move between the two boxes. Enter confirms what has been typed.

====B and A for traces before and after====
When two nodes are selected, a startnode and an endnode, B and A work like in the above section, but create a trace of the endnode before/after the startnode. The label of the endnode is copied to the newly created trace. If the endnode is a W-phrase of some sort, a *T* trace is created and the W is removed from the copied label that appears over the trace. If the endnode is not a W-phrase, an ICE trace is created. Pressing Enter after B/A confirms the initial suggestion, but editing is possible and works as in other uses of the B/A shortcuts.

====Leaf before from context menu====
Right clicking a node brings up the context menu. At the right side the section "Leaf before" provides a fast way to add the most common empty categories. This is the preferred method to create empty subjects and empty C and P heads in Annotald.

==Delete/prune node (D)==
Pressing the D key prunes a selected phrase node. D normally has no effect on tag nodes since words should not be deleted. The exceptions are empty categories (start with *), comments (in curly brackets) and special tags (start with lt-sign), which can be deleted using the D key.

==CoIndex (C)==
Pressing C co-indexes two selected nodes. If they are already coindexed, repeatedly pressing C rotates through combinations of - (normal) and = (gapping) indices. The order for selected startnode/endnode is:

* --
* -= (gapping)
* =- (backwards gapping)
* == (coindex two instances of gapping)
* remove all indices

Selecting a single indexed node and pressing C removes the index on that node.

Ordering of indices is reset to a nice organization on save if they become unordered during editing.

==Undo (Z)/redo (1)==
Undo can be triggered using the Z key or a button to the right of the editing area.

Redo can be triggered using the 1 key or a button to the right of the editing area.

==Save==
Use the button in the menu to the right of the edit area. The last save is copied into a backup file in the same directory and the current state of the file is saved under the same name as the original file. This is different from CorpusDraw, which saves under ".new". The method used in Annotald is more appropriate for a project that uses a version control system, since the version control system keeps track of the various stages of the file. The user is of course responsible for committing changes frequently enough in case there is a problem with Annotald.

==Known issues==
* Splitting and joining words is not currently possible in Annotald. The current workaround is to save the file in Annotald, open it a text editor, do the change there, and use refresh to load the updated version into Annotald. This will be fixed soon.
* Annotald does not give feedback when the save operation is complete. Save seems to always work though, but be careful and save and commit changes frequently.

Annotald

2011-05-13T15:12:46Z

Anton: /* CoIndex (C) */

Annotald is a program that facilitates editing of phrase structure in labeled bracketing format. The program is tightly integrated with the Icelandic Parsed Historical Corpus (IcePaHC). The program, as well as this documentation, is a work in progress, and should be expected to be incomplete in various ways. Users are encouraged to save their files frequently and back them up to a repository to prevent loss of data.

==Installing and running==

In addition to the Annotald program files, included in the treedrawing directory of the IcePaHC git repository, the following 3rd party programs and libraries are required:

* Python 2 (not compatible with Python 3, yet)
* CherryPy 3 (not compatible with CherryPy 2)
* Google Chrome (not compatible with any other browser)

CherryPy is required in order to launch the Annotald web server that handles communication between the web-based Annotald user interface and manipulation of files on the hard drive. To install CherryPy 3 on Ubuntu, type in a terminal:

<code>sudo apt-get install python-cherrypy3</code>

To run Annotald from the IcePaHC parsing directory and open the file "filename.psd", type:

<code>./annotald filename.psd</code>

This is equivalent to:

<code>python ../treedrawing/treedrawing.py filename.psd</code>

When the program runs it starts a webserver on port 8080. You can then edit "filename.psd" by directing Google Chrome to the following path:

[http://localhost:8080 http://localhost:8080]

==General philosophy==

Annotald is designed to maximize the speed of phrase structure annotation. It is important for the understand the philosophy of the design to make the most of the program. First, most tasks can be performed without ever taking the right hand off the mouse and the left hand off its normal position at the left side of the keyboard. Sometimes it is possible to enter a phrase label or tag using the full keyboard, but this is rarely a good idea, since it takes the annotator's hands out of the previously described position where all the shortcuts are accessible.

==Selecting and unselecting nodes==

Nodes are selected by left clicking them. The first node selected becomes the "startnode" and the second node selected becomes the "endnode" for the purposes of commands that deal with more than one node at a time. Only two nodes can be selected at any one time. Clicking a selected node unselects the node. When one of two selected nodes is unselected, the remaining selected node becomes the "startnode", whether it had that status before or not.

====Clear selection with space bar====
The fastest way to clear the selection entirely, including both nodes if two are selected, is to press the space bar. Another way to unselect everything is to left click the highlighted area to each side of editing area where the sentences are displayed. Left clicking the area to the left of the editing area is a fairly fast way clear the selection.

==Moving nodes around==

====Left click + Right click====
A node that has been selected can be moved under another node by right clicking the target node. Clause level nodes are highlighted (using a different background color) to make it easier to identify the current "floor" of the sentence. Annotald will not allow the user to move nodes in a way that violates the linear order of the words in the sentence, or results in an otherwise ill-formed structure.

====Select 2 sisters + Right click====
Multiple nodes can be moved at once by making use of a "startnode" and an "endnode". Select two nodes that are sisters and right click a target to move the two sisters and all their sisters that are in between them. Annotald will again not allow movement that results in an ill-formed structure.

====Splitting and merging tokens====
Splitting and joining tokens is done like any other moving of nodes in Annotald. Move a node or nodes to the leftmost part of the editing area using the left click + right click method to split it away from its current token. Move the root node of a token the same way inside an adjacent token to merge tokens.

==Changing labels==
The label of a selected node can by changed using shortcuts or by typing it in. The latter method should be avoided for it takes a longer time for a trained user and introduces typing mistakes as a potential source of errors.

====Mouse shortcuts====
Many of the most common label changes can be performed using mouse shortcuts. To bring up a context menu for a node, right click the node. When no node is selected (no "startnode" or "endnode" by means of left clicking) any node can be right clicked to bring up its menu. When one node is selected, that node, and only that node, has an active context menu. The context menu is not active at all when two nodes are selected.

=====Simple relabeling from context menu=====
A simple relabeling of the node is done by selecting an option from the "Label" section of the context menu. A "label" section appears for all nodes. In most cases Annotald offers labels that belong to a set of labels related to the current label, but as a fallback it shows verb tags, when it doesn't have a definition for what amounts to a related label.

=====Changing the case of a phrase or tag=====
When a right click is used to bring up the context menu for a phrase that has case, most commonly a noun phrase, a special "case" section appears in the context menu. Selecting case from the context menu of a phrase changes all the case extensions on tags that are immediately dominated by the phrase. This saves time when correcting case on multiple items, like when an NP has a quantifier, an adjective and a noun. The "case" section is also displayed in the context menu for tag nodes that have case, but only one tag can be corrected at a time using that feature.

====Keyboard shortcuts====
Changing a label using keyboard shortcuts can be very fast. When a node is selected (always the "startnode"), an annotator can pick a label for it using shortcuts on the left side of the keyboard. For this reason, the left hand should always rest on the left side of the keyboard while annotating. Various keys on the left side of the keyboard represent a label group:

'''NOTE: The shortcuts might change a little bit as the program moves from beta to stable'''

* E = CP-ADV, CP-CMP
* R = CP-REL, CP-FRL, CP-CAR, CP-CLF
* S = IP-SUB, IP-MAT, IP-IMP
* V = IP-SMC, IP-INF, IP-INF-PRP
* T = CP-THT, CP-THT-PRN, CP-DEG, CP-QUE
* G = ADJP, ADJP-SPR, NP-MSR, QP
* F = PP, ADVP, ADVP-TMP, ADVP-LOC, ADVP-DIR
* 2 = NP, NP-PRN, NP-POS, NP-COM
* Q = CONJP, ALSO, FP
* W = NP-SBJ, NP-OB1, NP-OB2, NP-PRD

When one of the above shortcut keys is pressed, the selected (startnode) is updated. If the previous label is not in the group of the key just pressed, the label is set to the first item in the list. If the previous label is in the group of the key, then pressing the key repeatedly rotates through the labels in the group. Therefore, and XP can be changed into NP-OB1 by pressing the W key twice.

====L + Typing====
Pressing the L button triggers the edit label mode. This key is on the right side of the keyboard since the user will anyway have to do the rare move of the right hand away from the mouse to do the typing. When L is pressed an edit box is displayed with the current label selected. To replace the label entirely, type away and the previous label will disappear. To change only the last part of the label, like adding or changing an extension to the tag, press space bar while in edit mode, which will unselect label and place the caret at the end of it. Press Enter to confirm the label that has been typed.

==Creating nodes==

====X for XP====
Pressing X creates an XP over the currently selected node or nodes. The XP remains selected for further editing. To create an NP-SBJ over a selected node (or a span of nodes by selecting a starnode and an endnode), press X and then W. To create an NP-OB1, press XWW. A node with a label that is not accessible from the keyboard shortcuts can be created by using XL, which opens edit mode for the newly created node.

====Ctrl + Left Click====
When a startnode has been selected, holding down Ctrl and left clicking a sister of the startnode creates an XP that spans the area from the startnode to the node that was clicked. This has the same effect as left clicking to add an endnode to the selection an then pressing X to create the node.

====B and A for new leafs before and after====
B and A are shortcuts for creating arbitrary leafs before are after the selected node. This can be used for empty categories like expletive subjects. The edit mode for the new leaf works the same as the edit mode for labels. Typing away replaces the content of the box, spacebar moves the caret to the end for editing the last part. The tab key is used to move between the two boxes. Enter confirms what has been typed.

====B and A for traces before and after====
When two nodes are selected, a startnode and an endnode, B and A work like in the above section, but create a trace of the endnode before/after the startnode. The label of the endnode is copied to the newly created trace. If the endnode is a W-phrase of some sort, a *T* trace is created and the W is removed from the copied label that appears over the trace. If the endnode is not a W-phrase, an ICE trace is created. Pressing Enter after B/A confirms the initial suggestion, but editing is possible and works as in other uses of the B/A shortcuts.

====Leaf before from context menu====
Right clicking a node brings up the context menu. At the right side the section "Leaf before" provides a fast way to add the most common empty categories. This is the preferred method to create empty subjects and empty C and P heads in Annotald.

==Delete/prune node (D)==
Pressing the D key prunes a selected phrase node. D normally has no effect on tag nodes since words should not be deleted. The exceptions are empty categories (start with *), comments (in curly brackets) and special tags (start with lt-sign), which can be deleted using the D key.

==CoIndex (C)==
Pressing C co-indexes two selected nodes. If they are already coindexed, repeatedly pressing C rotates through combinations of - (normal) and = (gapping) indices. The order for selected startnode/endnode is:

* --
* -= (gapping)
* =- (backwards gapping)
* == (coindex two instances of gapping)
* remove all indices

Ordering of indices is reset to a nice organization on save if they become unordered during editing.

==Undo (Z)/redo (1)==
Undo can be triggered using the Z key or a button to the right of the editing area.

Redo can be triggered using the 1 key or a button to the right of the editing area.

==Save==
Use the button in the menu to the right of the edit area. The last save is copied into a backup file in the same directory and the current state of the file is saved under the same name as the original file. This is different from CorpusDraw, which saves under ".new". The method used in Annotald is more appropriate for a project that uses a version control system, since the version control system keeps track of the various stages of the file. The user is of course responsible for committing changes frequently enough in case there is a problem with Annotald.

==Known issues==
* Splitting and joining words is not currently possible in Annotald. The current workaround is to save the file in Annotald, open it a text editor, do the change there, and use refresh to load the updated version into Annotald. This will be fixed soon.
* Annotald does not give feedback when the save operation is complete. Save seems to always work though, but be careful and save and commit changes frequently.

Annotald

2011-05-13T15:11:17Z

Anton: /* CoIndex (C) */

Annotald is a program that facilitates editing of phrase structure in labeled bracketing format. The program is tightly integrated with the Icelandic Parsed Historical Corpus (IcePaHC). The program, as well as this documentation, is a work in progress, and should be expected to be incomplete in various ways. Users are encouraged to save their files frequently and back them up to a repository to prevent loss of data.

==Installing and running==

In addition to the Annotald program files, included in the treedrawing directory of the IcePaHC git repository, the following 3rd party programs and libraries are required:

* Python 2 (not compatible with Python 3, yet)
* CherryPy 3 (not compatible with CherryPy 2)
* Google Chrome (not compatible with any other browser)

CherryPy is required in order to launch the Annotald web server that handles communication between the web-based Annotald user interface and manipulation of files on the hard drive. To install CherryPy 3 on Ubuntu, type in a terminal:

<code>sudo apt-get install python-cherrypy3</code>

To run Annotald from the IcePaHC parsing directory and open the file "filename.psd", type:

<code>./annotald filename.psd</code>

This is equivalent to:

<code>python ../treedrawing/treedrawing.py filename.psd</code>

When the program runs it starts a webserver on port 8080. You can then edit "filename.psd" by directing Google Chrome to the following path:

[http://localhost:8080 http://localhost:8080]

==General philosophy==

Annotald is designed to maximize the speed of phrase structure annotation. It is important for the understand the philosophy of the design to make the most of the program. First, most tasks can be performed without ever taking the right hand off the mouse and the left hand off its normal position at the left side of the keyboard. Sometimes it is possible to enter a phrase label or tag using the full keyboard, but this is rarely a good idea, since it takes the annotator's hands out of the previously described position where all the shortcuts are accessible.

==Selecting and unselecting nodes==

Nodes are selected by left clicking them. The first node selected becomes the "startnode" and the second node selected becomes the "endnode" for the purposes of commands that deal with more than one node at a time. Only two nodes can be selected at any one time. Clicking a selected node unselects the node. When one of two selected nodes is unselected, the remaining selected node becomes the "startnode", whether it had that status before or not.

====Clear selection with space bar====
The fastest way to clear the selection entirely, including both nodes if two are selected, is to press the space bar. Another way to unselect everything is to left click the highlighted area to each side of editing area where the sentences are displayed. Left clicking the area to the left of the editing area is a fairly fast way clear the selection.

==Moving nodes around==

====Left click + Right click====
A node that has been selected can be moved under another node by right clicking the target node. Clause level nodes are highlighted (using a different background color) to make it easier to identify the current "floor" of the sentence. Annotald will not allow the user to move nodes in a way that violates the linear order of the words in the sentence, or results in an otherwise ill-formed structure.

====Select 2 sisters + Right click====
Multiple nodes can be moved at once by making use of a "startnode" and an "endnode". Select two nodes that are sisters and right click a target to move the two sisters and all their sisters that are in between them. Annotald will again not allow movement that results in an ill-formed structure.

====Splitting and merging tokens====
Splitting and joining tokens is done like any other moving of nodes in Annotald. Move a node or nodes to the leftmost part of the editing area using the left click + right click method to split it away from its current token. Move the root node of a token the same way inside an adjacent token to merge tokens.

==Changing labels==
The label of a selected node can by changed using shortcuts or by typing it in. The latter method should be avoided for it takes a longer time for a trained user and introduces typing mistakes as a potential source of errors.

====Mouse shortcuts====
Many of the most common label changes can be performed using mouse shortcuts. To bring up a context menu for a node, right click the node. When no node is selected (no "startnode" or "endnode" by means of left clicking) any node can be right clicked to bring up its menu. When one node is selected, that node, and only that node, has an active context menu. The context menu is not active at all when two nodes are selected.

=====Simple relabeling from context menu=====
A simple relabeling of the node is done by selecting an option from the "Label" section of the context menu. A "label" section appears for all nodes. In most cases Annotald offers labels that belong to a set of labels related to the current label, but as a fallback it shows verb tags, when it doesn't have a definition for what amounts to a related label.

=====Changing the case of a phrase or tag=====
When a right click is used to bring up the context menu for a phrase that has case, most commonly a noun phrase, a special "case" section appears in the context menu. Selecting case from the context menu of a phrase changes all the case extensions on tags that are immediately dominated by the phrase. This saves time when correcting case on multiple items, like when an NP has a quantifier, an adjective and a noun. The "case" section is also displayed in the context menu for tag nodes that have case, but only one tag can be corrected at a time using that feature.

====Keyboard shortcuts====
Changing a label using keyboard shortcuts can be very fast. When a node is selected (always the "startnode"), an annotator can pick a label for it using shortcuts on the left side of the keyboard. For this reason, the left hand should always rest on the left side of the keyboard while annotating. Various keys on the left side of the keyboard represent a label group:

'''NOTE: The shortcuts might change a little bit as the program moves from beta to stable'''

* E = CP-ADV, CP-CMP
* R = CP-REL, CP-FRL, CP-CAR, CP-CLF
* S = IP-SUB, IP-MAT, IP-IMP
* V = IP-SMC, IP-INF, IP-INF-PRP
* T = CP-THT, CP-THT-PRN, CP-DEG, CP-QUE
* G = ADJP, ADJP-SPR, NP-MSR, QP
* F = PP, ADVP, ADVP-TMP, ADVP-LOC, ADVP-DIR
* 2 = NP, NP-PRN, NP-POS, NP-COM
* Q = CONJP, ALSO, FP
* W = NP-SBJ, NP-OB1, NP-OB2, NP-PRD

When one of the above shortcut keys is pressed, the selected (startnode) is updated. If the previous label is not in the group of the key just pressed, the label is set to the first item in the list. If the previous label is in the group of the key, then pressing the key repeatedly rotates through the labels in the group. Therefore, and XP can be changed into NP-OB1 by pressing the W key twice.

====L + Typing====
Pressing the L button triggers the edit label mode. This key is on the right side of the keyboard since the user will anyway have to do the rare move of the right hand away from the mouse to do the typing. When L is pressed an edit box is displayed with the current label selected. To replace the label entirely, type away and the previous label will disappear. To change only the last part of the label, like adding or changing an extension to the tag, press space bar while in edit mode, which will unselect label and place the caret at the end of it. Press Enter to confirm the label that has been typed.

==Creating nodes==

====X for XP====
Pressing X creates an XP over the currently selected node or nodes. The XP remains selected for further editing. To create an NP-SBJ over a selected node (or a span of nodes by selecting a starnode and an endnode), press X and then W. To create an NP-OB1, press XWW. A node with a label that is not accessible from the keyboard shortcuts can be created by using XL, which opens edit mode for the newly created node.

====Ctrl + Left Click====
When a startnode has been selected, holding down Ctrl and left clicking a sister of the startnode creates an XP that spans the area from the startnode to the node that was clicked. This has the same effect as left clicking to add an endnode to the selection an then pressing X to create the node.

====B and A for new leafs before and after====
B and A are shortcuts for creating arbitrary leafs before are after the selected node. This can be used for empty categories like expletive subjects. The edit mode for the new leaf works the same as the edit mode for labels. Typing away replaces the content of the box, spacebar moves the caret to the end for editing the last part. The tab key is used to move between the two boxes. Enter confirms what has been typed.

====B and A for traces before and after====
When two nodes are selected, a startnode and an endnode, B and A work like in the above section, but create a trace of the endnode before/after the startnode. The label of the endnode is copied to the newly created trace. If the endnode is a W-phrase of some sort, a *T* trace is created and the W is removed from the copied label that appears over the trace. If the endnode is not a W-phrase, an ICE trace is created. Pressing Enter after B/A confirms the initial suggestion, but editing is possible and works as in other uses of the B/A shortcuts.

====Leaf before from context menu====
Right clicking a node brings up the context menu. At the right side the section "Leaf before" provides a fast way to add the most common empty categories. This is the preferred method to create empty subjects and empty C and P heads in Annotald.

==Delete/prune node (D)==
Pressing the D key prunes a selected phrase node. D normally has no effect on tag nodes since words should not be deleted. The exceptions are empty categories (start with *), comments (in curly brackets) and special tags (start with lt-sign), which can be deleted using the D key.

==CoIndex (C)==
Pressing C co-indexes two selected nodes. If they are already coindexed, repeatedly pressing C rotates through combinations of - (normal) and = (gapping) indices. The order for selected startnode/endnode is:

* --
* -=
* =-
* ==
* remove all indices

Ordering of indices is reset to a nice organization on save if they become unordered during editing.

==Undo (Z)/redo (1)==
Undo can be triggered using the Z key or a button to the right of the editing area.

Redo can be triggered using the 1 key or a button to the right of the editing area.

==Save==
Use the button in the menu to the right of the edit area. The last save is copied into a backup file in the same directory and the current state of the file is saved under the same name as the original file. This is different from CorpusDraw, which saves under ".new". The method used in Annotald is more appropriate for a project that uses a version control system, since the version control system keeps track of the various stages of the file. The user is of course responsible for committing changes frequently enough in case there is a problem with Annotald.

==Known issues==
* Splitting and joining words is not currently possible in Annotald. The current workaround is to save the file in Annotald, open it a text editor, do the change there, and use refresh to load the updated version into Annotald. This will be fixed soon.
* Annotald does not give feedback when the save operation is complete. Save seems to always work though, but be careful and save and commit changes frequently.

Icelandic Parsed Historical Corpus (IcePaHC)

2011-04-27T16:43:23Z

Anton: /* Grants */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.4 which is a preview release of about 440.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project within which the Icelandic corpus is constructed is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-04-27T16:42:47Z

Anton:

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme for the Icelandic corpus is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.4 which is a preview release of about 440.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Icelandic Parsed Historical Corpus (IcePaHC)

2011-04-27T16:42:03Z

Anton: /* Download */

This is the wiki for the '''Icelandic Parsed Historical Corpus (IcePaHC)''' (The Icelandic Treebank). It is mostly used to document the annotation standard for those constructing and using the corpus. The annotation scheme is meant to be mostly compatible with [http://www.ling.upenn.edu/~beatrice/annotation/ the Penn historical corpora], and the guidelines here are written as a supplement to the Penn guidelines, so look at Beatrice Santorini's [http://www.ling.upenn.edu/~beatrice/annotation/ guidelines] for further information.

==Download==

'''You can download the Icelandic corpus from the [[download|download page]]'''. The corpus is released under a free and open source license (LGPL) and there is no registration wall. The current release is version 0.4 which is a preview release of about 440.000 words from every century between the 12th and the 19th centuries inclusive. We recommend use of released versions to ensure that results can be replicated but between releases you can watch the development at [http://github.com/antonkarl/icecorpus/ Github].

==Annotation guidelines==
*[[Phrase Types]]
*[[Head Types]]
*[[Conjunction]]
*[[Tagset]]
*[[Clause level constituents]]
*[[Treatment of individual words]]
*[[Empty categories]]
*[[Lemmatization]]
*[[Splitting and joining words]]
*[[Index]]

'''Search PPCME/PPCEME documentation''' (ling.upenn.edu/~beatrice/annotation)
<html>
<form method="get" action="http://www.google.com/search">
<a href="http://www.google.com/>
<img src="http://www.google.com/logos/Logo_40wht.gif" border="0" alt="Google"></a>
<input type="text" name="q" maxlength="255" />
<input type="submit" value="Google Search" />
<input style="visibility:hidden" type="radio" name="sitesearch" value="http://ling.upenn.edu/~beatrice/annotation/" checked="checked" />
</form>
</html>

==Citation==
For the version 0.4 release of April 12th 2011.

<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==General information==
*[[Icelandic Syntax Phenomena]]
*[[Syntactic definitions]]
*[[Málfræðiheiti|English-Icelandic Translations of Linguistic Terminology]]
*[[Texts]]
*[[Genres]]

'''Annotation:'''
*Annotation [[Issues]] ...
*[[Annotation Process]]
*[[Checklist]]
*[http://www.mediawiki.org/wiki/Help:Formatting MediaWiki Formatting Guide]
*[[Annotald]] a new annotation tool for parsed corpora, currently under developmemt.

'''Resources'''
*[[Icelandic Resources]] for doing Computational Linguistics and Natural Language Processing
*[[Treebank Resources]] (language independent)
*[[Penn Parsed Corpora of Historical English]]
*[[Parsed Corpora]] for other languages

'''Treebank team:'''
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

==Grants==

The project is funded in part by the following grants:

* From the '''Icelandic Research Fund (RANNÍS)''', grant nr. 090662011, '''[http://iceblark.wordpress.com/ Viable Language Technology beyond English – Icelandic as a test case]'''.
* From the '''U.S. National Science Foundation (NSF) International Research Fellowship Program (IRFP)''', grant '''#OISE-0853114, Evolution of Language Systems: a comparative study of grammatical change in Icelandic and English'''
* From the '''University of Iceland Research Fund (Rannsóknasjóður Háskóla Íslands)''', grant '''Icelandic Diachronic Treebank (Sögulegur íslenskur trjábanki)'''

Download

2011-04-20T01:01:20Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent GUI (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-20T01:00:59Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) Platform Independent (Java)''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-20T00:34:41Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) with Java GUI''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-20T00:33:14Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) with platform independent Java GUI''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-20T00:33:00Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)
* [https://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-java.zip '''Icelandic Parsed Historical Corpus (IcePaHC) with platform independent Java GUI''']. Version 0.4. LGPL. (manual setup, 5.7 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-19T23:11:56Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-0.4-mac.dmg '''Icelandic Parsed Historical Corpus (IcePaHC) for Mac OS''']. Version 0.4. LGPL. (user friendly visual setup, 9.4 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:59:09Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, which is required, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:56:55Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop. If you do not have Java installed, the installation will direct you to a Java download page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:55:33Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows (download above) and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:54:42Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page. If you use IcePaHC for Windows you do not have to type in commands to start the program, you simply click the IcePaHC icon on your Desktop.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:53:29Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows and follow the on-screen instructions. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:52:40Z

Anton: /* Getting started using the corpus */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
If you use Windows, the easiest way to get started is to download IcePaHC for Windows. IcePaHC for Windows uses CorpusSearch to run queries, so read [http://corpussearch.sourceforge.net/ CorpusSearch] documentation in addition to this web page.

Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:47:53Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly visual setup, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)

Download

2011-04-12T13:47:10Z

Anton: /* Download Version 0.4, (LGPL) */

==Introduction==
The Icelandic Parsed Historical Corpus (IcePaHC) is a project that aims to construct a diachronic corpus with samples of written Icelandic from all periods from the 12th century to modern times. The corpus is mostly compatible with the [http://www.ling.upenn.edu/~beatrice/annotation/ corpora of historical English] developed at UPenn. For historical texts spelling is modernized for phonological change.

==Download Version 0.4, ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL])==
To get access to the current version of the Icelandic Parsed Historical Corpus (IcePaHC) you can download the following zip-file, which contains the raw data of the corpus in labeled bracketing format. If you use Windows, we provide an easy-to-use setup file that installs the corpus and a graphical user interface which can be started from your desktop. Since this is an early preview version you can expect to find some uncorrected mistakes. Please let us know about those so they can be corrected before our next release.

'''Current release'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.4.zip '''Icelandic Parsed Historical Corpus (IcePaHC)''']. Version 0.4. LGPL. (zip, 5.2 MB, ca. 440.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/IcePaHC-0.4-Setup.exe '''Icelandic Parsed Historical Corpus (IcePaHC) for Windows''']. Version 0.4. LGPL. (user friendly setup file, 7.5 MB, ca. 440.000 words)

'''Previous releases'''
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.3.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.3. LGPL. (zip, 1.7 MB, ca. 262.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.2.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.2. LGPL. (zip, 813 KB, ca. 120.000 words)
* [http://github.com/downloads/antonkarl/icecorpus/icepahc-v0.1.zip Icelandic Parsed Historical Corpus (IcePaHC)]. Version 0.1. LGPL. (zip, 211 KB, ca. 31.000 words)

The corpus, as well as software developed as part of the IcePaHC project, is released under an ([http://en.wikipedia.org/wiki/GNU_Lesser_General_Public_License LGPL]) license, to ensure compatibility with other LGPL-licensed NLP tools, notably the [http://sourceforge.net/projects/icenlp/ IceNLP] toolkit, which is used extensively in the development of the corpus.

The corpus is free as in beer and as in speech and there is no registration wall. We recommend that people cite the latest released version when using the corpus for research to ensure that results can be replicated. However, the most up-to-date version and information on the current state of development can be accessed at our version control repository at [http://github.com/antonkarl/icecorpus Github].

==Getting started using the corpus==
Since the corpus uses the labeled bracketing format it is compatible with programs that assume such annotation. We recommend using the [http://corpussearch.sourceforge.net/ CorpusSearch] program developed by Beth Randall at UPenn. If you have copied the corpus to the directory "/home/chomsky/icepahc" and saved the CorpusSearch jar file in "/home/chomsky/corpussearch", you can give a command like the following to search the corpus using a query in a text file named '''datsubj.q'''.

<pre>
java -classpath /home/chomsky/corpussearch/CS_2.002.75.jar csearch/CorpusSearch datsubj.q /home/chomsky/icepahc/*.psd
</pre>

Let us assume that '''datsubj.q''' is a query that picks out all dative subjects. The file could look like the following:

<pre>
node: IP*

query: (IP* idoms NP-SBJ) AND (NP-SBJ idoms *-D)
</pre>

If you run the command above using a file like that, CorpusSearch will return a file called '''datsubj.out''' with all sentences in the corpus that contain dative subjects. Read the [http://corpussearch.sourceforge.net/ CorpusSearch documentation] and the [http://linguist.is/wiki/Main_Page annotation guidelines] for the corpus to find out how to do more.

Note that there will be ways to simplify the commands by creating aliases etc. but this will work differently on different operating systems. Read the [http://corpussearch.sourceforge.net/CS-manual/GettingStarted.html getting started with CorpusSearch documentation] for more information.

==Texts included in Version 0.4==
* 4439 words from The First Grammatical Treatise (entire text) (12th century)
* 40844 words from Íslensk hómilíubok (Icelandic book of homilies) (12th century)
* 25017 words from Morkinskinna (1275)
* 3459 words from Egils saga (theta fragment) (13th century)
* 22720 words from Sturlunga saga (13th century)
* 23040 words from Finnboga saga ramma (1350)
* 13541 words from Bandamanna saga - Möðruvallabók manuscript (1350)
* 11486 words from Bandamanna saga - Konungsbók manuscript (1450)
* 23041 words from Vilhjálms saga Sjóðs (1450)
* 18042 words from Miðaldaævintýri (1500)
* 8582 words from Erasmus saga (1525)
* 13151 words from Georgius saga (1525)
* 20683 words from the New Testament's Gospel of John (1540)
* 16421 words from the New Testament's Acts (1540)
* 15445 words from Okur, treatise on usury, (1611)
* 17127 words from Ólafur Egilsson's travelogue (1628)
* 9760 words from Píslarsaga Jóns Magnússonar (1659)
* 22905 words from Jón Indíafari's travelogue (1661)
* 11220 words from Söguþáttur af Ármanni og Þorsteini gála (1675)
* 3204 words from Um ætt Magnúsar Jónssonar (1675)
* 3857 words from Móðars þáttur (1675)
* 23013 words from Vídalínspostilla (1720)
* 18784 words from Fimmbræðra saga (1790)
* 22099 words from Jón Steingrímsson's biography (1791)
* 3269 words from Jónas Hallgrímsson's essay on the nature and origin of the earth (1835)
* 17837 words from Piltur og stúlka (novel by Jón Thoroddsen) (1850)
* 27192 words from Brynjólfur Sveinsson biskup (novel by Torfhildur Hólm) (1882)

Total number of words: 440166

==Directories included in Version 0.4==

* /psd: for the parsed versions of the texts (.psd), in plain text utf-8.

* /txt: for versions of the texts with no markup at all (.txt), in plain text utf-8.

Note that each token in a given .psd file corresponds to a single line in the .txt file, so for example, the token with ID number ""361"" will appear on line 361 in the corresponding .txt file.

* /info: for philological and other information about each text (.info), in plain text utf-8.

* /tagged: for versions of the texts with only part-of-speech tags and lemmas, in plain text utf-8, with each word on its own line and tab-separated markup.

==Citation for the Version 0.4 release (of April 12th 2011)==
<pre>
Wallenberg, Joel, Anton Karl Ingason, Einar Freyr Sigurðsson and Eiríkur Rögnvaldsson. 2011.
Icelandic Parsed Historical Corpus (IcePaHC).
Version 0.4. http://www.linguist.is/icelandic_treebank
</pre>

==Treebank team==
*[http://www.ling.upenn.edu/~joelcw/ Joel Wallenberg] (PI) (joel.wallenberg@gmail.com)
*[http://www.hi.is/~eirikur/ Eiríkur Rögnvaldsson] (PI) (eirikur@hi.is)
*[http://linguist.is/ Anton Karl Ingason] (anton.karl.ingason@gmail.com)
*[http://einarfreyr.wordpress.com/ Einar Freyr Sigurðsson] (einarfs@gmail.com)
*Brynhildur Stefánsdóttir (BA research assistant)
*Hulda Óladóttir (BA research assistant)