History of quantitative linguistics - Revision history

Haspelmath at 12:44, 5 October 2007

2007-10-05T12:44:30Z

Dvdsn: /* Development */

2007-10-05T12:31:44Z

Development

WikiLingua at 10:22, 16 August 2007

2007-08-16T10:22:14Z

WikiLingua at 19:32, 2 August 2007

2007-08-02T19:32:30Z

Rk: History of QL moved to History of quantitative linguistics: no caps

2007-07-13T12:21:30Z

History of QL moved to History of quantitative linguistics: no caps

Sven Siegmund: /* References */ buttons in references

2007-07-09T14:39:56Z

References: buttons in references

Rk at 18:47, 8 July 2007

2007-07-08T18:47:09Z

Rk: /* The Beginning */

2007-07-08T11:20:44Z

The Beginning

Sven Siegmund: en cat

2007-07-06T23:01:03Z

en cat

Rk at 22:55, 6 July 2007

2007-07-06T22:55:44Z

← Older revision		Revision as of 12:44, 5 October 2007
Line 29:		Line 29:

	[[Category:En]]		[[Category:En]]
		+	[[Category:SURV]]
	[[Category:Quantitative Linguistics]]		[[Category:Quantitative Linguistics]]

@@ Line 12: / Line 12: @@
 The unveiled interrelations between frequency of words and the ranks of the frequency class (alternatively: between frequency and the number of words in the given frequency class) were systematically investigated by the above-mentioned founder of QL, George Kingley Zipf. He was the first to set up a theoretical model in order to explain the observations and to find a mathematical formula for the corresponding function – the famous “Zipf’s Law”. Zipf and others observed the same kind of dependence between rank and frequency (or size) on data from a number of scientific and every-day phenomena. Among his publications, his books “The Psycho-Biology of Language. An Introduction to Dynamic Philology” (1935) and “Human Behavior and the Principle of Least Effort” (1949) are considered the most important ones. Zipf formulated (in different terms) innovative thoughts on self-organisation, the principle of language economy and fundamental properties of linguistic laws long before modern systems theory arose, even without any preparatory work of others. His ideas, such as the “principle of least effort” and the “forces of unification and diversification” are important still today (even if they suffer from certain defects and mistakes) and they belong to the few things contemporary linguists know about QL. Later, Zipf’s model was conceptually and mathematically improved and enhanced by Benoît Mandelbrot (1953, 1959, 1961a, 1961b), the world-wide celebrated originator of fractal geometry. Zipf’s body of thought fecundated various scientific disciplines and enjoys increasing publicity again.
-Shannon and Weaver (1949) applied information theory to linguistics and raised a storm of calculations on diverse language phenomena. Many linguists responded well to this novel approach, among them in particular Gustav Herdan (e.g., 1954, 1956, 1960, 1962, 1964 1966, 1969), Rajmund.G. Piotrowski (also spelled Piotrovskij) (1959, 1968, 1979) und Walter Meyer-Eppler (1959). The corresponding experiments and calculations, however, turned out to be of little help for a deeper insight, as the technical concept of information does not take into account linguistic semantics. Basically, not much more could be achieved than the measurement of entropy and redundancy, and thus the storm waned.
+Shannon and Weaver (1949) applied information theory to linguistics and raised a storm of calculations on diverse language phenomena. Many linguists responded well to this novel approach, among them in particular Gustav Herdan (e.g., 1954, 1956, 1960, 1962, 1964 1966, 1969), Rajmund.G. Piotrowski (also spelled Piotrovskij) (1959, 1968, 1979) and Walter Meyer-Eppler (1959). The corresponding experiments and calculations, however, turned out to be of little help for a deeper insight, as the technical concept of information does not take into account linguistic semantics. Basically, not much more could be achieved than the measurement of entropy and redundancy, and thus the storm waned.
 Physicist Wilhelm Fucks (1955) was responsible for a turn towards theoretical considerations in German QL. He set up, among others, a mathematical model of word length distributions and performed various investigations into language, literature, and music. In France, Charles Muller (1973, 1979) created a novel approach to study the vocabulary of a text, which is still popular today. In Russia, Zipfian linguistics was conducted particularly by Michail V. Arapov (1988; Arapov / Cherc 1983) in Moscow, who based his models of the dynamics of texts and of language development on the analysis of rank order. In Georgia, a group around Jurij K. Orlov (cf. 1982a, 1982b) established a tradition of studies into the statistical structure of texts based on the Zipf-Mandelbrot Law. The Estonian researcher Juhan Tuldava (1995, 1998) is famous for his mathematical methods of analysis of numerous text phenomena.

@@ Line 22: / Line 22: @@
 ==References==
-'''Aichele, Dieter''' (2005): Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 16-22.
+*Aichele, Dieter. 2005. Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann & Rajmund G. Piotrowski (eds.). ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, 16-22.
-'''Grzybek, Peter, Kelih, Emmerich''' (2005): Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 23-64.
+*Grzybek, Peter & Kelih, Emmerich. 2005. Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann & Rajmund G. Piotrowski (eds.). ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, 23-64.
-'''Köhler, Reinhard''': Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.
+*Köhler, Reinhard. Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann & Rajmund G. Piotrowski (eds.). ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, 1-15.
 [[Category:En]]
 [[Category:Quantitative Linguistics]]

@@ Line 22: / Line 22: @@
 ==References==
-*Aichele, Dieter (2005): Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 16-22.
+'''Aichele, Dieter''' (2005): Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 16-22.
-*Grzybek, Peter, Kelih, Emmerich (2005): Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 23-64.
+'''Grzybek, Peter, Kelih, Emmerich''' (2005): Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 23-64.
-*Köhler, Reinhard: Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.
+'''Köhler, Reinhard''': Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: ''Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook.'' (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.
 [[Category:En]]
 [[Category:Quantitative Linguistics]]

@@ Line 22: / Line 22: @@
 ==References==
-Aichele, Dieter (2005): Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 16-22.
+*Aichele, Dieter (2005): Quantitative Linguistik in Deutschland und Österreich. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 16-22.
-Grzybek, Peter, Kelih, Emmerich (2005): Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 23-64.
+*Grzybek, Peter, Kelih, Emmerich (2005): Zur Vorgeschichte quantitativer Ansätze in der russischen Sprach- und Literaturwissenschaft. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 23-64.
-Köhler, Reinhard: Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.
+*Köhler, Reinhard: Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.
 [[Category:En]]
 [[Category:Quantitative Linguistics]]

← Older revision	Revision as of 12:21, 13 July 2007
(No difference)

@@ Line 7: / Line 7: @@
 ==Development==
-Later, quantitative studies of linguistic material were, in the first place, a consequence of practical demands: efforts to improve second language training and optimisation of stenographic systems are examples. Early quantitative observations and corresponding mathematical models in the field of vocabulary are originated from works by J.B. Estoup (1916), G.U. Yule (1924) und E.U. Condon (1928). The unveiled interrelations between frequency of words and the ranks of the frequency class (alternatively: between frequency and the number of words in the given frequency class) were systematically investigated by the above-mentioned founder of QL, George Kingley Zipf. He was the first to set up a theoretical model in order to explain the observations and to find a mathematical formula for the corresponding function – the famous “Zipf’s Law”. Zipf and others observed the same kind of dependence between rank and frequency (or size) on data from a number of scientific and every-day phenomena. Among his publications, his books “The Psycho-Biology of Language. An Introduction to Dynamic Philology” (1935) and “Human Behavior and the Principle of Least Effort” (1949) are considered the most important ones. Zipf formulated (in different terms) innovative thoughts on self-organisation, the principle of language economy and fundamental properties of linguistic laws long before modern systems theory arose, even without any preparatory work of others. His ideas, such as the “principle of least effort” and the “forces of unification and diversification” are important still today (even if they suffer from certain defects and mistakes) and they belong to the few things contemporary linguists know about QL. Later, Zipf’s model was conceptually and mathematically improved and enhanced by Benoît Mandelbrot (1953, 1959, 1961a, 1961b), the world-wide celebrated originator of fractal geometry. Zipf’s body of thought fecundated various scientific disciplines and enjoys increasing publicity again.
+Later, quantitative studies of linguistic material were, in the first place, a consequence of practical demands: efforts to improve second language training and optimisation of stenographic systems are examples. Early quantitative observations and corresponding mathematical models in the field of vocabulary are originated from works by J.B. Estoup (1916), G.U. Yule (1924) und E.U. Condon (1928).
 Shannon and Weaver (1949) applied information theory to linguistics and raised a storm of calculations on diverse language phenomena. Many linguists responded well to this novel approach, among them in particular Gustav Herdan (e.g., 1954, 1956, 1960, 1962, 1964 1966, 1969), Rajmund.G. Piotrowski (also spelled Piotrovskij) (1959, 1968, 1979) und Walter Meyer-Eppler (1959). The corresponding experiments and calculations, however, turned out to be of little help for a deeper insight, as the technical concept of information does not take into account linguistic semantics. Basically, not much more could be achieved than the measurement of entropy and redundancy, and thus the storm waned.

@@ Line 1: / Line 1: @@
 ==The Beginning==
-[[Image:Markov.gif|100px|Andrej Andreevič Markov (Андрей Андреевич Марков); * 14. Juni 1856 in Rjasan; † 20. Juli 1922 in Petrograd]]
+[[Image:Markov.gif|right|100px|Andrej Andreevič Markov (Андрей Андреевич Марков); * 14. Juni 1856 in Rjasan; † 20. Juli 1922 in Petrograd]]
 The first scientific counts of units of language or text were published already in the 19th century. In Germany, Förstemann (1846, 1852) and Drobisch (1866), in Russia, Bunjakovskij (1847), in France Bourdon (1892), in Italy, Mariotti (1880) and in the USA, probably Sherman (1888) performed frequency studies as a means of linguistic description. First theoretical insight after many years of merely descriptive counts of various kinds, is due to the Russian mathematician A. A. Markov who created the base of the theory of Markov chains in 1913. This mathematical model of the sequential (syntagmatic) dependence among units in linear concatenation in the form of transition probabilities was – despite its mathematical significance – of only little use for linguistics. Some of the linguistics areas, such as syntax, were considered principally inappropriate for the application of this model type as they require recursive models in order to represent the self-embedding structures in syntax. Hence, applications of Markov chains were restricted to some efforts with respect to textual units and to phonology. (In modern computational linguistics and in natural language processing, however, Markov chains are a central component of the corresponding methods of language technology (“Hidden Markov Models”; cf. e.g., Brants 1999)).

← Older revision		Revision as of 23:01, 6 July 2007
Line 25:		Line 25:
	Köhler, Reinhard: Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.		Köhler, Reinhard: Gegenstand und Arbeitsweise der quantitativen Linguistik. In: Reinhard Köhler, Gabriel Altmann and Rajmund G. Piotrowski [eds.]: Quantitative Linguistik. Ein internationales Handbuch. Quantitative Linguistics. An international Handbook. (=HSK27) Berlin, New York: de Gruyter, pp. 1-15.

		+	[[Category:En]]
	[[Category:Quantitative Linguistics]]		[[Category:Quantitative Linguistics]]