Localization - Revision history

imported>Martins at 19:06, 14 August 2013

2013-08-14T19:06:57Z

← Older revision		Revision as of 19:06, 14 August 2013
Line 51:		Line 51:
	**:means:		**:means:
	**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].		**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].
	*Localize only the rules that are strictly related to English, i.e., the English specific grammar. Do not localize the ~~normalization~~ grammar and the default grammar. They are expected to be valid for all languages.		*Localize only the rules that are strictly related to English, i.e., the English specific grammar. Do not localize the standardization grammar and the default grammar. They are expected to be valid for all languages.

imported>Martins at 14:14, 17 November 2012

2012-11-17T14:14:24Z

@@ Line 51: / Line 51: @@
 **:means:
 **::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].
-*Localize only words between "quotes" and [single brackets]. Remember that words between <nowiki>[[double brackets]]</nowiki> are UW's, and they should not be localized. The features, which are normally expressed in upper-case letters, are also expected to be language-independent. For instance, in the rule:
+*Localize only the rules that are strictly related to English, i.e., the English specific grammar. Do not localize the normalization grammar and the default grammar. They are expected to be valid for all languages.

imported>Martins at 11:51, 5 September 2012

2012-09-05T11:51:43Z

← Older revision		Revision as of 11:51, 5 September 2012
Line 1:		Line 1:
	Localization is the process of adapting dictionaries and grammars to a specific language, which is referred to as "locale". In the UNL framework, localization of existing resources is one of the strategies that can be adopted in order to create basic dictionaries and grammars required to process simple corpora~~, such as [[Corpus500]]~~. In what follows, we give some instructions concerning the localization of the [[English dictionary]] and the [[English grammar]].		Localization is the process of adapting dictionaries and grammars to a specific language, which is referred to as "locale". In the UNL framework, localization of existing resources is one of the strategies that can be adopted in order to create basic dictionaries and grammars required to process simple corpora. In what follows, we give some instructions concerning the localization of the [[English dictionary]] and the [[English grammar]].

	== Localization of the English Dictionary ==		== Localization of the English Dictionary ==

imported>Martins at 22:37, 3 August 2012

2012-08-03T22:37:55Z

← Older revision		Revision as of 22:37, 3 August 2012
Line 51:		Line 51:
	**:means:		**:means:
	**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].		**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].
	*Localize only words between "quotes" and [single brackets]. Remember that words between [[double brackets]] are UW's, and they should not be localized. The features, which are normally expressed in upper-case letters, are also expected to be language-independent. For instance, in the rule:		*Localize only words between "quotes" and [single brackets]. Remember that words between <nowiki>[[double brackets]]</nowiki> are UW's, and they should not be localized. The features, which are normally expressed in upper-case letters, are also expected to be language-independent. For instance, in the rule:
	*:(DIGIT,%x)(BLK)({"s"\|"sec"\|"secs"\|"second"\|"seconds"}):=(%x,+SECOND);		*:(DIGIT,%x)(BLK)({"s"\|"sec"\|"secs"\|"second"\|"seconds"}):=(%x,+SECOND);
	*:the localizable part is {"s"\|"sec"\|"secs"\|"second"\|"seconds"}. The words DIGIT, BLK and SECOND are language-independent features and must not be localized (or the other rules that depend on these features will not work).		*:the localizable part is {"s"\|"sec"\|"secs"\|"second"\|"seconds"}. The words DIGIT, BLK and SECOND are language-independent features and must not be localized (or the other rules that depend on these features will not work).

imported>Martins at 22:37, 3 August 2012

2012-08-03T22:37:39Z

← Older revision		Revision as of 22:37, 3 August 2012
Line 48:		Line 48:
	**isolated strings are features (MCL is masculine)		**isolated strings are features (MCL is masculine)
	**:For instance, the rule:		**:For instance, the rule:
	**::("a",[b],[[c]],D=E,F,%g):=(%g)("g");		**::<nowiki>("a",[b],[[c]],D=E,F,%g):=(%g)("g")</nowiki>;
	**:means:		**:means:
	**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].		**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].

imported>Martins at 22:29, 2 August 2012

2012-08-02T22:29:47Z

← Older revision		Revision as of 22:29, 2 August 2012
Line 43:		Line 43:
	**"quotes" mean natural language strings		**"quotes" mean natural language strings
	**[single brackets] mean natural language words		**[single brackets] mean natural language words
	**[[double brackets]] mean UW's		**<nowiki>[[double brackets]]</nowiki> mean UW's
	**% means indexes		**% means indexes
	**X=Y means the attribute X has the value Y (GEN=MCL means gender is masculine)		**X=Y means the attribute X has the value Y (GEN=MCL means gender is masculine)

imported>Martins at 22:29, 2 August 2012

2012-08-02T22:29:35Z

← Older revision		Revision as of 22:29, 2 August 2012
Line 35:		Line 35:
	*::[this]{}"" (LEX=D,POS=DEM,NUM=SNG,att=@proximal)<eng,255,0>;		*::[this]{}"" (LEX=D,POS=DEM,NUM=SNG,att=@proximal)<eng,255,0>;
	*::[this]{}"00.@proximal" (LEX=R,POS=DEP,NUM=SNG)<eng,255,0>;		*::[this]{}"00.@proximal" (LEX=R,POS=DEP,NUM=SNG)<eng,255,0>;

			== Localization of the English Grammar ==
			Instead of creating a whole grammar from the scratch, you should consider localizing the English grammar, which is a far much simpler strategy to start your first grammar. In order to do that, the following is very important:
			*You should localize the English dictionary, as described above, instead of creating a brand new dictionary, with a different entry structure.
			*Revise the grammar formalism at the [[UNL Grammar Specs]]. Don't forget that:
			**(parentheses) mean a node
			**"quotes" mean natural language strings
			**[single brackets] mean natural language words
			**[[double brackets]] mean UW's
			**% means indexes
			**X=Y means the attribute X has the value Y (GEN=MCL means gender is masculine)
			**isolated strings are features (MCL is masculine)
			**:For instance, the rule:
			**::("a",[b],[[c]],D=E,F,%g):=(%g)("g");
			**:means:
			**::IF there is node whose string is "a", whose natural language word is "b", whose UW is "c", and which has the feature D with the value E, and the feature F, ADD a new node, whose string is "g", to the right of it. Note that %g is used only to index the left side and the right side of the rules (i.e, to indicate that the new node will be inserted to the right of the node referred to in the left side). For further information of the rule structure, read carefully the [[UNL Grammar Specs]].
			*Localize only words between "quotes" and [single brackets]. Remember that words between [[double brackets]] are UW's, and they should not be localized. The features, which are normally expressed in upper-case letters, are also expected to be language-independent. For instance, in the rule:
			*:(DIGIT,%x)(BLK)({"s"\|"sec"\|"secs"\|"second"\|"seconds"}):=(%x,+SECOND);
			*:the localizable part is {"s"\|"sec"\|"secs"\|"second"\|"seconds"}. The words DIGIT, BLK and SECOND are language-independent features and must not be localized (or the other rules that depend on these features will not work).
			*Localize only the rules that are strictly related to English, i.e., the rules that involve English words. In the ENG-UNL (Analysis) Transformation Grammar, these rules are concentrated in the beginning of the grammar (sections 1 and 2). Normally, the sections 3, 5 and 6 are not localized. In most cases, you can leave them as they are. The section 4 is localized only with respect to the order of the nodes, but you have to understand the principle of [[X-bar]] in order to localize it.
			* Note that, depending on your language, many rules may be preserved. There are actually three types of rules:
			**Rules that are valid only for English, and must be deleted from your grammar, as:
			**:([to])(BLK)(V,%x):=(-ATE,+ATE=INF,%x);
			**::assigns the value INF (infinitive) to a verb following the word "to"
			**Rules that are valid for other languages, but must be localized:
			**:(DIGIT,%x)("million"):=(%x,+MILLION);
			**::deletes the word "million" after the digit and assigns the feature MILLION to the digit. The word "million" is specific to English, but this rule will also work in several other languages if we do the corresponding changes, such as:
			**::(DIGIT,%x)({"million"\|"millions"}):=(%x,+MILLION); (in French, we had to add the plural "millions", because the word is inflectional, differently from English
			**::(DIGIT,%x)({"milhão"\|"milhões"}):=(%x,+MILLION); (in Portuguese, we had to replace "million" by "milhão", and add the plural, but the rule is the same as in English
			**Rules that don't need to be localized:
			**::(SNGT,^SNG):=(-NUM,-SGNT,+NUM=SNG,+NUM=SNGT); SNGT is also SNG
			**:::A word that is used only in singular, i.e., which is defined as SGNT (singulare tantum), is also singular (SNG)

imported>Martins at 21:30, 2 August 2012

2012-08-02T21:30:47Z

← Older revision		Revision as of 21:30, 2 August 2012
Line 32:		Line 32:
	*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;		*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;
	*The classification of natural language entries must be UNL-based		*The classification of natural language entries must be UNL-based
	*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a demonstrative determiner and as a demonstrative pronoun.		*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a demonstrative determiner and as a demonstrative pronoun:
			*::[this]{}"" (LEX=D,POS=DEM,NUM=SNG,att=@proximal)<eng,255,0>;
			*::[this]{}"00.@proximal" (LEX=R,POS=DEP,NUM=SNG)<eng,255,0>;

imported>Martins at 15:14, 29 July 2012

2012-07-29T15:14:23Z

← Older revision		Revision as of 15:14, 29 July 2012
Line 31:		Line 31:
	*:::[la]{}"" (LEX=D,POS=ART,NUM=SNG,GEN=FEM,att=@def)<eng,255,0>;		*:::[la]{}"" (LEX=D,POS=ART,NUM=SNG,GEN=FEM,att=@def)<eng,255,0>;
	*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;		*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;
	*The classification of natural language entries must be UNL-~~driven~~		*The classification of natural language entries must be UNL-based
	*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a demonstrative determiner and as a demonstrative pronoun.		*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a demonstrative determiner and as a demonstrative pronoun.

imported>Martins at 15:11, 29 July 2012

2012-07-29T15:11:31Z

← Older revision		Revision as of 15:11, 29 July 2012
Line 32:		Line 32:
	*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;		*:::[les]{}"" (LEX=D,POS=ART,NUM=PLR,att=@def)<eng,255,0>;
	*The classification of natural language entries must be UNL-driven		*The classification of natural language entries must be UNL-driven
	*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a ~~possessive~~ determiner and as a ~~possessive~~ pronoun.		*:Don't forget that you are creating either a NL-UNL or a UNL-NL dictionary, i.e., a bilingual dictionary between your locale and UNL. You have to map the lexical items of your language into UNL, and the UWs into your language. In order to do that, you have to have in mind how the word will be represented in UNL. In several cases, you will not be able to simply adopt the descriptive conventions created for your language. Some English grammars, for instance, treat the word "this" as a "demonstrative pronoun" only, without making any difference between the adjective ("this book") and the noun ("this is the book") uses of the word. In UNL, these two "this" will be represented differently: the first one - "this" as a determiner - will be represented by an attribute (@proximal); the second one - "this" as a pronoun - will be represented by the pro-form "00". Therefore, <u>independently on how this phenomenon is described by English traditional grammars</u>, these two "this" must be differentiated: as a demonstrative determiner and as a demonstrative pronoun.