https://unlarchive.org/wiki/index.php?action=history&feed=atom&title=SegmentationSegmentation - Revision history2026-05-10T15:11:35ZRevision history for this page on the wikiMediaWiki 1.44.2https://unlarchive.org/wiki/index.php?title=Segmentation&diff=14465&oldid=previmported>Martins at 23:43, 27 July 20122012-07-27T23:43:00Z<p></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 23:43, 27 July 2012</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l8">Line 8:</td>
<td colspan="2" class="diff-lineno">Line 8:</td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== EUGENE ==</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== EUGENE ==</div></td></tr>
<tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>In [[EUGENE]], segmentation is done using the [[UNL <del style="font-weight: bold; text-decoration: none;">Document</del>]] tags.</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>In [[EUGENE]], segmentation is done using the [[UNL <ins style="font-weight: bold; text-decoration: none;">document</ins>]] tags.</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag [S] defines the beginning of a sentence, and the tag [/S] defines the end of a sentence</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag [S] defines the beginning of a sentence, and the tag [/S] defines the end of a sentence</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag {org} defines the beginning of the source sentence, and the tag {/org} defines the end of the source sentence</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag {org} defines the beginning of the source sentence, and the tag {/org} defines the end of the source sentence</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag {unl} defines the beginning of the UNL graph, and the tag {/unl} defines the end of the UNL graph</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>*The tag {unl} defines the beginning of the UNL graph, and the tag {/unl} defines the end of the UNL graph</div></td></tr>
</table>imported>Martinshttps://unlarchive.org/wiki/index.php?title=Segmentation&diff=14464&oldid=previmported>Martins at 23:41, 27 July 20122012-07-27T23:41:46Z<p></p>
<p><b>New page</b></p><div>Segmentation is the processing of splitting the input into processing units. In [[UNLization]] with [[IAN]], the natural language input document is split into sentences; in [[UNLization]] with [[SEAN]], the natural language input is split into texts; in [[NLization]] with [[EUGENE]], the UNL input is split into graphs.<br />
<br />
== IAN ==<br />
In [[IAN]], segmentation is done using a set of predefined* sentence boundaries:<br />
*punctuation signs: ".",";","!","?","..."<br />
*special characters: end-of-line, end-of-paragraph<br />
<nowiki>*</nowiki> This process is expected to be replaced by a user-defined system in the coming releases of IAN.<br />
<br />
== EUGENE ==<br />
In [[EUGENE]], segmentation is done using the [[UNL Document]] tags.<br />
*The tag [S] defines the beginning of a sentence, and the tag [/S] defines the end of a sentence<br />
*The tag {org} defines the beginning of the source sentence, and the tag {/org} defines the end of the source sentence<br />
*The tag {unl} defines the beginning of the UNL graph, and the tag {/unl} defines the end of the UNL graph</div>imported>Martins