GATE track 1 session: Difference between revisions

Jump to navigation Jump to search

GATE track 1 session (view source)

Revision as of 14:37, 3 September 2010

6 bytes added ,  3 September 2010
→‎Lucene data store
No edit summary
Line 1: Line 1:
A full week of learning [http://en.wikipedia.org/wiki/General_Architecture_for_Text_Engineering GATE] text mining/information extraction language processing and talks. [http://gate.ac.uk/wiki/TrainingCourseAug2010/ Session wiki]
{{Wiki_List |
 
wiki_name  =                CoralQueen                                              |
[[File:GATE_screenshot.png|900px|GATE developer screenshot]]
wiki_logo =                  [[Image:NoLogo.png]]                                   |
 
wiki_URL =                  http://coralqueen.multihullboatbuilder.com/                                                       |
GATE is written in Java and very Java centric. This makes it portable, fast, and heavyweight. A programming library is available.  It's 14 years old and has many users and contributors.
wiki_recentchanges =       http://coralqueen.multihullboatbuilder.com/RecentChanges                                          |
 
wiki_status =               Inactive                  |
= Using GATE developer =
wiki_lastreviewed =        08-Feb-06                  |
 
wiki_language =            Inactive                  |
* GATE developer is used to process sets of Language Resources in Corpus using Processing Resources. They are typically saved to a serialized Datastore.
wiki_editmode =             Inactive            |
* ANNIE, VG (verb group) processors.
wiki_engine =               Inactive                        |
* Preserve formatting embeds tags in HTML or XML.
wiki_maintopic =           Inactive
** Different strengths using GATE's graph (node/offset) based XML vs. preserved formatting (original xml/html)
}}
 
==Description==
= Information Extraction =
Not Found - ParkingLot there currently
 
* IR - retrieve docs
* IE - retreive structured data
 
* Knowledge Engineering - rule based
* Learning Systems - statistical
 
Old Bailey IE project - old english (Online)
 
* POS - assigned in Token (noun, verb, etc)
 
* Gazateer - gotcha, have to set initialization parameter listsURL before it's
loaded. Must also "save and reinitialize."
* Gazeteer creates Lookups, then transducer creaties named entities
* Then orthomatcher (spelling features in common) coreference associates those
 
* Annotation Key sets and annotation comparing
** Need setToKeep key in Document Reset for any pre annotated texts
 
== Evaluation / Metrics ==
 
* Evaluation metric - mathematically against human annotated
* Scoring - performance measures for annotation types
 
* Result types - Correct, missing, spurious, partially correct (overlapped)
 
* Tools > Annotations Diff - comparing human vs machine annotation
 
* Corpus > Corpus quality assurance - compare by type
* (B has to be the generated set)
 
* Annotation set transfer (in tools) - transfer between docs in pipeline
** useful for eg HTML that has boilerplate
 
= Other notes =
 
== Lucene data store ==
 
* Use <null> for default set
* Go to Datastore for queries
** eg {Person}({Token})+{Money}
 
[[File:GATE-lucene-person-money.png]]
 
== To investigate ==
 
* markupAware for HTML/XML (keeps tags in editor)
* AnnotationStack
* Advanced Options
 
= JAPE =
 
* Rules based on tokens and lookups
 
== To review, gotchas ==
 
* Rule types : first takes only first match, excludes compound
** a? b for "a b" will match "a b"
* multiplexor tranducers
* multi-constraint statements
* macros
* To reuse created annotations has to be a separate rule
 
= To follow up =
 
* WebSphinx crawler CREOLE plugin
 
= Conclusions =
 
While it can do a lot out of the box and benefits from development time and breadth of connectivity, it needs usability testing, a lot of things are inobvious and too domain specific. It could really use some "sexying up," interaction could including a lot more useful and interesting looking displays. A web based version could have these features.
 
{{Blikied|Aug 30, 2010}}
 
[[Category:SemWeb]]
Retrieved from "https://wiki.zooid.org/w/Special:MobileDiff/3554"

Navigation menu