GATE track 1 session: Difference between revisions

From zooid Wiki
Jump to navigation Jump to search
Line 1: Line 1:
A full week of learning [http://en.wikipedia.org/wiki/General_Architecture_for_Text_Engineering GATE] text mining/information extraction language processing and talks. [http://gate.ac.uk/wiki/TrainingCourseAug2010/ Session wiki]
'''Type''': Resolution


[[File:GATE_screenshot.png|900px|GATE developer screenshot]]
'''Status''': Adopted on 2/6/07


GATE is written in Java and very Java centric. This makes it portable, fast, and heavyweight. A programming library is available. It's 14 years old and has many users and contributors.
'''Source File''': http://www.co.suffolk.ny.us/legis/Resos2006/i2267-06.htm


= Using GATE developer =
'''Text''':


* GATE developer is used to process sets of Language Resources in Corpus using Processing Resources. They are typically saved to a serialized Datastore.
'''RESOLUTION NO. 41-2007, CREATING THE SUFFOLK COUNTY CARBON CAP IMPLEMENTATION ADVISORY COMMITTEE'''  
* ANNIE, VG (verb group) processors.
* Preserve formatting embeds tags in HTML or XML.
** Different strengths using GATE's graph (node/offset) based XML vs. preserved formatting (original xml/html)


= Information Extraction =
'''WHEREAS''', global warming is a matter of increasing concern for the public health, environment and economy of Suffolk County; and


* IR - retrieve docs
'''WHEREAS''', global warming is caused by the emission of greenhouse gases, which include carbon dioxide, methane, nitrous oxide, hydrofluorocarbons, perfluorocarbons, and sulfer hexafluoride; and
* IE - retreive structured data


* Knowledge Engineering - rule based
'''WHEREAS''', the health of Suffolk residents is threatened by global warming and scientists have concluded that reducing the emission of greenhouse gases will reduce air pollution, a known contributor to respiratory ailments; and
* Learning Systems - statistical


Old Bailey IE project  - old english (Online)
'''WHEREAS''', fossil fuel burning electric generating units are the largest individual source of carbon dioxide and these units account for approximately one-quarter of the annual emission of carbon dioxide; and


* POS - assigned in Token (noun, verb, etc)
'''WHEREAS''', the reduction of greenhouse gas emissions from electric generating plants in Suffolk County should be of primary concern to those who are charged with protecting the health and safety of Suffolk residents; now, therefore be it


* Gazateer - gotcha, have to set initialization parameter listsURL before it's loaded. Must also "save and reinitialize."
1st  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee is hereby created to study the level of greenhouse gas emissions from electric generating plants in Suffolk County and to develop strategies to achieve a 25% reduction in greenhouse gas emissions from such electric generating plants by 2020; and be it further
* Gazeteer creates Lookups, then transducer creaties named entities
* Then orthomatcher (spelling features in common) coreference associates those


* Annotation Key sets and annotation comparing
2nd  '''RESOLVED''', that this Suffolk County Carbon Cap Implementation Advisory Committee shall consist of the following fifteen (15) members:
** Need setToKeep key in Document Reset for any pre annotated texts


== Evaluation / Metrics ==
1.) the Chairman of the Suffolk County Legislature’s Economic Development, Higher Education and Energy Committee;


* Evaluation metric - mathematically against human annotated
2.) the Commissioner of Environment and Energy, or his or her designee, who will serve as Co-Chair;
* Scoring - performance measures for annotation types


* Precision = correct / correct + spurious
3.) the Presiding Officer, or his or her designee;
* Recall = correct / correct + missing
* F-measure is precision and recall (harmonic mean)
* F=2⋅(precision⋅recall / precision+recall)
* GATE supports average, strict, lenient


* Result types - Correct, missing, spurious, partially correct (overlapped)
4.) the Minority Leader, or his or her designee;


* Tools > Annotations Diff - comparing human vs machine annotation
5.) a representative from the Office of Legislative Budget Review;


* Corpus > Corpus quality assurance - compare by type
6.) the Dean of SUNY Stony Brook School of Engineering, or his or her designee;
* (B has to be the generated set)


* Annotation set transfer (in tools) - transfer between docs in pipeline
7.) the President of SUNY Farmingdale, or his or her designee;
** useful for eg HTML that has boilerplate


8.) the Director of the Brookhaven National Laboratory, or his or her designee;


== To investigate ==
9.) the Executive Director of the Neighborhood Network, or his or her designee, who shall serve as Co-Chair;


* markupAware for HTML/XML (keeps tags in editor)
10.) the Executive Director of Renewable Energy Long Island, or his or her designee;
* AnnotationStack
* Advanced Options


= JAPE =
11.) the Executive Director of Citizens Campaign for the Environment, or his or her designee;


* Rules based on tokens and lookups
12.) a representative of the Long Island Association Energy Committee;


== To review, gotchas ==
13.) a representative from Sustainable Energy Long Island;


* Rule types : first takes only first match, excludes compound
14.) a representative from LIPA; and
** a? b for "a b" will match "a b"
* multiplexor tranducers
* multi-constraint statements
* macros
* To reuse created annotations has to be a separate rule


= To follow up =
15.) a representative from KeySpan;


* WebSphinx crawler CREOLE plugin
and be it further


= Other notes =
3rd  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall determine the baseline level of greenhouse gas emissions from electric generation in Suffolk County in the year 1990; the current level of greenhouse gas emissions from electric generation; and the projected level of greenhouse gas emissions in Suffolk County in the year 2020 if no action is taken by the County; and be it further


== Lucene data store and ANIC ==
4th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall develop strategies for the reduction of greenhouse gas emissions from electric generation in Suffolk County and shall determine what technologies are most feasible for reducing the amount of greenhouse gas emissions from electric generation by 25%; the legal authority to mandate the use of any technology or strategy or to establish a “carbon cap”; what timeline should be set to ensure that the goal of a 25% reduction is met by 2020; and which implementation scheme, including, but not limited to, a cap and trade system, mandated technologies, mandated emission reductions per plant or mandated emission reductions per electric generation company, would be most effective; and be it further


* Use <null> for default set
5th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall also study and determine which entities should bear the costs associated with any greenhouse gas emission reduction strategy; and be it further
* Go to Datastore for queries
** eg {Person}({Token})+{Money}
* Useful for debugging JAPE and results


[[File:GATE-lucene-person-money.png|800px]]
6th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall study the proposed KeySpan/National Grid merger, and determine how such a  merger would effect any implementation program, and whether or not a phased in implementation of any recommended strategies can be made a condition of such merger; and be it further


= Demos =
7th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall hold its first meeting no later than thirty (30) days after the oaths of office of all members have been filed, which meeting shall be convened by the Chairperson of the Suffolk County Carbon Cap Implementation Advisory Committee, for the purpose of organization and the appointment of a vice chairperson and a secretary; and be it further


* Mímir for querying large volumes of data (uses MG4J)
8th  '''RESOLVED''', that the members of said Suffolk County Carbon Cap Implementation Advisory Committee shall serve without compensation and shall serve at the pleasure of their respective appointing authorities; and be it further
* Translating parts of speech between languages using Compound editor and Alignment editor
* Predicate extractor (MultiPaX)
** Mixed results at best
* OwlExporter
** NLP ontology


= Conclusions =
9th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall keep a record of all its proceedings and determine the rules of its own proceedings with special meetings to be called by the Chairperson upon his or her own initiative or upon receipt of a written request there for signed by at least three (3) members of the Suffolk County Carbon Cap Implementation Advisory Committee.  Written notice of the time and place of such special meetings shall be given by the secretary to each member at least four (4) days before the date fixed by the notice for such special meeting; and be it further


While it can do a lot out of the box and benefits from development time and breadth of connectivity, to be useful to more than patient specialists, it needs usability testing. A lot of things are inobvious and too domain specific that with a bit of work could be more broadly useful. Interaction could include a lot more immediate, useful and interesting looking displays. A web based version could have these features. However the team seems somewhat ambivalent about development. :)
10th  '''RESOLVED''', that eight (8) members of the Suffolk County Carbon Cap Implementation Advisory Committee shall constitute a quorum to transact the business of the Suffolk County Carbon Cap Implementation Advisory Committee at both regular and special meetings; and be it further


Looking forward to learning about programming using GATE libraries.
11th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee may submit requests to the County Executive and/or the County Legislature for approval for the provision of secretarial services, travel expenses, or retention of consultants to assist the Suffolk County Carbon Cap Implementation Advisory Committee with such endeavors, said total expenditures not to exceed Five Thousand ($5,000.00) per fiscal year, which services shall be subject to Legislative approval; and be it further


{{Blikied|Aug 30, 2010}}
12th  '''RESOLVED''', that clerical services involving the month-to-month operation of this Suffolk County Carbon Cap Implementation Advisory Committee, as well as supplies and postage as necessary, will be provided by the staff of the County Legislature; and be it further


[[Category:SemWeb]]
13th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee may conduct such informal hearings and meetings at any place or places within the County of Suffolk for the purpose of obtaining necessary information or other data to assist it in the proper performance of its duties and functions as it deems necessary; and be it further
 
14th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee may delegate to any member of the Suffolk County Carbon Cap Implementation Advisory Committee the power and authority to conduct such hearings and meetings; and be it further
 
15th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall cooperate with the Legislative Committees of the County Legislature and make available to each Committee's use, upon request, any records and other data it may accumulate or obtain; and be it further
 
16th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall submit a written report of its findings and determinations together with its recommendations for action to each member of the County Legislature, the Commissioner of Health Services, and the County Executive no later than June 1, 2007 for consideration, review, and appropriate action, if necessary, by the entire County Legislature; and be it further
 
17th  '''RESOLVED''', that the Suffolk County Carbon Cap Implementation Advisory Committee shall expire, and the terms of office of its members terminate, as of June 1, 2007 at which time the Suffolk County Carbon Cap Implementation Advisory Committee shall deposit all the records of its proceedings with the Clerk of the Legislature; and be it further
 
18th  '''RESOLVED''', that this Legislature, being the State Environmental Quality Review Act (SEQRA) lead agency, hereby finds and determines that this resolution constitutes a Type II action pursuant to Section 617.5(c)(20) and (27) of Title 6 of the NEW YORK CODE OF RULES AND REGULATIONS (6 NYCRR) and within the meaning of Section 8-0109(2) of the NEW YORK ENVIRONMENTAL CONSERVATION LAW as a promulgation of regulations, rules, policies, procedures, and legislative decisions in connection with continuing agency administration, management and information collection, and the Suffolk County Council on Environmental Quality (CEQ) is hereby directed to circulate any appropriate SEQRA notices of determination of non-applicability or non-significance in accordance with this resolution.
 
[[Category:New York]]

Revision as of 17:33, 3 September 2010

Type: Resolution

Status: Adopted on 2/6/07

Source File: http://www.co.suffolk.ny.us/legis/Resos2006/i2267-06.htm

Text:

RESOLUTION NO. 41-2007, CREATING THE SUFFOLK COUNTY CARBON CAP IMPLEMENTATION ADVISORY COMMITTEE

WHEREAS, global warming is a matter of increasing concern for the public health, environment and economy of Suffolk County; and

WHEREAS, global warming is caused by the emission of greenhouse gases, which include carbon dioxide, methane, nitrous oxide, hydrofluorocarbons, perfluorocarbons, and sulfer hexafluoride; and

WHEREAS, the health of Suffolk residents is threatened by global warming and scientists have concluded that reducing the emission of greenhouse gases will reduce air pollution, a known contributor to respiratory ailments; and

WHEREAS, fossil fuel burning electric generating units are the largest individual source of carbon dioxide and these units account for approximately one-quarter of the annual emission of carbon dioxide; and

WHEREAS, the reduction of greenhouse gas emissions from electric generating plants in Suffolk County should be of primary concern to those who are charged with protecting the health and safety of Suffolk residents; now, therefore be it

1st RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee is hereby created to study the level of greenhouse gas emissions from electric generating plants in Suffolk County and to develop strategies to achieve a 25% reduction in greenhouse gas emissions from such electric generating plants by 2020; and be it further

2nd RESOLVED, that this Suffolk County Carbon Cap Implementation Advisory Committee shall consist of the following fifteen (15) members:

1.) the Chairman of the Suffolk County Legislature’s Economic Development, Higher Education and Energy Committee;

2.) the Commissioner of Environment and Energy, or his or her designee, who will serve as Co-Chair;

3.) the Presiding Officer, or his or her designee;

4.) the Minority Leader, or his or her designee;

5.) a representative from the Office of Legislative Budget Review;

6.) the Dean of SUNY Stony Brook School of Engineering, or his or her designee;

7.) the President of SUNY Farmingdale, or his or her designee;

8.) the Director of the Brookhaven National Laboratory, or his or her designee;

9.) the Executive Director of the Neighborhood Network, or his or her designee, who shall serve as Co-Chair;

10.) the Executive Director of Renewable Energy Long Island, or his or her designee;

11.) the Executive Director of Citizens Campaign for the Environment, or his or her designee;

12.) a representative of the Long Island Association Energy Committee;

13.) a representative from Sustainable Energy Long Island;

14.) a representative from LIPA; and

15.) a representative from KeySpan;

and be it further

3rd RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall determine the baseline level of greenhouse gas emissions from electric generation in Suffolk County in the year 1990; the current level of greenhouse gas emissions from electric generation; and the projected level of greenhouse gas emissions in Suffolk County in the year 2020 if no action is taken by the County; and be it further

4th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall develop strategies for the reduction of greenhouse gas emissions from electric generation in Suffolk County and shall determine what technologies are most feasible for reducing the amount of greenhouse gas emissions from electric generation by 25%; the legal authority to mandate the use of any technology or strategy or to establish a “carbon cap”; what timeline should be set to ensure that the goal of a 25% reduction is met by 2020; and which implementation scheme, including, but not limited to, a cap and trade system, mandated technologies, mandated emission reductions per plant or mandated emission reductions per electric generation company, would be most effective; and be it further

5th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall also study and determine which entities should bear the costs associated with any greenhouse gas emission reduction strategy; and be it further

6th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall study the proposed KeySpan/National Grid merger, and determine how such a merger would effect any implementation program, and whether or not a phased in implementation of any recommended strategies can be made a condition of such merger; and be it further

7th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall hold its first meeting no later than thirty (30) days after the oaths of office of all members have been filed, which meeting shall be convened by the Chairperson of the Suffolk County Carbon Cap Implementation Advisory Committee, for the purpose of organization and the appointment of a vice chairperson and a secretary; and be it further

8th RESOLVED, that the members of said Suffolk County Carbon Cap Implementation Advisory Committee shall serve without compensation and shall serve at the pleasure of their respective appointing authorities; and be it further

9th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall keep a record of all its proceedings and determine the rules of its own proceedings with special meetings to be called by the Chairperson upon his or her own initiative or upon receipt of a written request there for signed by at least three (3) members of the Suffolk County Carbon Cap Implementation Advisory Committee. Written notice of the time and place of such special meetings shall be given by the secretary to each member at least four (4) days before the date fixed by the notice for such special meeting; and be it further

10th RESOLVED, that eight (8) members of the Suffolk County Carbon Cap Implementation Advisory Committee shall constitute a quorum to transact the business of the Suffolk County Carbon Cap Implementation Advisory Committee at both regular and special meetings; and be it further

11th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee may submit requests to the County Executive and/or the County Legislature for approval for the provision of secretarial services, travel expenses, or retention of consultants to assist the Suffolk County Carbon Cap Implementation Advisory Committee with such endeavors, said total expenditures not to exceed Five Thousand ($5,000.00) per fiscal year, which services shall be subject to Legislative approval; and be it further

12th RESOLVED, that clerical services involving the month-to-month operation of this Suffolk County Carbon Cap Implementation Advisory Committee, as well as supplies and postage as necessary, will be provided by the staff of the County Legislature; and be it further

13th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee may conduct such informal hearings and meetings at any place or places within the County of Suffolk for the purpose of obtaining necessary information or other data to assist it in the proper performance of its duties and functions as it deems necessary; and be it further

14th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee may delegate to any member of the Suffolk County Carbon Cap Implementation Advisory Committee the power and authority to conduct such hearings and meetings; and be it further

15th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall cooperate with the Legislative Committees of the County Legislature and make available to each Committee's use, upon request, any records and other data it may accumulate or obtain; and be it further

16th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall submit a written report of its findings and determinations together with its recommendations for action to each member of the County Legislature, the Commissioner of Health Services, and the County Executive no later than June 1, 2007 for consideration, review, and appropriate action, if necessary, by the entire County Legislature; and be it further

17th RESOLVED, that the Suffolk County Carbon Cap Implementation Advisory Committee shall expire, and the terms of office of its members terminate, as of June 1, 2007 at which time the Suffolk County Carbon Cap Implementation Advisory Committee shall deposit all the records of its proceedings with the Clerk of the Legislature; and be it further

18th RESOLVED, that this Legislature, being the State Environmental Quality Review Act (SEQRA) lead agency, hereby finds and determines that this resolution constitutes a Type II action pursuant to Section 617.5(c)(20) and (27) of Title 6 of the NEW YORK CODE OF RULES AND REGULATIONS (6 NYCRR) and within the meaning of Section 8-0109(2) of the NEW YORK ENVIRONMENTAL CONSERVATION LAW as a promulgation of regulations, rules, policies, procedures, and legislative decisions in connection with continuing agency administration, management and information collection, and the Suffolk County Council on Environmental Quality (CEQ) is hereby directed to circulate any appropriate SEQRA notices of determination of non-applicability or non-significance in accordance with this resolution.