Friday, 20 February 2015

Penn Treebank POS Tags in Natural Language Processing

Part-of-speech(POS) tags are the most common things to be used in Natural Language processing. Let's say we are parsing a sentence and following is the result parse tree:

(TOP  (SBARQ (WHADVP (WRB How))
(SQ (VBZ is)
       (NP
 (NP (DT the) (NN author) )
 (PP (IN of)
        (NP
               (NP (DT The) (NNP Call) )
               (PP (IN of)
                      (NP (DT the) (NNP Wild?) )
                )
          )
 )
                                      )
                            )
  ))

Now the problem arises : What do these pos tags(i.e. SBARQ,WHADVP,VBZ etc.) stand for? 
So to avoid this situation, I am consolidating all the pos tags here :

Tag
Description
CC
Coordinating conjunction
CD
Cardinal number
DT
Determiner
EX
Existential there
FW
Foreign word
IN
Preposition or subordinating conjunction
JJ
Adjective
JJR
Adjective, comparative
JJS
Adjective, superlative
LS
List item marker
MD
Modal
NN
Noun, singular or mass
NNS
Noun, plural
NNP
Proper noun, singular
NNPS
Proper noun, plural
PDT
Pre determiner
POS
Possessive ending
PRP
Personal pronoun
PRP$
Possessive pronoun
RB
Adverb
RBR
Adverb, comparative
RBS
Adverb, superlative
RP
Particle
S
Simple declarative clause, i.e. one that is not introduced by a (possible empty) subordinating conjunction or a wh-word and that does not exhibit subject-verb inversion
SBAR
Clause introduced by a (possibly empty) subordinating conjunction
SBARQ
Direct question introduced by a wh-word or a wh-phrase. Indirect questions and relative clauses should be bracketed as SBAR, not SBARQ
SINV
Inverted declarative sentence, i.e. one in which the subject follows the tensed verb or modal.
SQ
 Inverted yes/no question, or main clause of a wh-question, following the wh-phrase in SBARQ.
SYM
Symbol
VBD
Verb, past tense
VBG
Verb, gerund or present participle
VBN
Verb, past participle
VBP
Verb, non-3rd person singular present
VBZ
Verb, 3rd person singular present
WDT
Wh-determiner
WP
Wh-pronoun
WP$
Possessive wh-pronoun
WRB
Wh-adverb

 will keep updating the list with new pos tags. Cheers!!!

No comments:

Post a Comment