将XML非法和char转换为utf8 – python

在以下位置有一个XML和HTML字符引用列表：https://en.wikipedia.org/wiki/List_of_XML_and_HTML_character_entity_references.

但是,有些内容在该列表中根本没有定义,但它们在较旧的HTML脚本中使用.当我处理来自http://www.d.umn.edu/~tpederse/data.html的Senseval-2格式(带有修复)数据集时,我会遇到以下单词,它会破坏我的脚本,该脚本试图使用Xml.et.elementTree来解析数据.

这些单词的unicode等价是什么？

&and.
&and.A
&and.b
&and.D
&and.L's
&BACkquote.alim)
&BACkquote.ulema
&dash
&dash.
&dash."
&dashq.
&degree.
&degree.C
&ellip
&ellip.
&ellip.0
&ellip.1
&ellip.11
&ellip.2
&ellip.23
&ellip.28
&ellip.38
&ellip.4
&ellip.6
&ellip.64
&ellip.?"
&ellip.two
&times.

我的剧本：

import xml.etree.ElementTree as et
s1 = 'Train-fix.xml' # from http://www.d.umn.edu/~tpederse/Data/Sval1to2.fix.tar.gz
tree = et.parse(s1)
root = tree.getroot()

给出这个追溯：

TraceBACk (most recent call last):
  File "senseval.py",line 4,in source,parser)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py",line 656,in parse
    parser.feed(data)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py",line 1642,in feed
    self._raiseerror(v)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py",line 1506,in _raiseerror
    raise err
xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 41,@R_@R_772_11280@_8620@n 113