用 LegalBert 替换 PreSumm 中的模型

大佬教程收集整理的这篇文章主要介绍了用 LegalBert 替换 PreSumm 中的模型，大佬教程大佬觉得挺不错的，现在分享给大家，也给大家做个参考。

如何解决用 LegalBert 替换 PreSumm 中的模型？

开发过程中遇到用 LegalBert 替换 PreSumm 中的模型的问题如何解决？下面主要结合日常开发的经验，给出你关于用 LegalBert 替换 PreSumm 中的模型的解决方法建议，希望对你解决用 LegalBert 替换 PreSumm 中的模型有所启发或帮助；

我在 Presumm 应用程序的代码中替换了 LegalBert 模型，当我运行代码时，生成的摘要是空的。 当我使用 torch==1.1.0 从 https://github.com/nlpyang/PreSumm 安装 PResumm 应用程序时，出现以下错误。如有必要，我可以提供更多信息。 你能指出可能是什么问题吗？

[2021-01-28 16:52:31,419 INFO] https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-vocab.txt not found in cache or force_download set to True,downloading to /tmp/tmp1cak34np
100% 231508/231508 [00:00<00:00,1209050.34B/s]
[2021-01-28 16:52:31,922 INFO] copying /tmp/tmp1cak34np to cache at ../temp/26bc1ad6c0ac742e9b52263248f6d0f00068293b33709fae12320c0e35ccfbbb.542ce4285a40d23a559526243235df47c5f75c197f04f37d1a0c124c32c9a084
[2021-01-28 16:52:31,922 INFO] creaTing Metadata file for ../temp/26bc1ad6c0ac742e9b52263248f6d0f00068293b33709fae12320c0e35ccfbbb.542ce4285a40d23a559526243235df47c5f75c197f04f37d1a0c124c32c9a084
[2021-01-28 16:52:31,922 INFO] removing temp file /tmp/tmp1cak34np
[2021-01-28 16:52:31,923 INFO] loading file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-vocab.txt from cache at ../temp/26bc1ad6c0ac742e9b52263248f6d0f00068293b33709fae12320c0e35ccfbbb.542ce4285a40d23a559526243235df47c5f75c197f04f37d1a0c124c32c9a084
gpu_rank 0
[2021-01-28 16:52:31,966 INFO] * number of parameters: 180222522
[2021-01-28 16:52:31,966 INFO] Start Training...
TraceBACk (most recent call last):
  file "/usr/lib/python3.6/tarfile.py",line 188,in nti
    s = nts(s,"ascii","Strict")
  file "/usr/lib/python3.6/tarfile.py",line 172,in nts
    return s.decode(enCoding,errors)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xfb in position 1: ordinal not in range(128)

During handling of the above exception,another exception occurred:

TraceBACk (most recent call last):
  file "/usr/lib/python3.6/tarfile.py",line 2299,in next
    tarinfo = self.tarinfo.fromtarfile(self)
  file "/usr/lib/python3.6/tarfile.py",line 1093,in fromtarfile
    obj = cls.frombuf(buf,tarfile.enCoding,tarfile.errors)
  file "/usr/lib/python3.6/tarfile.py",line 1035,in frombuf
    chksum = nti(buf[148:156])
  file "/usr/lib/python3.6/tarfile.py",line 191,in nti
    raise InvalIDheaderError("invalID header")
tarfile.InvalIDheaderError: invalID header

During handling of the above exception,another exception occurred:

TraceBACk (most recent call last):
  file "/usr/local/lib/python3.6/dist-packages/torch/serialization.py",line 556,in _load
    return legacy_load(f)
  file "/usr/local/lib/python3.6/dist-packages/torch/serialization.py",line 467,in legacy_load
    with closing(tarfile.open(fiLeobj=f,mode='r:',format=tarfile.pax_FORMAT)) as tar,\
  file "/usr/lib/python3.6/tarfile.py",line 1591,in open
    return func(name,filemode,fiLeobj,**kwargs)
  file "/usr/lib/python3.6/tarfile.py",line 1621,in Taropen
    return cls(name,mode,line 1484,in __init__
    self.firstmember = self.next()
  file "/usr/lib/python3.6/tarfile.py",line 2311,in next
    raise ReadError(str(E))
tarfile.ReadError: invalID header

During handling of the above exception,another exception occurred:

TraceBACk (most recent call last):
  file "Train.py",line 122,in <module>
    Train_abs(args,device_ID)
  file "/src/Train_abstractive.py",line 275,in Train_abs
    Train_abs_single(args,line 336,in Train_abs_single
    Trainer.Train(Train_iter_fct,args.Train_steps)
  file "/src/models/Trainer.py",line 133,in Train
    Train_iter = Train_iter_fct()
  file "/src/Train_abstractive.py",line 315,in Train_iter_fct
    shuffle=True,is_test=falsE)
  file "/src/models/data_loader.py",line 136,in __init__
    self.cur_iter = self._next_dataset_iterator(datasets)
  file "/src/models/data_loader.py",line 156,in _next_dataset_iterator
    self.cur_dataset = next(dataset_iter)
  file "/src/models/data_loader.py",line 90,in load_dataset
    yIEld _lazy_dataset_loader(pt,corpus_typE)
  file "/src/models/data_loader.py",line 78,in _lazy_dataset_loader
    dataset = torch.load(pt_filE)
  file "/usr/local/lib/python3.6/dist-packages/torch/serialization.py",line 387,in load
    return _load(f,map_LOCATIOn,pickle_module,**pickle_load_args)
  file "/usr/local/lib/python3.6/dist-packages/torch/serialization.py",line 560,in _load
    raise RuntimeError("{} is a zip archive (dID you mean to use torch.jit.load()?)".format(f.Name))
RuntimeError: /preTrained_files/bert/temp.Train.0.bert.pt is a zip archive (dID you mean to use torch.jit.load()?)

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）

大佬总结

以上是大佬教程为你收集整理的用 LegalBert 替换 PreSumm 中的模型全部内容，希望文章能够帮你解决用 LegalBert 替换 PreSumm 中的模型所遇到的程序开发问题。

如果觉得大佬教程网站内容还不错，欢迎将大佬教程推荐给程序员好友。

本图文内容来源于网友网络收集整理提供，作为学习参考使用，版权属于原作者。
如您有任何意见或建议可联系处理。小编QQ：384754419，请注明来意。