COLLECTED BY

Organization: Archive Team

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.

History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.

The main site for Archive Team is at archiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.

This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by the Wayback Machine, providing a path back to lost websites and work.

Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.

The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.

Collection: ArchiveBot: The Archive Team Crowdsourced Crawler

ArchiveBot is an IRC bot designed to automate the archival of smaller websites (e.g. up to a few hundred thousand URLs). You give it a URL to start at, and it grabs all content under that URL, records it in a WARC, and then uploads that WARC to ArchiveTeam servers for eventual injection into the Internet Archive (or other archive sites).

To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.

There is a dashboard running for the archivebot process at http://www.archivebot.com.

ArchiveBot's source code can be found at https://github.com/ArchiveTeam/ArchiveBot.

TIMESTAMPS

The Wayback Machine - https://web.archive.org/web/20240725153456/https://github.com/taishan1994

taishan1994

Follow

🍌

西西嘛呦 taishan1994

🍌

Follow

NLP Scientist, Master of Wuhan University of Technology, Working on large language model

598 followers · 16 following

Achievements

Achievements

Block or Report

Block or report taishan1994

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

taishan1994/README.md

你好，我是西西嘛呦. 👋

🌱 博客园地址：西西嘛呦
👯 微信公众号：西西嘛呦
🔭 知乎：西西嘛呦
🤔 目前从事于自然语言处理相关工作，喜欢探索不同的技术
⚡ 定制化arxiv，每日更新NLP相关论文：https://taishan1994.github.io/xiximayou-arxiv/
😄 联系我-微信号：gongoubo

ChatGPT

以下三个是一个系列：怎么让英文大语言模型支持中文

图神经网络

分布式训练

pytorch分布式训练

中文信息抽取

基于pipe的信息抽取：

BERT-BILSTM-CRF：中文实体识别
BERT-Relation-Extraction：中文关系抽取
BERT-ABSA：中文方面级情感分析
BERT-Event-Extraction 中文事件抽取

基于指针网络的信息抽取：实体识别、关系抽取、事件抽取：

PointerNet_Chinese_Information_Extraction

基于GlobalPointer的信息抽取：实体识别、关系抽取、事件抽取：

chinese_information_extraction

命名实体识别

关系抽取

事件抽取

多标签分类+事件抽取

文本分类

句子相似度

实体链接

基于bert的实体链接

指代消解

基于bert的指代消解

意图识别和槽位填充

意图识别和槽位填充

知识图谱

文本生成

中文关键词提取

关键词提取

机器问答

中文文本纠错

模型压缩

知识蒸馏

其它

Popular repositories Loading

awesome-chinese-ner awesome-chinese-ner Public

中文命名实体识别。包含目前最新的中文命名实体识别论文、中文实体识别相关工具、数据集，以及中文预训练模型、词向量、实体识别综述等。

560 44
pytorch_bert_bilstm_crf_ner pytorch_bert_bilstm_crf_ner Public

基于pytorch的bert_bilstm_crf中文命名实体识别

Python 492 76
pytorch_triple_extraction pytorch_triple_extraction Public

基于pytorch的中文三元组提取（命名实体识别+关系抽取）

Python 317 39
BERT-BILSTM-CRF BERT-BILSTM-CRF Public

使用BERT-BILSTM-CRF进行中文命名实体识别。

Python 296 33
chinese_information_extraction chinese_information_extraction Public

中文信息抽取，包含实体抽取、关系抽取、事件抽取

Python 217 23
langchain-learning langchain-learning Public

langchain学习笔记，包含langchain源码解读、langchain中使用中文模型、langchain实例等。

164 23