Abstract
We introduce DLT-Corpus, the largest domain-specific text collection for Distributed Ledger Technology (DLT) research to date: 2.98 billion tokens from 22.12 million documents spanning scientific literature (37,440 publications), United States Patent and Trademark Office (USPTO) patents (49,023 filings), and social media (22 million posts). Existing Natural Language Processing (NLP) resources for DLT focus narrowly on cryptocurrencies price prediction and smart contracts, leaving domain-specific language under explored despite the sector's ~$3 trillion market capitalization and rapid technological evolution. We demonstrate DLT-Corpus' utility by analyzing technology emergence patterns and market-innovation correlations. Findings reveal that technologies originate in scientific literature before reaching patents and social media, following traditional technology transfer patterns. While social media sentiment remains overwhelmingly bullish even during crypto winters, scientific and patent activity grow independently of market fluctuations, tracking overall market expansion in a virtuous cycle where research precedes and enables economic growth that funds further innovation. We publicly release the full DLT-Corpus; LedgerBERT, a domain-adapted model achieving 23% improvement over BERT-base on a DLT-specific Named Entity Recognition (NER) task; and all associated tools and code.
Abstract (translated)
我们介绍DLT-Corpus,这是迄今为止最大的专注于分布式账本技术(DLT)研究的特定领域文本集合:包含来自2212万份文档的298亿个词素,这些文档涵盖了科学文献(37,440篇出版物)、美国专利商标局(USPTO)专利申请(49,023项申请),以及社交媒体上的帖子(2200万个)。现有的自然语言处理(NLP)资源对DLT的研究重点狭隘地集中在加密货币价格预测和智能合约上,尽管该行业的市值约为3万亿美元,并且技术迅速演变,但特定领域的语言仍未得到充分探索。我们通过分析技术出现模式和市场创新相关性来展示DLT-Corpus的实用性。研究结果表明,技术首先出现在科学文献中,然后进入专利申请和社会媒体,遵循传统的技术转让模式。尽管在加密货币寒冬期间社交媒体情绪依然普遍乐观,但科学研究和技术专利活动却独立于市场波动,跟踪整体市场的扩张,在良性循环中促进经济发展,并为更多的创新提供资金支持。我们公开发布了完整的DLT-Corpus;LedgerBERT,这是一个针对DLT特定命名实体识别(NER)任务的领域适应模型,在该任务上比BERT-base模型提高了23%的性能;以及所有相关的工具和代码。
URL
https://arxiv.org/abs/2602.22045