Published August 7, 2026 | Version v1
Dataset Open

Code and data accompanying "Beyond cognacy" (corrected study)

  • 1. ROR icon University of Tübingen

Description

This dataset contains the complete data and code of the corrected analysis (August 2026) for the paper:

Gerhard Jäger. 2025. Beyond cognacy. In Proceedings of the 7th Workshop on Research in Computational Linguistic Typology and Multilingual NLP (SIGTYP 2025). The corrected and updated version of the paper is available as arXiv:2507.03005.

The study compares three methods for phylogenetic reconstruction of language families from Lexibank lexical data: expert cognate classes, automatic cognate clustering based on pointwise mutual information, and multiple sequence alignments derived from pair-Hidden Markov Models. The resulting trees are evaluated against Glottolog and Grambank using Generalized Quartet Distance, typological fit (ΔAIC), and the Pythia difficulty score. The study covers 974 languages and 15 language families.

The archive beyond-cognacy-fdat.zip contains the full working directory of the analysis: the pipeline code as run, all primary data (Lexibank, Grambank, Glottolog, as downloaded on 2026-08-03), all intermediate results (wordlists, distances, cognate clusterings, alignments, character matrices), the RAxML-NG tree inference outputs for the full dataset, the 15 families and the 100 subsamples, the final evaluation tables, the result figures, and the logs of the actual run. See DEPOSIT_README.md inside the archive for a detailed inventory.

The maintained code repository is https://codeberg.org/profgerhard/sigtyp2025_code/. The dataset of the originally published 2025 version of the paper is archived on Zenodo (doi:10.5281/zenodo.15678468); the present deposit supersedes it for the corrected study.

Files

beyond-cognacy-fdat.zip

Files (4.1 GB)

Name Size Download all
md5:cb67064d14a7c643013722995510d0bc
4.1 GB Preview Download

Additional details

Related works

Is derived from
Software: https://codeberg.org/profgerhard/sigtyp2025_code/ (URL)
Is new version of
Dataset: 10.5281/zenodo.15678468 (DOI)
Is supplement to
Text: https://aclanthology.org/2025.sigtyp-1.6/ (URL)
Text: arXiv:2507.03005 (arXiv)

Data quality

Accuracy

The input data are drawn from established, curated, publicly available sources (Lexibank, Grambank, Glottolog). All derived results were produced by the included pipeline in a single documented analysis campaign (August 2026) with fixed random seeds; the complete run logs are part of the deposit. The final evaluation tables are identical to the numbers reported in the corrected version of the accompanying paper (arXiv:2507.03005).

Completeness

Complete: the deposit contains the full working directory of the analysis, including the primary data as downloaded on 2026-08-03, all intermediate results (wordlists, distances, cognate clusterings, alignments, character matrices), the tree inference outputs for the full dataset, the 15 families and the 100 subsamples, the final evaluation tables, the figures, the code as run, the conda and Julia environment specifications, and the run logs. The parameters of the pair-Hidden Markov Model, which were trained on a corpus shared with a related project, are included as code/phmm_parameters.json. Excluded is only an abandoned earlier run that contributed to no reported result.

Conformity

The deposit follows the FAIR data principles. All input data come from publicly available, versioned sources with documented licenses. File formats are open and non-proprietary (CSV, PHYLIP, Newick, JSON, plain text). Software dependencies are specified in machine-readable environment files, and the workflow is documented in the code repository.

Consistency

All results stem from a single analysis campaign with fixed random seeds, not from a mixture of runs. The final evaluation tables can be re-derived from the included character matrices and trees, which in turn derive from the included primary data via the included pipeline. The archive passed an integrity test, and the MD5 checksum of the uploaded file was verified against the local copy.

Credibility

The study was carried out at the University of Tübingen. The underlying paper was peer-reviewed and published in the Proceedings of SIGTYP 2025. The post-publication corrections are transparently documented in the corrected paper, in the code repository, and in this deposit; the development history is public at https://codeberg.org/profgerhard/sigtyp2025_code/.

Processability

All files are machine-readable with standard open-source tools. The analysis stack (Julia, Python, R, RAxML-NG, GNU parallel) is free and open source; exact dependency versions are pinned in the included environment files (conda yml, Julia Project.toml and Manifest.toml).

Relevance

The deposit supports research in computational historical linguistics and linguistic typology: it allows full replication of the reported comparison between expert cognacy, automatic cognate clustering, and multiple sequence alignment as bases for phylogenetic inference, and the derived character matrices, alignments and trees for 974 languages can be reused in follow-up studies.

Timeliness

The deposit reflects the corrected study of August 2026, which supersedes the originally published 2025 analysis. The dataset of the original version remains available on Zenodo (doi:10.5281/zenodo.15678468). The Lexibank, Grambank and Glottolog data are the versions current at the download date (2026-08-03), which is recorded in the deposit.

Understandability

DEPOSIT_README.md at the root of the archive provides a detailed inventory of the contents. The analysis workflow is documented step by step in the code repository (workflow.md and README). The methods are described in the accompanying paper; the corrections relative to the originally published version are documented in the paper's title footnote. The lexical data follow the CLDF conventions of Lexibank.

Software documentation

Application category
data analytics and processing software
Build instructions

The conda environments are specified in sigtyp2025_code.yml and sigtyp2025_r.yml and can be recreated with:

mamba env create -f sigtyp2025_code.yml mamba env create -f sigtyp2025_r.yml

The Julia environment is set up with:

cd code julia --project=. -e "using Pkg; Pkg.instantiate()"

The pipeline steps and the sbatch scripts for the tree searches are documented in code/ and in workflow.md of the code repository; the driver scripts of the actual run (run_pipeline*.sh) are included at the top level of the archive.

Code repository
https://codeberg.org/profgerhard/sigtyp2025_code/
Copyright holder
Gerhard Jäger
Copyright year
2026
Is accessible for free
Yes
Maintainer
0000-0002-9642-9359
Operating system
linux platform
Programming language
julia, python, r