Package: text 1.9

Oscar Kjell

text: Analyses of Text using Transformers Models from HuggingFace, Natural Language Processing and Machine Learning

Link R with Transformers from Hugging Face to transform text variables to word embeddings; where the word embeddings are used to statistically test the mean difference between set of texts, compute semantic similarity scores between texts, predict numerical variables, and visual statistically significant words according to various dimensions etc. For more information see <https://www.r-text.org>.

Authors:Oscar Kjell [aut, cre], Salvatore Giorgi [aut], Andrew Schwartz [aut]

text_1.9.tar.gz
text_1.9.zip(r-4.7)text_1.9.zip(r-4.6)text_1.9.zip(r-4.5)
text_1.9.tgz(r-4.6-any)text_1.9.tgz(r-4.5-any)
text_1.9.tar.gz(r-4.7-any)text_1.9.tar.gz(r-4.6-any)
text_1.9.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
text/json (API)

# Install 'text' in R:

install.packages('text', repos = c('https://oscarkjell.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/oscarkjell/text/issues

Pkgdown/docs site:https://r-text.org

Datasets:

centrality_data_harmony - Example data for plotting a Semantic Centrality Plot.
DP_projections_HILS_SWLS_100 - Data for plotting a Dot Product Projection Plot.
Language_based_assessment_data_3_100 - Example text and numeric data.
Language_based_assessment_data_8 - Text and numeric data for 10 participants.
PC_projections_satisfactionwords_40 - Example data for plotting a Principle Component Projection Plot.
raw_embeddings_1 - Word embeddings from textEmbedRawLayers function
word_embeddings_4 - Word embeddings for 4 text variables for 40 participants

On CRAN:

deep-learning machine-learning nlp transformers

12.99 score 160 stars 1 packages 936 scripts 1.2k downloads 9 mentions 63 exports 149 dependencies

Last updated from:1fa93c87b9. Checks:9 OK. Indexed: yes.

Target	Result	Time
linux-devel-x86_64	OK	262
source / vignettes	OK	308
linux-release-x86_64	OK	253
macos-release-arm64	OK	227
macos-oldrel-arm64	OK	226
windows-devel	OK	182
windows-release	OK	172
windows-oldrel	OK	220
wasm-release	OK	201

Exports:find_textrpp_env textAssess textBERTopics textCentrality textCentralityPlot textClassify textClean textCleanNonASCII textDescriptives textDiagnostics textDimName textDistance textDistanceMatrix textDistanceNorm textDomainCompare textEmbed textEmbedLayerAggregation textEmbedRawLayers textEmbedReduce textEmbedStatic textExamples textFindNonASCII textFineTuneDomain textFineTuneTask textGeneration textLBAM textModelLayers textModels textModelsRemove textNER textPCA textPCAPlot textPlot textPredict textPredictAll textPredictTest textProjection textProjectionPlot textQA textrpp_initialize textrpp_install textrpp_install_virtualenv textrpp_uninstall textSimilarity textSimilarityMatrix textSimilarityNorm textSum textTokenize textTokenizeAndCount textTopics textTopicsReduce textTopicsTest textTopicsTree textTopicsWordcloud textTrain textTrainLists textTrainN textTrainNPlot textTrainRandomForest textTrainRegression textTranslate textWordPrediction textZeroShot

Dependencies:base64enc bit bit64 bslib cachem class cli clipr clock codetools colorspace commonmark cowplot cpp11 crayon curl data.table diagram dials DiceDesign digest dplyr evaluate farver fastmap fastmatch float fontawesome fs furrr future future.apply GauPro generics ggforce ggplot2 ggrepel ggwordcloud globals glue gower gridtext gtable gtools hardhat here highr hms htmltools ipred isoband ISOcodes jpeg jquerylib jsonlite KernSmooth knitr labeling lattice lava lbfgs lgr lifecycle listenv litedown lubridate magrittr markdown MASS Matrix MatrixExtra memoise mime mixopt mlapi modelenv nnet numDeriv parallelly parsnip patchwork pillar pkgconfig png polyclip prettyunits prodlim progress progressr purrr quanteda R6 rappdirs RColorBrewer Rcpp RcppArmadillo RcppEigen RcppProgress RcppTOML readr recipes reticulate RhpcBLASctl rlang rmarkdown rpart rprojroot rsample rsparse RSpectra S7 sass scales sfd shape slider SnowballC sparsevctrs splitfngr SQUAREM stopwords stringi stringr survival systemfonts tailor text2vec textmineR tibble tidyr tidyselect timechange timeDate tinytex topics tune tweenr tzdb utf8 vctrs viridisLite vroom warp withr workflows xfun xml2 yaml yardstick

HuggingFace Transformers in R: Word Embeddings Defaults and Specifications

Rendered fromhuggingface_in_r.Rmdusingknitr::rmarkdown

Last update: 2026-06-13
Started: 2022-07-13

Extended Installation Guide

Rendered fromext_install_guide.Rmdusingknitr::rmarkdown

Last update: 2026-06-13
Started: 2025-07-29

Getting started

textEmbed(): mapping text to numbers using HuggingFace language models | textTrain(): Examine the relationship between text and numeric variables | Plot statistically significant words | textProjection(): Pre-process data for plotting | textProjectionPlot(): A two-dimensional word plot | Articles using the text-package | Other relevant references

Rendered fromtext.Rmdusingknitr::rmarkdown

Last update: 2025-12-02
Started: 2019-12-30

The Language-Based Assessment Model (L-BAM) Library

Overview of L-BAM pipelines | References

Rendered fromLBAM.Rmdusingknitr::rmarkdown

Last update: 2025-11-14
Started: 2024-11-01

Creating a Singularity Container to Run HuggingFace Transformers Models in R

Code to build a singularity container with HuggingFace models in R

Rendered fromsingularity_transformers_container.Rmdusingknitr::rmarkdown

Last update: 2025-09-01
Started: 2022-07-13

Pre-registration and Researcher Degrees of Freedom

Flexibility: The double edged sword in data analyses | Specific pre-registration requirements for text analyses | References

Rendered frompre_registration_and_transformers.Rmdusingknitr::rmarkdown

Last update: 2025-08-29
Started: 2022-12-01

Installing and Managing Python Environments with reticulate

Rendered fromreticulate.Rmdusingknitr::rmarkdown

Last update: 2025-07-21
Started: 2025-07-21

Implicit Motives Tutorial

Rendered fromimplicit_motives_tutorial.Rmdusingknitr::rmarkdown

Last update: 2025-02-17
Started: 2024-11-25

L-BAM Tutorial

Rendered fromlbam_tutorial.Rmdusingknitr::rmarkdown

Last update: 2024-11-26
Started: 2024-11-25

Psychological Methods: the Text Tutorial

Rendered frompsychological_methods.Rmdusingknitr::rmarkdown

Last update: 2022-12-01
Started: 2022-12-01

How to best manage computationally heavy analyses

Your system's capacity | References

Rendered fromhuggingface_in_r_and_computer_capacity.Rmdusingknitr::rmarkdown

Last update: 2022-07-13
Started: 2022-07-13

HuggingFace language models are downloaded in .cache

Rendered fromremoving_huggingface_transformers_cache_files.Rmdusingknitr::rmarkdown

Last update: 2022-07-13
Started: 2022-07-13

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Example data for plotting a Semantic Centrality Plot.	centrality_data_harmony
Data for plotting a Dot Product Projection Plot.	DP_projections_HILS_SWLS_100
Example text and numeric data.	Language_based_assessment_data_3_100
Text and numeric data for 10 participants.	Language_based_assessment_data_8
Example data for plotting a Principle Component Projection Plot.	PC_projections_satisfactionwords_40
Word embeddings from textEmbedRawLayers function	raw_embeddings_1
Semantic similarity score between single words' and an aggregated word embeddings	textCentrality
Plots words from textCentrality()	textCentralityPlot
Cleans text from standard personal information	textClean
Clean non-ASCII characters	textCleanNonASCII
Compute descriptive statistics of character variables.	textDescriptives
Run diagnostics for the text package	textDiagnostics
Change dimension names	textDimName
Semantic distance	textDistance
Semantic distance across multiple word embeddings	textDistanceMatrix
Semantic distance between a text variable and a word norm	textDistanceNorm
Compare two language domains	textDomainCompare
textEmbed() extracts layers and aggregate them to word embeddings, for all character variables in a given dataframe.	textEmbed
Aggregate layers	textEmbedLayerAggregation
Extract layers of hidden states	textEmbedRawLayers
Pre-trained dimension reduction (experimental)	textEmbedReduce
Apply static word embeddings	textEmbedStatic
Identify language examples.	textExamples
Detect non-ASCII characters	textFindNonASCII
Domain Adapted Pre-Training (EXPERIMENTAL - under development)	textFineTuneDomain
Task Adapted Pre-Training (EXPERIMENTAL - under development)	textFineTuneTask
Text generation	textGeneration
The LBAM library	textLBAM
Number of layers	textModelLayers
Check downloaded, available models.	textModels
Delete a specified model	textModelsRemove
Named Entity Recognition. (experimental)	textNER
textPCA()	textPCA
textPCAPlot	textPCAPlot
Plot words	textPlot
textPredict, textAssess and textClassify	textAssess textClassify textPredict
Predict from several models, selecting the correct input	textPredictAll
Significance testing for model prediction performance	textPredictTest
Supervised Dimension Projection	textProjection
Plot Supervised Dimension Projection	textProjectionPlot
Question Answering. (experimental)	textQA
Initialize text required python packages	textrpp_initialize
Install text required python packages in conda or virtualenv environment	textrpp_install textrpp_install_virtualenv
Uninstall textrpp conda environment	textrpp_uninstall
Semantic Similarity	textSimilarity
Semantic similarity across multiple word embeddings	textSimilarityMatrix
Semantic similarity between a text variable and a word norm	textSimilarityNorm
Summarize texts. (experimental)	textSum
Tokenize text-variables	textTokenize
Tokenize and count	textTokenizeAndCount
BERTopic	textBERTopics textTopics
textTopicsReduce (EXPERIMENTAL)	textTopicsReduce
Wrapper for topicsTest function from the topics package	textTopicsTest
textTopicsTest (EXPERIMENTAL) to get the hierarchical topic tree	textTopicsTree
Plot word clouds	textTopicsWordcloud
Trains word embeddings	textTrain
Train lists of word embeddings	textTrainLists
Cross-validated accuracies across sample-sizes	textTrainN
Plot cross-validated accuracies across sample sizes	textTrainNPlot
Trains word embeddings usig random forest	textTrainRandomForest
Train word embeddings to a numeric variable.	textTrainRegression
Translation. (experimental)	textTranslate
Compute word-level prediction scores for plotting with textProjectionPlot().	textWordPrediction
Zero Shot Classification (Experimental)	textZeroShot
Word embeddings for 4 text variables for 40 participants	word_embeddings_4