Recently, I had to curate a list of publications for our institution. Where’s the point? One might ask. Let’s leave aside that a number of colleagues do not use citation management software to work with their publications. They just hack the citation, if and when needed, in some word files. Done. Fair enough, unless someone tries to come up with a list of all the publication of that institution. In that case, the curator will need some structured data, otherwise he or she will end up copy-pasting the rest of the day.
Things become worse if multiple lists such as “gimme the list of all journal articles of 2017” and “gimme the list of all bookchapters of 2018” are demanded. Such requests cannot easily be handled by standard click-and-run software packages such as Mendeley or even Bibdesk.
So I thought it would be best to get the bibliographic data into R, use the R data wrangling magic to form the data in every possible way and to export the resulting bibliographies back to a citation manager program or just compile a RMarkdown file with all references cited.
OK, let’s try that now.
There’s a nice package called RefManageR that will do the trick for us.
library(RefManageR)
library(tidyverse)## Warning: package 'dplyr' was built under R version 3.5.1Let’s load some bibliographic information, eg., from truely yours. Download this data:
bib_data <- "https://data-se.netlify.com/download/publications_sebastian_sauer.bib"
download.file(url = bib_data,
destfile = "sauer.bib")And then parse it:
bib_path <- "/Users/sebastiansaueruser/Documents/Publikationen/blog_ses/data_se/sauer.bib"
bib <- ReadBib(bib_path, check = TRUE)## Warning in do_read_bib(file, encoding = .Encoding, srcfile):
## /Users/sebastiansaueruser/Documents/Publikationen/blog_ses/data_se/sauer.bib:444:0
## syntax error, unexpected TOKEN_LITERAL, expecting TOKEN_COMMA
## Dropping the entry `S` (starting at line 444)## Ignoring entry 'sauer2011mindfulness' (line48) because:
## A bibentry of bibtype 'InCollection' has to specify the field: editor## Ignoring entry 'schulke2010unterstutzende' (line79) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'sauer2010wirkfaktoren' (line174) because:
## A bibentry of bibtype 'InCollection' has to specify the field: editor## Ignoring entry 'daubner2011kontrakturenpravention' (line183) because:
## The name list field author cannot be parsed## Ignoring entry 'kohls2010custodial' (line275) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'berzlanovich2013achtsamkeit' (line285) because:
## A bibentry of bibtype 'InCollection' has to specify the field: editor## Ignoring entry 'kaltwasser2014mindfulness' (line305) because:
## A bibentry of bibtype 'InCollection' has to specify the field: editor## Ignoring entry 'buettner2015towards' (line335) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'plischke2014nichtstorendes' (line343) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'sauer2016making' (line371) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'Lenhardetal2017' (line410) because:
## A bibentry of bibtype 'Article' has to specify the field: c("year", "date")## Ignoring entry 'Sauer2016aa' (line494) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'Sauer2017ac' (line505) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'Sauer2017ad' (line519) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editor## Ignoring entry 'Sauer2017ae' (line533) because:
## A bibentry of bibtype 'InProceedings' has to specify the field: editorLet’s ignore the parsing errors for the moment, and focus on what we have achieved: A list of publications from a bib file is now available in R.
Convert to a data frame in order to make use of the rich data frame wrangling resources of R:
bib_df <- as.data.frame(bib)
bib_df <- rownames_to_column(bib_df)
glimpse(bib_df)## Observations: 33
## Variables: 21
## $ rowname <chr> "kohls2009facets", "sauer2010gray", "offenbach...
## $ bibtype <chr> "Article", "Article", "Article", "Article", "A...
## $ author <chr> "Niko Kohls and S Sauer and Harald Walach", "S...
## $ doi <chr> "https://doi.org/10.1016/j.paid.2008.10.009", ...
## $ file <chr> ":Users/sebastiansauer/Documents/Literatur/Kli...
## $ journal <chr> "Personality and Individual Differences", "Per...
## $ number <chr> "2", "4", "25", "1", "1572", "4", "1", "10", "...
## $ pages <chr> "224--230", "506--551", "2434--2445", "10", "1...
## $ publisher <chr> "Pergamon", "Pergamon", "Informa Healthcare", ...
## $ title <chr> "{Facets of mindfulness--Results of an online ...
## $ url <chr> "http://www.sciencedirect.com/science/article/...
## $ volume <chr> "46", "50", "33", "6", "366", "20", "2", "32",...
## $ year <chr> "2009", "2010", "2011", "2011", "2011", "2011"...
## $ booktitle <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ `date-added` <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ `date-modified` <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ month <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ day <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ abstract <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ issn <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...
## $ howpublished <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA...Now, honey time. Say we are interested only in articles from 2017. Let’s extract that:
bib_df %>%
filter(bibtype == "Article" & year == "2017") -> Sauers_best
Sauers_best %>% select(title) ## title
## 1 Zurich Model Revisited -- validation of the model of different forms of work satisfaction
## 2 Observation oriented modeling revised from a statistical point of viewNot that much published in 2017, Monsieur Sauer, but that’s a different story.
Before we can use this information, we have to revert it into a list that can in turn be exported to a bibtext file.
bib_back <- as.BibEntry(Sauers_best)## Warning in as.BibEntry(Sauers_best): rownames of data.frame not meaningful
## for creating keysTo export the list as a bib file, use this function:
WriteBib(bib_back, file = "Sauers_best.bib")If we read this file, we see
@Article{1,
rowname = {Ferreira2017},
author = {Yvonne Ferreira and Sandra Suelzenbrueck and Sebastian Sauer},
doi = {10.1007/s41449-017-0060-0},
journal = {Zeitschrift f{\"u}r Arbeitswissenschaft},
number = {3},
pages = {157--168},
title = {Zurich Model Revisited -- validation of the model of different forms of work satisfaction},
url = {https://doi.org/10.1007/s41449-017-0060-0},
volume = {71},
year = {2017},
month = {Oct},
day = {01},
abstract = {Job satisfaction is one of the most prominent working models of occupational and organizational psychology. So far, job satisfaction has been operationalized mainly as a one-dimensional model; this not only repeatedly led to mistakes but also to excessively positive judgements of the job satisfaction. The necessity to see the creation of job satisfaction as a much more complex process was taken into account by the Model of Different Forms of Work Satisfaction (Zurich Model) (Z{\"u}rcher Modell der Arbeitszufriedenheit) (Bruggemann 1974; Bruggemann 1976). The present article describes the empirical and theoretical evolution of this extensive model into the ``Zurich Model Revisited'' which offers the scientific basis for developing an innovative questionnaire (Ferreira, submitted 2017).},
issn = {2366-4681},
}
@Article{2,
rowname = {Sauer2017},
author = {Sebastian Sauer},
doi = {10.3758/s13428-017-0949-8},
journal = {Behavior Research Methods},
title = {Observation oriented modeling revised from a statistical point of view},
url = {https://doi.org/10.3758/s13428-017-0949-8},
year = {2017},
month = {Aug},
day = {25},
abstract = {Observation Oriented Modeling was proposed to overcome some of the problems in the application of statistical inference methods in the behavioral sciences. In this paper, we refine one part of this approach and show how it is connected to methods that are well known in statistical learning. Specifically, we argue that the Moore-Penrose pseudo inverse is superior to the initial solution from a statistical point of view. With this we also show that Observation Oriented Modeling can indeed be appropriate for some tasks in the analysis of observed data. To provide a practical example, we demonstrate the revised method by analyzing the effect of mindfulness training on attentional processes.},
issn = {1554-3528},
}So it seems that everything worked out nicely.
RefmanageR provides some basic functionality for printing a bibliogrphay:
NoCite(bib_back)
PrintBibliography(bib_back, .opts = list(style = "latex",
bib.style = "authoryear"))## Ferreira, Y, S. Suelzenbrueck and S. Sauer
## (2017).
## ``Zurich Model Revisited -- validation of the model of different forms of work satisfaction''.
## In: \emph{Zeitschrift für Arbeitswissenschaft} 71.3, pp. 157--168.
## ISSN: 2366-4681.
## DOI: 10.1007/s41449-017-0060-0.
## \url{https://doi.org/10.1007/s41449-017-0060-0}.
##
## Sauer, S.
## (2017).
## ``Observation oriented modeling revised from a statistical point of view''.
## In: \emph{Behavior Research Methods}.
## ISSN: 1554-3528.
## DOI: 10.3758/s13428-017-0949-8.
## \url{https://doi.org/10.3758/s13428-017-0949-8}.However, I think that ther are not many bib.styles available. For instance, there’s no option for APA citation style (AFAIK).