R (programming language)
R is a programming language and free software environment for statistical computing and graphics supported by the R Foundation for Statistical Computing. The R language is widely used among statisticians and data miners for developing statistical software and data analysis. Polls, data mining surveys, and studies of scholarly literature databases show substantial increases in popularity; R ranks 8th in the TIOBE index, a measure of popularity of programming languages.
A GNU package, the official R software environment is written primarily in C, Fortran, and R itself and is freely available under the GNU General Public License. Pre-compiled executables are provided for various operating systems. Although R has a command line interface, there are several third-party graphical user interfaces, such as RStudio, an integrated development environment, and Jupyter, a notebook interface.
History
R is an implementation of the S programming language combined with lexical scoping semantics, inspired by Scheme. S was created by John Chambers in 1976, while at Bell Labs. There are some important differences, but much of the code written for S runs unaltered.R was created by Ross Ihaka and Robert Gentleman at the University of Auckland, New Zealand, and is developed by the R Development Core Team. R is named partly after the first names of the first two R authors and partly as a play on the name of S. The project was conceived in 1992, with an initial version released in 1995 and a stable beta version on 29 February 2000.
Statistical features
R and its libraries implement a wide variety of statistical and graphical techniques, including linear and nonlinear modeling, classical statistical tests, time-series analysis, classification, clustering, and others. R is easily extensible through functions and extensions, and the R community is noted for its active contributions in terms of packages. Many of R's standard functions are written in R itself, which makes it easy for users to follow the algorithmic choices made. For computationally intensive tasks, C, C++, and Fortran code can be linked and called at run time. Advanced users can write C, C++, Java,.NET or Python code to manipulate R objects directly. R is highly extensible through the use of user-submitted packages for specific functions or specific areas of study. Due to its S heritage, R has stronger object-oriented programming facilities than most statistical computing languages. Extending R is also eased by its lexical scoping rules.Another strength of R is static graphics, which can produce publication-quality graphs, including mathematical symbols. Dynamic and interactive graphics are available through additional packages.
R has Rd, its own LaTeX-like documentation format, which is used to supply comprehensive documentation, both online in a number of formats and in hard copy.
Programming features
R is an interpreted language; users typically access it through a command-line interpreter. If a user types2+2
at the R command prompt and presses enter, the computer replies with 4, as shown below:> 2 + 2
4
This calculation is interpreted as the sum of two single-element vectors, resulting in a single-element vector. The prefix
indicates that the list of elements following it on the same line starts with the first element of the vector.Like other similar languages such as APL and MATLAB, R supports matrix arithmetic. R's data structures include vectors, matrices, arrays, data frames and lists. Arrays are stored in column-major order. R's extensible object system includes objects for : regression models, time-series and geo-spatial coordinates. The scalar data type was never a data structure of R. Instead, a scalar is represented as a vector with length one.
Many features of R derive from Scheme. R uses S-expressions to represent both data and code.
Functions are first-class and can be manipulated in the same way as data objects, facilitating meta-programming, and allow multiple dispatch. Variables in R are lexically scoped and dynamically typed. Function arguments are passed by value, and are lazy—that is to say, they are only evaluated when they are used, not when the function is called.
R supports procedural programming with functions and, for some functions, object-oriented programming with generic functions. A generic function acts differently depending on the classes of arguments passed to it. In other words, the generic function dispatches the function specific to that class of object. For example, R has a generic
print
function that can print almost every class of object in R with a simple print
syntax.Although used mainly by statisticians and other practitioners requiring an environment for statistical computation and software development, R can also operate as a general matrix calculation toolbox – with performance benchmarks comparable to GNU Octave or MATLAB.
Packages
The capabilities of R are extended through user-created packages, which allow specialised statistical techniques, graphical devices, import/export capabilities, reporting tools, etc. These packages are developed primarily in R, and sometimes in Java, C, C++, and Fortran. The R packaging system is also used by researchers to create compendia to organise research data, code and report files in a systematic way for sharing and public archiving.A core set of packages is included with the installation of R, with more than 15,000 additional packages available at the Comprehensive R Archive Network, Bioconductor, Omegahat, GitHub, and other repositories.
The "Task Views" page on the CRAN website lists a wide range of tasks to which R has been applied and for which packages are available. R has also been identified by the FDA as suitable for interpreting data from clinical research.
Other R package resources include Crantastic, a community site for rating and reviewing all CRAN packages, and R-Forge, a central platform for the collaborative development of R packages, R-related software, and projects. R-Forge also hosts many unpublished beta packages, and development versions of CRAN packages. Microsoft maintains a daily snapshot of CRAN, that dates back to Sept. 17, 2014.
The Bioconductor project provides R packages for the analysis of genomic data. This includes object-oriented data-handling and analysis tools for data from Affymetrix, cDNA microarray, and next-generation high-throughput sequencing methods.
A group of packages called the Tidyverse, which can be considered a "dialect of the R language", is increasingly popular in the R ecosystem. The group of packages strives to provide a cohesive collection of functions to deal with common data science tasks, including data import, cleaning, transformation and visualisation.
Milestones
A list of changes in R releases is maintained in various "news" files at CRAN. Some highlights are listed below for several major releases.Release | Date | Description |
0.16 | This is the last alpha version developed primarily by Ihaka and Gentleman. Much of the basic functionality from the "White Book" was implemented. The mailing lists commenced on April 1, 1997. | |
0.49 | This is the oldest source release which is currently available on CRAN. CRAN is started on this date, with 3 mirrors that initially hosted 12 packages. Alpha versions of R for Microsoft Windows and the classic Mac OS are made available shortly after this version. | |
0.60 | R becomes an official part of the GNU Project. The code is hosted and maintained on CVS. | |
0.65.1 | First versions of update.packages and install.packages functions for downloading and installing packages from CRAN. | |
1.0 | Considered by its developers stable enough for production use. | |
1.4 | S4 methods are introduced and the first version for Mac OS X is made available soon after. | |
1.8 | Introduced a flexible condition handling mechanism for signalling and handling condition objects. | |
2.0 | Introduced lazy loading, which enables fast loading of data with minimal expense of system memory. | |
2.1 | Support for UTF-8 encoding, and the beginnings of internationalization and localization for different languages. | |
2.6.2 | Last version to support Windows 95, 98, Me and NT 4.0 | |
2.11 | Support for Windows 64 bit systems. | |
2.12.2 | Last version to support Windows 2000 | |
2.13 | Adding a new compiler function that allows speeding up functions by converting them to byte-code. | |
2.14 | Added mandatory namespaces for packages. Added a new parallel package. | |
2.15 | New load balancing functions. Improved serialisation speed for long vectors. | |
3.0.0 | Support for numeric index values 231 and larger on 64 bit systems. | |
3.3.3 | Last version to support Microsoft Windows XP. | |
3.4.0 | Just-in-time compilation of functions and loops to byte-code enabled by default. | |
3.5.0 | Packages byte-compiled on installation by default. Compact internal representation of integer sequences. Added a new serialisation format to support compact internal representations. | |
3.6.0 | ||
4.0.0 |
Interfaces
The most specialized integrated development environment for R is RStudio. A similar development interface is R Tools for Visual Studio. Some generic IDEs like Eclipse, also offer features to work with R.Graphical user interfaces with more of a point-and-click approach include Rattle GUI, R Commander, and RKWard.
Some of the more common editors with varying levels of support for R include Emacs, Vim, Neovim, Kate, LyX, Notepad++, Visual Studio Code, WinEdt, and Tinn-R.
R functionality is accessible from several scripting languages such as Python, Perl, Ruby, F#, and Julia. Interfaces to other, high-level programming languages, like Java and.NET C# are available as well.
Implementations
The main R implementation is written in R, C, and Fortran, and there are several other implementations aimed at improving speed or increasing extensibility. A closely related implementation is pqR by Radford M. Neal with improved memory management and support for automatic multithreading. Renjin and FastR are Java implementations of R for use in a Java Virtual Machine. CXXR, rho, and Riposte are implementations of R in C++. Renjin, Riposte, and pqR attempt to improve performance by using multiple processor cores and some form of deferred evaluation. Most of these alternative implementations are experimental and incomplete, with relatively few users, compared to the main implementation maintained by the R Development Core Team.TIBCO built a runtime engine called TERR, which is part of Spotfire.
Microsoft R Open is a fully compatible R distribution with modifications for multi-threaded computations.
Communities
R has local communities worldwide for users to network, share ideas, and learn.There are a growing number of R events bringing its users together, such as conferences, meetups, as well as R-Ladies groups that promote gender diversity and the R Foundation taskforce on women and other under-represented groups.
useR! conferences
The official annual gathering of R users is called "useR!". The first such event was useR! 2004 in May 2004, Vienna, Austria. After skipping 2005, the useR! conference has been held annually, usually alternating between locations in Europe and North America. Subsequent conferences have included:- useR! 2006, Vienna, Austria
- useR! 2007, Ames, Iowa, USA
- useR! 2008, Dortmund, Germany
- useR! 2009, Rennes, France
- useR! 2010, Gaithersburg, Maryland, USA
- useR! 2011, Coventry, United Kingdom
- useR! 2012, Nashville, Tennessee, USA
- useR! 2013, Albacete, Spain
- useR! 2014, Los Angeles, California, USA
- useR! 2015, Aalborg, Denmark
- useR! 2016, Stanford, California, USA
- useR! 2017, Brussels, Belgium
- useR! 2018, Brisbane, Australia
- useR! 2019, Toulouse, France
- useR! 2020, St. Louis, Missouri, USA
- useR! 2021, Zurich, Switzerland
''The R Journal''
Comparison with SAS, SPSS, and Stata
R is comparable to popular commercial statistical packages such as SAS, SPSS, and Stata, but R is available to users at no charge under a free software license.In January 2009, the New York Times ran an article charting the growth of R, the reasons for its popularity among data scientists and the threat it poses to commercial statistical packages such as SAS. In June 2017 data scientist Robert Muenchen published a more in-depth comparison between R and other software packages, "The Popularity of Data Science Software".
R is more procedural-code oriented than either SAS or SPSS, both of which make heavy use of pre-programmed procedures that are built-in to the language environment and customized by parameters of each call. R generally processes data in-memory, which limits its usefulness in processing extremely large files.
Commercial support for R
Although R is an open-source project supported by the community developing it, some companies strive to provide commercial support and/or extensions for their customers. This section gives some examples of such companies.In 2007, Richard Schultz, Martin Schultz, Steve Weston and Kirk Mettler founded Revolution Analytics to provide commercial support for Revolution R, their distribution of R, which also includes components developed by the company. Major additional components include: ParallelR, the R Productivity Environment IDE, RevoScaleR, RevoDeployR, web services framework, and the ability for reading and writing data in the SAS file format. Revolution Analytics also offer a distribution of R designed to comply with established IQ/OQ/PQ criteria which enables clients in the pharmaceutical sector to validate their installation of REvolution R. In 2015, Microsoft Corporation completed the acquisition of Revolution Analytics. and has since integrated the R programming language into SQL Server 2016, SQL Server 2017, Power BI, Azure SQL Database, Azure Cortana Intelligence, Microsoft R Server and Visual Studio 2017.
In October 2011, Oracle announced the Big Data Appliance, which integrates R, Apache Hadoop, Oracle Linux, and a NoSQL database with Exadata hardware., Oracle R Enterprise became one of two components of the "Oracle Advanced Analytics Option".
IBM offers support for in-Hadoop execution of R, and provides a programming model for massively parallel in-database analytics in R.
Tibco offers a runtime-version R as a part of Spotfire.
Mango Solutions offers a validation package for R, ValidR, to make it compliant with drug approval agencies, like FDA. These agencies allow for the use of any statistical software in submissions, if only the software is validated, either by the vendor or sponsor itself.
Examples
Basic syntax
The following examples illustrate the basic syntax of the language and use of the command-line interface.In R, the generally preferred assignment operator is an arrow made from two characters
<-
, although =
can usually be used instead.> x <- 1:6 # Create vector.
> y <- x^2 # Create vector by formula.
> print # Print the vector’s contents.
1 4 9 16 25 36
> mean # Arithmetic mean of vector.
15.16667
> var # Sample variance of vector.
178.9667
> model <- lm # Linear regression model y = A + B * x.
> print # Print the model’s results.
Call:
lm
Coefficients:
x
-9.333 7.000
> summary # Display an in-depth summary of the model.
Call:
lm
Residuals:
1 2 3 4 5 6
3.3333 -0.6667 -2.6667 -2.6667 -0.6667 3.3333
Coefficients:
Estimate Std. Error t value Pr
-9.3333 2.8441 -3.282 0.030453 *
x 7.0000 0.7303 9.585 0.000662 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 3.055 on 4 degrees of freedom
Multiple R-squared: 0.9583, Adjusted R-squared: 0.9478
F-statistic: 91.88 on 1 and 4 DF, p-value: 0.000662
> par # Create a 2 by 2 layout for figures.
> plot # Output diagnostic plots of the model.
Structure of a function
One of R's strengths is the ease of creating new functions. Objects in the function body remain local to the function, and any data type may be returned.Here is an example user-created function:
- Declare function “f” with parameters “x”, “y“
- that returns a linear combination of x and y.
> f
11
> f, c)
23 18 25
> f
19 22 25
Mandelbrot set
Short R code calculating Mandelbrot set through the first 20 iterations of equation z = z2 + c plotted for different complex constants c. This example demonstrates:- use of community-developed external libraries, in this case caTools package
- handling of complex numbers
- multidimensional arrays of numbers used as basic data type, see variables
C
,Z
andX
.
install.packages # install external package
library # external package providing write.gif function
jet.colors <- colorRampPalette
dx <- 1500 # define width
dy <- 1400 # define height
C <- complex
C <- matrix # reshape as square matrix of complex numbers
Z <- 0 # initialize Z to zero
X <- array # initialize output 3D array
for
write.gif