# time series

In statistics, signal processing, and econometrics, a

As shown by Box and Jenkins in their book, models for time series data can have many forms and represent different stochastic processes. When modeling the mean of a process, three broad classes of practical importance are the

Among non-linear time series, there are models to represent the changes of variance along time (heteroskedasticity). These models are called autoregressive conditional heteroskedasticity (ARCH) and the collection comprises a wide variaty of representation (GARCH, TARCH, EGARCH, FIGARCH, CGARCH, etc). Recently, wavelet transform based methods (for example locally stationary wavelets and wavelet decomposed neural networks) have gained favour. Multiscale (often referred to as multiresolution) techniques decompose a given time series, attempting to illustrate time dependance at multiple scales.

is a common notation which specifies a time series

where the term ε

1.

2.

3.

If it also has a normal distribution, it is called normal white noise:

More recently there has been increased use of time series methods in geophysics (the analysis of rain fall and climate change for example). Within industry, almost every sector will in some way perform time series analysis. With retail, for example, tracking and predicting sales. Analysts will typically load their data into a statistics package ( R and S-Plus are examples of such programs). The most important step is the review of the Autocorrelation function (ACF) which indicates the number of lagged observations to be included in any time series model (one should always analyse the partial autocorrelation function as well).

In general financial series often require non-linear models (such as ARCH) as the application of autoregressive models often results in a model suggesting that to predict the value of tomorrows, lets say share price here, depends almost entirely on yesterday's share price:

(where α

Robert Engle recognised the importance of including lagged values of the series' variance. In general time series can be considered in the time domain and/or the frequency domain. This duality has led to many of the recent developments in time series analysis. Wavelet-based methods are an attempt to model series in both domains. Wavelets are compactly supported "small waves", which when convolved with the series itself (when scaled and dylated) gives a scale by scale analysis of the temporal dependance of a series. Such wavelet based methods are frequently applied for climate change problems.

One other (and less researched) area of time series analysis considers the "mining" of series to reterospectively extract knowlegde. In the literature this is referred to as time series data mining (TSDM). Techniques in this area often depend on "feature detection". In essence this is an attempt to find the "characteristic" behaviour of the series, and use this to find areas of the series which do not adhere to this behaviour. Current efforts are led by the computer science department at the University of California (Riverside).

An abstract

**time series**is a sequence of data points, measured typically at successive times, spaced at (often uniform) time intervals.**Time series**is the use of a model to predict future events based on known past events: to predict future data points before they are measured. The standard example is the opening price of a share of stock based on its past performance.*analysis**comprises methods that attempt to understand such time series, often either to understand the underlying theory of the data points (where did they come from? what generated them?), or to make forecasts (predictions).**Time series**prediction*As shown by Box and Jenkins in their book, models for time series data can have many forms and represent different stochastic processes. When modeling the mean of a process, three broad classes of practical importance are the

*autoregressive*(AR) models, the*integrated*(I) models, and the*moving average*(MA) models (the MA process is related but not to be confused with the concept of moving average ). These three classes depend linearly on previous data points and are treated in more detail in the articles autoregressive moving average models (ARMA) and autoregressive integrated moving average (ARIMA). The autoregressive fractionally integrated moving average (ARFIMA) model generalizes the former three. Non-linear dependence on previous data points is of interest because of the possibility of producing a chaotic time series.Among non-linear time series, there are models to represent the changes of variance along time (heteroskedasticity). These models are called autoregressive conditional heteroskedasticity (ARCH) and the collection comprises a wide variaty of representation (GARCH, TARCH, EGARCH, FIGARCH, CGARCH, etc). Recently, wavelet transform based methods (for example locally stationary wavelets and wavelet decomposed neural networks) have gained favour. Multiscale (often referred to as multiresolution) techniques decompose a given time series, attempting to illustrate time dependance at multiple scales.

## Notation

A number of different notations are in use for time-series analysis:is a common notation which specifies a time series

*X*which is indexed by the natural numbers. We also are accustomed to## Assumptions

There are only two assumptions from which the theory is built: The general representation of an autoregressive model well-known as AR(*p*) iswhere the term ε

_{t}is the source of randomness and is called white noise. It is assumed to have the following characteristics:1.

2.

3.

If it also has a normal distribution, it is called normal white noise:

## Related tools

Tools for investigating time-series data include:- Consideration of the autocorrelation function and the spectral density function
- Performing a Fourier transform to investigate the series in the frequency domain.
- Use of a filter to remove unwanted noise.
- Principal components analysis (or empirical orthogonal function analysis)
- Artificial neural networks
- time-frequency analysis techniques:
- Continuous wavelet transform
- Short-time Fourier transform
- Chirplet transform
- Fractional Fourier transform
- Chaotic analysis
- Correlation dimension
- Recurrence plots
- Recurrence quantification analysis
- Lyapunov exponents

## Applied time series

Time series analysis is exercised in numerous applied fields, from astrophysics to geology. Model selection is often based on the underlying assymption on the data generating process. Take, for example, traffic flow, here we would fully expect periodic behaviour (with bursts at peak travel times). In such a situation one may consider applying Dynamic Harmonic Regression (this is highly similar to airline data which is frequently analysed in the statistics literature).More recently there has been increased use of time series methods in geophysics (the analysis of rain fall and climate change for example). Within industry, almost every sector will in some way perform time series analysis. With retail, for example, tracking and predicting sales. Analysts will typically load their data into a statistics package ( R and S-Plus are examples of such programs). The most important step is the review of the Autocorrelation function (ACF) which indicates the number of lagged observations to be included in any time series model (one should always analyse the partial autocorrelation function as well).

In general financial series often require non-linear models (such as ARCH) as the application of autoregressive models often results in a model suggesting that to predict the value of tomorrows, lets say share price here, depends almost entirely on yesterday's share price:

(where α

_{1}is close to 1).Robert Engle recognised the importance of including lagged values of the series' variance. In general time series can be considered in the time domain and/or the frequency domain. This duality has led to many of the recent developments in time series analysis. Wavelet-based methods are an attempt to model series in both domains. Wavelets are compactly supported "small waves", which when convolved with the series itself (when scaled and dylated) gives a scale by scale analysis of the temporal dependance of a series. Such wavelet based methods are frequently applied for climate change problems.

One other (and less researched) area of time series analysis considers the "mining" of series to reterospectively extract knowlegde. In the literature this is referred to as time series data mining (TSDM). Techniques in this area often depend on "feature detection". In essence this is an attempt to find the "characteristic" behaviour of the series, and use this to find areas of the series which do not adhere to this behaviour. Current efforts are led by the computer science department at the University of California (Riverside).

## See also

## External links

- A First Course on Time Series Analysis - an open source book on time series analysis with SAS
- Software for Time Series Analysis
- Free online chaos theory based analysis
- Online Tutorial 'Recurrence Plot' (Flash animation); lots of examples
- A Professional Environment for Time Series and Signal Analysis
- Adaptive Harmonic Components Detection and Forecasting in Wave Non-Periodic Time Series Using Neural Networks

**Statistics**is a mathematical science pertaining to the collection, analysis, interpretation or explanation, and presentation of data. It is applicable to a wide variety of academic disciplines, from the physical and social sciences to the humanities.

**.....**Click the link for more information.

**Signal processing**is the analysis, interpretation and manipulation of signals. Signals of interest include sound, images, biological signals such as ECG, radar signals, and many others.

**.....**Click the link for more information.

**Econometrics**is concerned with the tasks of developing and applying quantitative or statistical methods to the study and elucidation of economic principles.

^{[1]}Econometrics combines economic theory with statistics to analyze and test economic relationships.

**.....**Click the link for more information.

In statistics, a

**data point**is a single*typed*measurement. Here*type*is used in a way compatible with datatype in computing; so that the type of measurement can specify whether the measurement results in a Boolean value from , an integer or real number, or some**.....**Click the link for more information.**Forecasting**is the process of estimation in unknown situations. Prediction is a similar, but more general term, and usually refers to estimation of time series, cross-sectional or longitudinal data.

**.....**Click the link for more information.

For other uses, see Model.

An abstract

**model**(or conceptual model) is a theoretical construct that represents something, with a set of variables and a set of logical and quantitative relationships between them.

**.....**Click the link for more information.

In financial markets, the

**stock capital**of a corporation or a joint-stock company is the capital raised through the issuance, sale and distribution of shares. A person or organization that holds at least a partial share of stock is called a shareholder.**.....**Click the link for more information. In econometrics, the

**Box-Jenkins**methodology, named after the statisticians George Box and Gwilym Jenkins, applies autoregressive moving average ARMA or ARIMA models to find the best fit of a time series to past values of this time series, in order to make forecasts.**.....**Click the link for more information. A

**stochastic process**, or sometimes**random process**, is the opposite of a deterministic process (or deterministic system) in probability theory. Instead of dealing only with one possible 'reality' of how the process might evolve under time (as is the case, for example, for**.....**Click the link for more information.**moving average**or

**rolling average**is one of a family of similar techniques used to analyze time series data. It is applied in finance and especially in technical analysis.

**.....**Click the link for more information.

In statistics,

**autoregressive moving average**(**ARMA**)**models**, sometimes called**Box-Jenkins models**after the iterative Box-Jenkins methodology usually used to estimate them, are typically applied to time series data.**.....**Click the link for more information. In statistics, an

**autoregressive integrated moving average (ARIMA)**model is a generalisation of an autoregressive moving average or (ARMA) model. These models are fitted to time series data either to better understand the data or to predict future points in the series.**.....**Click the link for more information. In statistics,

**autoregressive fractionally integrated moving average**models are time series models that generalize ARIMA (*autoregressive integrated moving average*) models by allowing non-integer values of the differencing parameter and are useful in modeling time series**.....**Click the link for more information.**chaos theory**describes the behavior of certain nonlinear dynamical systems that under specific conditions exhibit dynamics that are sensitive to initial conditions (popularly referred to as the butterfly effect).

**.....**Click the link for more information.

**heteroscedastic**if the random variables have different variances. The complementary concept is called homoscedasticity. (Note: The alternative spelling

*homo-*or

*heteros*is equally correct and is also used frequently.

**k**edasticity**.....**Click the link for more information.

**autoregressive conditional heteroskedasticity**(

**ARCH**, Engle (1982)) model considers the variance of the current error term to be a function of the variances of the previous time period's error terms. ARCH relates the error variance to the square of a previous period's error.

**.....**Click the link for more information.

In mathematics, a

**natural number**can mean either an element of the set (i.e the positive integers or the**counting numbers**) or an element of the set (i.e. the non-negative integers).**.....**Click the link for more information. In the mathematical sciences, a

**stationary process**(or**strict(ly) stationary process**) is a stochastic process whose probability distribution at a fixed time or position is the same for all times or positions.**.....**Click the link for more information.**Ergodic theory**, the study of ergodic transformations, grew out of an attempt to prove the ergodic hypothesis of statistical physics. Much of the early work in what is now called chaos theory was pursued almost entirely by mathematicians, and published under the title of "ergodic

**.....**Click the link for more information.

**White noise**is a random signal (or process) with a flat power spectral density. In other words, the signal's power spectral density has equal power in any band, at any centre frequency, having a given bandwidth.

**.....**Click the link for more information.

**normal distribution**, also called the

**Gaussian distribution**, is an important family of continuous probability distributions, applicable in many fields. Each member of the family may be defined by two parameters,

*location*and

*scale*: the mean ("average",

**.....**Click the link for more information.

**Autocorrelation**is a mathematical tool used frequently in signal processing for analysing functions or series of values, such as time domain signals. Informally, it is a measure of how well a signal matches a time-shifted version of itself, as a function of the amount of time shift.

**.....**Click the link for more information.

In statistical signal processing and physics, the

**spectral density**,**power spectral density**, or**energy spectral density**is a positive real function of a frequency variable associated with a stationary stochastic process, or a deterministic function of time, which has**.....**Click the link for more information.**Fourier transform**, named in honor of French mathematician Joseph Fourier, is a certain linear operator that maps functions to other functions. Loosely speaking, the Fourier transform decomposes a function into a continuous spectrum of its

*frequency components*

**.....**Click the link for more information.

*See also: Time domain*

**Frequency domain**is a term used to describe the analysis of mathematical functions or signals with respect to frequency.

**.....**Click the link for more information.

In electronics, a

**digital filter**is any electronic filter that works by performing digital mathematical operations on an intermediate form of a signal. This is in contrast to older analog filters which work entirely in the analog realm and must rely on physical networks of**.....**Click the link for more information. In science, and especially in physics and telecommunication,

**noise**is fluctuations in and the addition of external factors to the stream of target information (*signal*) being received at a detector.**.....**Click the link for more information.**Principal components analysis (PCA)**is a technique used to reduce multidimensional data sets to lower dimensions for analysis. Depending on the field of application, it is also named the discrete

**Karhunen-LoÃ¨ve transform**, the

**Hotelling transform**or

**.....**Click the link for more information.

In statistics and signal processing, the method of

**empirical orthogonal function (EOF)**analysis is a decomposition of a signal or data set in terms of orthogonal basis functions which are determined from the data.**.....**Click the link for more information. An

**artificial neural network**(ANN), often just called a "neural network" (NN), is a mathematical model or computational model based on biological neural networks. It consists of an interconnected group of artificial neurons and processes information using a connectionist approach**.....**Click the link for more information.This article is copied from an article on Wikipedia.org - the free encyclopedia created and edited by online user community. The text was not checked or edited by anyone on our staff. Although the vast majority of the wikipedia encyclopedia articles provide accurate and timely information please do not assume the accuracy of any particular article. This article is distributed under the terms of GNU Free Documentation License.