Counting 3,663 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Author
Last Commit
Mar. 23, 2019
Created
Apr. 21, 2014

Siddhi

Jenkins Build Status GitHub (pre-)release GitHub (Pre-)Release Date GitHub last commit License

Siddhi is a Streaming and Complex Event Processing engine that listens to events from data streams, detects complex conditions described via a Streaming SQL language, and triggers actions.

Overview

Siddhi supports:

  • Streaming data integration

    • Retrieving data from various event sources (Kafka, NATS, JMS, HTTP, CDC, etc)
    • Map events to and from multiple event formats (JSON, XML, Text, Avro, etc)
    • Data preprocessing & cleaning
    • Joining multiple data streams
    • Integrate streaming data with databases (RDBMS, Cassandra, HBase, Redis, etc)
    • Integrate with external services
    • Publish data to multiple event sinks (Email, JMS, HTTP, etc)
  • Streaming data analytics

    • Generating alerts based on thresholds
    • Calculate aggregations over a short windows (time, length, session, unique, etc) or a long time period
    • Calculate aggregations over long time periods with seconds, minutes, hours, days, months & years granularity
    • Correlating data while finding missing and erroneous events
    • Detecting temporal event patterns
    • Analyzing trends (rise, fall, turn, tipple bottom)
    • Run pretreated machine learning models (PMML, Tensorflow)
    • Learn and predict at runtime using online machine learning models
  • Adaptive Intelligence

    • Static rule processing
    • Stateful rule processing
    • Decision making through synchronous stream processing
    • Query tables, windows and aggregations
  • And many more ... For more information, see Patterns of Streaming Realtime Analytics

Siddhi is free and open source, under Apache Software License v2.0.

Get Started!

Get started with Siddhi in a few minutes by following the Siddhi Quick Start Guide

Why use Siddhi ?

If you are a Siddhi user, we would love to hear more.

Develop Siddhi using IntelliJ IDEA

Install IDEA plugin to get the following features:

  • Siddhi Query Editor with syntax highlighting and with basic auto completion
  • Siddhi Runner and Debugger support to test Siddhi Application

Try Siddhi with WSO2 Stream Processor

WSO2 Stream Processor is a server version of Siddhi that is also released under Apache Software License v2.0. It was a Strong Performer in The Forrester Wave: Big Data Streaming Analytics, Q1 2016 (Report) and a Cool Vendors in Internet of Things Analytics, 2016.

If you use WSO2 Stream Processor, you can use the Siddhi functionality with the following additional features:

  • The Siddhi Query Editor tool with syntax highlighting and advanced auto completion support
  • The Siddhi Runner and Debugger tool
  • The Event Simulator tool
  • Run Siddhi as a server with high availability and scalability.
  • Monitoring support for Siddhi
  • Realtime dashboard
  • Business user-friendly query generation and deployment

There are domain specific solutions built using Siddhi, including Fraud Detection, Stock Market Surveillance, Location analytics, Proximity Marketing, Contextual Recommendation, Ad Optimization, Operational Analytics, and Detecting Chart Patterns.

For more information please contact us via http://wso2.com/support/.

Siddhi Versions

  • Active development version of Siddhi : v5.0.0-SNAPSHOT built on Java 8 & 11.

    Find the released Siddhi libraries here.

    Siddhi Query Guide for Siddhi v5.x.x

    Architecture of Siddhi v5.x.x

  • Latest Stable Release of Siddhi v4.x.x : v4.4.8 built on Java 8. (Recommended for production use)

    Find the released Siddhi libraries here.

    Siddhi Query Guide for Siddhi v4.x.x

    Architecture of Siddhi v4.x.x

  • Latest Stable Release of Siddhi v3.x.x : v3.2.3 built on Java 7.

    Find the released Siddhi libraries here.

    Siddhi Query Guide for Siddhi v3.x.x

Latest API Docs

Latest API Docs is 5.0.0-m4.

How to Contribute

Build from the Source

Prerequisites

Steps to Build

  1. Get a clone or download source from Github

    git clone https://github.com/siddhi-io/siddhi.git
  2. Run the Maven command mvn clean install from the root directory

Contact us

Support

  • We are committed to ensuring support for Siddhi (with its extensions) and WSO2 Stream Processor from development to production.
  • Our unique approach ensures that all support leverages our open development methodology and is provided by the very same engineers who build the technology.
  • For more details and to take advantage of this unique opportunity, contact us via http://wso2.com/support/.

Siddhi was joint research project initiated by WSO2 and University of Moratuwa, Sri Lanka.

Latest Releases
v4.4.10
 Mar. 21 2019
v4.4.9
 Mar. 14 2019
v5.0.0-m4
 Mar. 4 2019
v5.0.0-m3
 Mar. 3 2019
v5.0.0-m2
 Feb. 25 2019