Apache Wayang

Apache Wayang is a cross-platform data processing system designed to simplify and accelerate the execution of data analytics tasks across multiple processing engines. It enables developers to write data applications once and execute them on various platforms such as Apache Spark, Flink, Java Streams, and PostgreSQL, without changing the core logic. Wayang supports ultra-fast, federated in-situ data processing and is framework-agnostic, making it ideal for heterogeneous data environments.

Features

• Cross-platform execution with minimal code changes
• Federated in-situ data processing up to 150x faster than centralized platforms
• Support for multiple backends including Spark, Flink, Java Streams, JDBC, and PostgreSQL
• Modular architecture for extensibility and integration
• Benchmarking tools for performance evaluation
• Security features aligned with Apache standards

Capabilities

• Seamless migration of applications across data processing engines
• Execution of complex data workflows in hybrid environments
• Optimization of resource usage through intelligent backend selection
• Support for both batch and stream processing
• Integration with existing data infrastructure and tools

Benefits

• Significant performance improvements in data processing tasks
• Reduced development and maintenance effort through code reuse
• Increased flexibility and scalability in data analytics pipelines
• Enhanced portability and interoperability across platforms
• Accelerated time-to-insight for data-driven applications