The RAPIDS™ Accelerator for Apache Spark is a plug-in that leverages RAPIDS libraries and GPUs to accelerate data processing and machine learning pipelines on Apache Spark. It transforms existing pipelines without any code change.

Features

• Faster Execution Time: Accelerate the performance of data preparation tasks to train AI models faster and speed up analytics.
• Reduced Infrastructure Costs: Complete jobs faster with less hardware compared to CPUs, saving time and costs.
• Quick Time to Value: Experience benefits quickly with no required code changes. Tools identify the best jobs for GPU acceleration and calculate optimal configurations.
• Data Processing Scalability: Enhance compute infrastructure to process vastly more data.
• AI Pipelines: Accelerate operations with GPUs for quicker time to training and significant infrastructure cost reductions.
• Faster Analytics: Work with up-to-date information and get insights faster.

Benefits

• Enhanced Performance: Significantly faster performance with NVIDIA-accelerated Spark 3 compared to running Spark on CPUs.
• Cost Efficiency: Reduced infrastructure costs and quicker time to value.
• Scalability: Ability to handle growing volumes of data efficiently.
• AI Optimization: Optimized configurations for maximum performance using AI.
• Flexibility: Suitable for various use cases including business process analytics, data warehousing, and machine learning pipelines.