Joint solution reduces wall clock time by 5X for long running jobs
CAMPBELL, Calif. – August 11, 2020 – WekaIO™ (Weka), an innovation leader in high-performance, scalable file storage for data-intensive applications, together with Destiny Corporation, a business and technology consultancy specializing in SAS (an integrated software suite for advanced and predictive analytics, business intelligence, and data management) analytics and a SAS Institute gold partner, have published a reference design that is capable of delivering 5X runtime and wall clock time improvements for SAS analytics long running jobs, while also providing among the best storage economics. The solution is available on-premises as well as on Amazon Web Services (AWS). Most of the Fortune Global 1000 companies rely on SAS analytics to power their businesses and transform data into intelligence.
Although SAS solutions are architected to take optimal advantage of multi-core CPUs, their performance and scale are often constrained by access to volumes of data and storage I/O responsiveness. Even today’s leading on-premises and cloud storage solutions cannot keep up with modern CPU and server capabilities. As a result, SAS Grid and SAS Viya application servers remain vastly underutilized when operating across large data sets as they wait for data to be served from the storage system.
“Digital transformation is forcing organizations to modernize their IT operations, but inefficient application logic and performance limitations due to long-running jobs, processes, and pipelines negatively impacts the potential for business growth. Modernization is critical to overcoming challenges such as the better utilization, scalability, and stability of application servers, which fall over when trying to keep up with the storage performance and capacity demands. Our SAS analytics reference design solves these challenges and transforms data analytics for a more agile environment,” said Shailesh Manjrekar, WekaIO’s head of AI and strategic alliances.
“As a trusted advisor to our clients, we always look for new methods and technologies to help our clients improve their analytics work. Destiny chose to partner with WekaIO because we like the disruptive capabilities of this technology. They elegantly solve our clients’ problems with no change needed to the SAS code,” said Dana Rafiee, managing director at Destiny Corporation.
The reference design comprises SAS application servers configured either with SAS Foundation, SAS Grid, or SAS Viya software. These servers connect over Infiniband or 100Gbit Ethernet to a storage system running the Weka File System (WekaFS™), the world’s fastest parallel file system, delivering enhanced performance at any scale while offering enterprise readiness. The shared storage system starts at eight storage nodes with local NVMe drives, either from our leading OEM partners (on-premises) or Amazon Elastic Compute Cloud (Amazon EC2) instances (cloud), and can scale to hundreds of nodes, depending on the throughput requirements. In addition, WekaFS seamlessly integrates object storage for the best economics on multi-petabyte data sets. The starting reference design can scale from one SAS client running 32 concurrent sessions to 8 clients running 256 concurrent sessions, WekaFS measures up to 106GB/sec of mixed Read/Write bandwidth, while only taking 320 SAS cores to achieve this performance. The reference design is tuned to ensure the SAS application cores are not waiting for storage I/O and are fully utilized, without wasting any expensive compute cycles.
This reference design can be deployed either on-premises, on AWS, or as a hybrid cloud to get similar results. WekaFS matches the parallelism of the SAS Grid compute environment to enable the highest data loads and ETL (extract, transform, and load) processing while providing enterprise data management capabilities to SAS workloads.
“Using this reference design, organizations will be able to consolidate more users and workloads with the same SAS licensing in place, delivering exceptional economic value. Not only will this improve time to market and business outcomes, but it will eliminate racks of server infrastructure for a significantly improved total cost of ownership. The reference design leverages object storage data lakes to extend the file namespace and provide the best economics leveraging flash and HDD media,” added Manjrekar.
“Data-driven applications using SAS analytics are increasing in volume and complexity. With Weka and Destiny Corporation providing a reference design, customers have access to a validated solution that enables predictive and cognitive analytics in financial services (FSI), risk management, IoT, and healthcare markets,” said Amita Potnis, research director at IDC, Enterprise Infrastructure Practice.
For a complimentary SAS health-check, go to: https://www.weka.io/hpda/
Additional resources:
- SAS Analytics Solutions Brief
- Blog: Why Cloud ready SAS Analytics solution from Weka and Destiny Corp?
For more information on Destiny Corporation, go to: https://www.destinycorp.com/
To find an OEM partner in the WekaIO Innovation Network, go to https://www.weka.io/partners/ or email us at partners@weka.io.
WekaIO solutions are available through the AWS Marketplace: https://amzn.to/39K1wQa
About WekaIO
Weka offers WekaFS, the modern parallel file system that uniquely empowers organizations to solve the newest, biggest problems holding back innovation. Optimized for NVMe and the hybrid cloud, Weka handles the most demanding storage challenges in the most data-intensive technical computing environments, delivering truly epic performance at any scale. Its modern architecture unlocks the full capabilities of today’s data center, allowing businesses to maximize the value of their high-powered IT investments. Weka helps industry leaders reach breakthrough innovations and solve previously unsolvable problems. For more information on WekaFS, go to https://www.weka.io/products.
WekaIO, WekaFS, Weka AI, Weka Innovation Network, Weka Within, Weka AI logo, WIN logo, Weka Within logo, and the WekaIO logo are trademarks of WekaIO, Inc.
Media Contact
WEKA Communications
media.relations@weka.io
