Opensource Spark, Data Streaming, Data Engineering Solutions For AI

Supermicro Solutions using Opensource

The Challenge

There is a tremendous amount of information driven by the ever changing applications, from structured, unstructured, to semi-structure data. Conventional IT infrastructure is not built to handle the variety, velocity and volume of the data produced by social media networks, mobile applications, machine sensors and scientific researches, etc. For Enterprises, utilizing big data analytics is no longer a question of when, it is a question of how. Spark and other open-source software, designed for the cost effective storage and processing of large volumes of data, are born for this purpose. It can linearly scale up to thousands of servers and petabytes of storage.

For service providers and opensource savvy customers, who can manage and maintain opensource implementation of Spark and associated data streaming and data engineering software, Supermicro simplifies Kubernetes cluster deployment with reliable systems that have both in-band and out-of-band management and by offering a wide choice of system platforms that fit into customers data centers.

The Solution and Supermicro Advantage

Supermicro server clusters support opensource with simplified Kubernetes deployment.

• SYSTEM CHOICE: Customers can choose the best hardware platform to build clusters
  • Rack-mount CloudDC/Hyper systems or multi-node Twin servers, or Blade servers
  • Choice of CPU architectures, either Intel or AMD enterprise CPUs
  • Choice of GPU accelerators for applications such as Spark acceleration
  • Choice of disks from HDD to SSD to NVMe drives
  • Choice of network architectures, 10GbE to 400 GbE options
  • All managed by same IPMI / Redfish interfaces, and can be aggregated by the single-pane Supermicro Cloud Composer
  • Many of the deployment can be automated using Supermicro Super Cloud Orchestrator
• IMPLEMENTATION CHOICE: Customers can deploy on either bare-metal implementation, Red Hat OpenShift, Kubernetes, or virtual machine implementations
• SCALABILITY: Customers can start with the smallest cluster and scale by adding servers.
• AUTOMATION: Supermicro can build the cluster, fully tested with guaranteed build quality, and delivery schedule. The software implementation can be deployed using the automation features of Supermicro Cloud Orchestrator