OStatic Blog Cloudera and Intel Team on Accelerating Machine Learning Workloads

In recent months, countless new machine learning tools have been open sourced, including tools from tech giants such as Google. Both machine learning and AI tools tend to place tough demands on hardware resources, though. With that in mind, Cloudera has announced a jointly tested solution with Intel to advance capabilities for machine learning (ML) and artificial intelligence (AI) workloads."Benchmark tests on Cloudera with Apache Spark and the newly released Intel Math Kernel Library (Intel MKL), demonstrate the combined offering can advance machine learning performance over large data sets in less time and with less hardware," the company reports. "This helps organizations accelerate their investments in next generation predictive analytics."Cloudera is often seen as squarely focused on Hadoop, but it is also a leader in Apache Spark development, training, and services. Apache Spark has become a central tool for advancing machine learning on distributed systems.According to Cloudera:"By joining forces, Cloudera and Intel are furthering a joint mission of excellence in big data management in the pursuit of better outcomes by making machine learning smarter and easier to implement. By combining Spark, Intel MKL libraries, and Intel's optimized CPU architecture machine learning workloads can scale quickly. As machine learning solutions get access to more data they can provide better accuracy in delivering predictive maintenance, recommendation engines, proactive healthcare and monitoring, and risk and fraud detection." "There's a growing urgency to implement more rich machine learning models to explore and solve the most pressing business problems and to impact society in a more meaningful way," said Amr Awadallah, chief technical officer of Cloudera. "Already among our user base, machine learning is an increasingly common practice. In fact, in a recent adoption survey over 30% of respondents indicated they are leveraging Spark for machine learning. With constant advancements to Spark, and now through our collaboration with Intel to tap into Intel® MKL, we're confident Cloudera will continue to lead the market in advancing the use of Apache Spark for machine learning across every industry."As long-term business collaborators invested in each other's technology, expanding our efforts in AI was a logical step. Collectively, we see the future potential in AI as untapped, despite massive leaps in technology and growing implementation in recent years," said Michael Greene, vice president and general manager of the System Technologies and Optimization in Software Services Group, Intel Corporation. Together Cloudera, Intel and our ecosystem will unleash the power of AI to be faster, more expansive, and smarter from the beginning."You can also read more about the newly created benchmark. Related ActivitiesComments (0)Post a CommentAsk a QuestionRelated SoftwareSpark (add alternative, post review)Related Blog PostsIntel's BigDL: The Latest Deep Learning Tool to Go Open Source (post comment)In the 2017 Tech Job Pool, Open Source Skills Rule (1 comment)Docker and Cloudera Team on Government-Focused Tech Solutions (post comment)