Amazon releases new compiler for AI frameworks

Author Topic: Amazon releases new compiler for AI frameworks  (Read 2933 times)

Offline farzanaSadia

  • Full Member
  • ***
  • Posts: 127
  • Test
    • View Profile
Amazon releases new compiler for AI frameworks
« on: October 11, 2017, 07:38:12 PM »
Amazon is addressing artificial intelligence development challenges with a new end-to-end compiler solution. The NNVM compiler, developed by AWS and a team of researchers from the University of Washington’s Allen School of Computer Science & Engineering, is designed for deploying deep learning frameworks across a number of platforms and devices.

“You can choose among multiple artificial intelligence (AI) frameworks to develop AI algorithms. You also have a choice of a wide range of hardware to train and deploy AI models. The diversity of frameworks and hardware is crucial to maintaining the health of the AI ecosystem. This diversity, however, also introduces several challenges to AI developers,” Mu Li, a principal scientist for AWS AI, wrote in a post.

According to Amazon, there are three main challenges AI developers come across today: switching between AI frameworks, maintaining multiple backends, and supporting multiple AI frameworks. The NNVM compiler addresses this by compiling front-end workloads directly into hardware back-ends. “Today, AWS is excited to announce, together with the research team from UW, an end-to-end compiler based on the TVM stack that compiles workloads directly from various deep learning frontends into optimized machine codes,” Li wrote. The TVM stack, also developed by the team, is an intermediate representation stack designed to close the gap between deep learning frameworks and hardware backends.

“While deep learning is becoming indispensable for a range of platforms — from mobile phones and datacenter GPUs, to the Internet of Things and specialized accelerators — considerable engineering challenges remain in the deployment of those frameworks,” said Allen School Ph.D. student Tianqi Chen. “Our TVM framework made it possible for developers to quickly and easily deploy deep learning on a range of systems. With NNVM, we offer a solution that works across all frameworks, including MXNet and model exchange formats such as ONNX and CoreML, with significant performance improvements.”

The NNVM compiler is made up of two components from the TVM stack: NNVM for computation graphs and TVM for tensor operators, according to Amazon.

“NNVM provides a specification of the computation graph and operator with graph optimization routines, and operators are implemented and optimized for target hardware by using TVM. We demonstrated that with minimal effort this compiler can match and even outperform state-of-the-art performance on two radically different hardware: ARM CPU and Nvidia GPUs,” Li wrote. “We hope the NNVM compiler can greatly simplify the design of new AI frontend frameworks and backend hardware, and help provide consistent results across various frontends and backends to users.”
:)

Offline Nusrat Jahan Momo

  • Full Member
  • ***
  • Posts: 159
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #1 on: November 19, 2017, 10:59:24 AM »
good note.

Offline mushfiq.swe

  • Full Member
  • ***
  • Posts: 109
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #2 on: November 21, 2017, 07:21:02 PM »
Thank you for sharing such important information.
Muhammad Mushfiqur Rahman
Lecturer, Dept. of SWE,
FSIT, DIU.

Offline anwar.swe

  • Full Member
  • ***
  • Posts: 180
  • Lecturer, Dept. Software Engineering
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #3 on: November 23, 2017, 03:30:15 PM »
Thank you for sharing this information
Nd. Anwar Hossen
Senior Lecturer
Mentor, IEEE DIU Student Branch
Department of Software Engineering, FSIT
Daffodil International University

Offline SSH Shamma

  • Sr. Member
  • ****
  • Posts: 364
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #4 on: November 28, 2017, 12:29:48 AM »
Thanks for sharing
Syeda Sumbul Hossain
Lecturer, SWE
Daffodil International University
Contact No. 01918455555

Offline Tasnim_Katha

  • Full Member
  • ***
  • Posts: 119
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #5 on: May 06, 2019, 06:11:21 PM »
Thanks for sharing with us.

Offline tasnim.eee

  • Hero Member
  • *****
  • Posts: 506
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #6 on: June 23, 2019, 04:23:48 PM »
 :) :)

Offline lamisha

  • Full Member
  • ***
  • Posts: 100
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #7 on: July 06, 2019, 01:28:55 AM »
worth sharing

Offline Asif Khan Shakir

  • Full Member
  • ***
  • Posts: 123
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #8 on: July 06, 2019, 02:43:32 AM »
Thanks for sharing with us.

Offline maruf.swe

  • Sr. Member
  • ****
  • Posts: 472
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #9 on: February 26, 2020, 12:55:54 AM »
good post, Thanks for sharing

Offline moyez

  • Newbie
  • *
  • Posts: 12
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #10 on: February 28, 2020, 03:04:59 AM »
Good Post

Offline Dipty Rahman

  • Full Member
  • ***
  • Posts: 102
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #11 on: February 29, 2020, 10:37:04 AM »
Important breakthrough.
Dipty Rahman
Lecturer
Department of English
Daffodil International University

Offline SSH Shamma

  • Sr. Member
  • ****
  • Posts: 364
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #12 on: February 29, 2020, 07:43:55 PM »
Thanks for sharing
Syeda Sumbul Hossain
Lecturer, SWE
Daffodil International University
Contact No. 01918455555

Offline Raihana Zannat

  • Sr. Member
  • ****
  • Posts: 392
  • Test
    • View Profile
Re: Amazon releases new compiler for AI frameworks
« Reply #13 on: March 01, 2020, 04:08:22 PM »
Thank you for sharing
Raihana Zannat
Senior Lecturer
Dept. of Software Engineering
Daffodil International University
Dhaka, Bangladesh