Nvidia Takes Deep Learning to School

发布时间:2017-05-10 00:00
作者:Ameya360
来源:EE Times
阅读量:1868

  Deep learning is "transforming computing" is the message that Nvidia hopes to hammer home at its GPU Tech conference. On that theme, Nvidia has styled itself as a firebrand, catalyst and deep learning enabler and — in the long run — a deep profiteer.

  Among the telltale signs that Nvidia is betting its future on this branch of artificial intelligence (AI) is the recent launch of its “Deep Learning Institute,” with plans increase the number of developers to 100,000 this year. Nvidia trained 10,000 developers in deep learning in 2016.

  Over the last few years, AI has made inroads into “all parts of science,” said Greg Estes, Nvidia’s vice president responsible for developer programs. AI is becoming an integral component of “all applications ranging from cancer research, robotics, manufacturing to financial services, fraud detection and intelligent video analysis,” he noted.

  Nvidia wants to be known as the first resort for developers creating apps that use AI as a key component, said Estes.

  “Deep learning” is in the computer science curriculum at many schools, but few universities offer a degree specifically in AI.

  At its Deep Learning Institute, Nvidia plans to deliver “hands-on” training to “industry, government and academia,” according to Estes, with a  mission to “help developers, data scientists and engineers to get started in training, optimizing, and deploying neural networks to solve the real world problems in diverse disciplines.”

  How can you fit AI into apps?

  Kevin Krewell, principal analyst at Tirias Research, told EE Times, “The challenge of Deep Learning is that it’s just hard to get started and figuring out how to fit it into traditional app development.”

  He noted, “I think Nvidia is trying to get a wider set of developers trained on how to fit machine learning (ML) into existing development programs. Unlike traditional programs where algorithms are employed to perform a task, ML is a two-stage process with a training phase and a deployment phase.”

  Nvidia’s edge is that “Machine learning performs better with an accelerator like a GPU, rather than relying just on the CPU,” Krewell added.

  As Nvidia readies its Deep Learning Institute, the company is also entering a host of partnership deals with AI “framework” communities and universities. Among them are Facebook, Amazon, Google (Tensor Flow), the Mayo Clinic, Stanford University and Udacity.

  Such collaborations with framework vendors are critical, because every developer working on AI apps needs to have cloud and deep learning resources.

  As Jim McGregor, principal analyst at Tirias Research, told us, “The most difficult thing for app developers are the cloud resources and large data sets. As an example, the mobile suppliers are promoting machine learning on their devices, but to develop apps for those devices you need cloud/deep learning resources and the data sets to train those resources, which the mobile players are not providing.”

  Nvidia can provide the hardware resources and a mature software model, but “developers still need the service provider and data sets,” McGregor added.

  According to Nvidia, the company is also working with Microsoft Azure, IBM Power and IBM Cloud teams to port lab content to their cloud solutions.

(备注:文章来源于网络,信息仅供参考,不代表本网站观点,如有侵权请联系删除!)

在线留言询价

相关阅读
NVIDIA Reportedly Halves Vera Rubin SOCAMM Capacity as Memory Costs Near 29% of System BOM
  Rising memory costs are prompting AI hardware vendors to rethink their product strategies. According to Wccftech, citing analysis from GF Securities, NVIDIA is reportedly reducing the memory capacity of its Vera Rubin NVL72 rack-scale AI system to cope with elevated memory prices and ongoing supply shortages. Without these adjustments, memory could account for around 29% of the Vera Rubin VR200 system’s estimated US$2.1 million bill of materials (BOM), well above NVIDIA’s preferred level of 20%.  The cost burden is significant. Wccftech, citing an earlier Bernstein report, notes that a single Vera Rubin NVL72 rack could cost as much as US$9.1 million, with memory accounting for a significant share of the cost. Bernstein also forecasts HBM4 pricing to rise to US$53 per GB by 2027.  To lower costs and ease supply constraints, NVIDIA may adopt 96GB SOCAMM modules for each Vera CPU in its Vera Rubin NVL72 racks, down from the previously planned 192GB, the report says. As a result, total Vera CPU memory would decline from about 55TB to 28TB, while GPU HBM4 capacity would remain unchanged at 20.7TB per rack.  The revised memory configuration could deliver significant savings. As noted by Wccftech, GF Securities originally estimated LPDDR5X costs for the VR200 at around US$1.2 million based on the original memory configuration. Under the revised configuration, the cost is estimated to fall to around US$586,000 and could decline further to as low as US$293,000 if memory capacity is reduced to one-quarter.  According to a press release released by TrendForce in early June, based on preliminary allocation plans from Samsung, SK hynix, and Micron, NVIDIA is expected to receive enough LPDRAM to meet only about 60% of its estimated demand, with limited room for further increases. As a result, the company may reduce the SOCAMM memory configuration of its Vera Rubin Superchip platform to increase Vera CPU production and mitigate the risk of prolonged supply shortages.  Strengthening Long-Term Memory Partnerships  As NVIDIA navigates these cost and supply challenges, it is also strengthening its long-term partnerships with South Korea’s memory industry. According to Tom’s Hardware, NVIDIA and SK Group signed letters of intent formalizing a strategic partnership valued at more than US$500 billion. The collaboration spans multiple areas, including a long-term memory supply agreement with SK hynix that was announced in June.
2026-07-29 13:48 阅读量:296
NVIDIA Enters PC Market with RTX Spark Featuring MediaTek-Co-Designed N1X CPU on TSMC 3nm
  As traditional CPU leaders such as Intel push further into the AI accelerator market, NVIDIA is moving in the opposite direction—leveraging its dominance in AI computing to expand into the PC processor arena. At GTC Taipei on June 1, CEO Jensen Huang unveiled the NVIDIA RTX Spark, developed in partnership with Microsoft and powered by the new Arm-based N1X processor co-designed with MediaTek, according to NVIDIA and CNBC.  According to CNBC, the initial rollout will include more than 30 notebook models and 10 desktop systems. RTX Spark-powered devices from Microsoft, Dell, HP, ASUS, Lenovo, and MSI are expected to debut this fall, marking NVIDIA’s first large-scale push into the Windows PC CPU market.  CNBC adds that the platform combines NVIDIA’s Blackwell GPU architecture with the N1X CPU and 128GB of unified memory, bringing data center-class AI capabilities to personal computers. Notably, the new PC processor will be manufactured using TSMC’s 3nm process, which is currently produced exclusively in Taiwan, according to CNBC.  More Spec Details  Interestingly, as noted by The Verge, the flagship RTX Spark mirrors the DGX Spark almost exactly — 20 CPU cores, 6,144 GPU cores, 128GB of LPDDR5X memory — though NVIDIA plans to release leaner, more affordable variants, with some configurations dropping to just 16GB of RAM.  Meanwhile, NVIDIA has provided additional details on the platform’s performance. According to The Verge, with up to 128GB of unified memory—on par with AMD’s previous-generation Strix Halo—RTX Spark laptops and desktops are also capable of hosting AI agents with up to 120 billion parameters, a capability Microsoft appears eager to integrate into Windows.  Powered by RTX Spark, NVIDIA claims the system can render a 90GB 3D scene, edit 12K video, or run graphically intensive titles like Indiana Jones and the Great Circle at a smooth 100fps in 1440p—all within a 14mm-thin laptop operating without being plugged into power, the report adds.  CNBC, citing an NVIDIA spokesperson, reports that RTX Spark is described as being “roughly equivalent” to the company’s flagship RTX 5070 laptop GPU.  NVIDIA is certainly not the only player eyeing to expand its CPU footprint. As noted by CNBC, Apple now designs its own Arm-based processors for Mac computers, having rolled out a higher-end MacBook lineup powered by its latest M5 chips in March. In the same month, Arm unveiled its first in-house CPU, with Meta reportedly serving as the launch customer for the Arm AGI CPU, according to TechCrunch.
2026-06-02 10:29 阅读量:1092
NVIDIA Reportedly Plans GPU-Direct Storage for Vera Rubin, Raising Expectations for HBF Beyond HBM
  As AI models continue to scale, HBM may struggle to meet future memory-capacity demands, prompting industry experts to view GPU-driven storage architectures as a potential next frontier. According to The Elec, NVIDIA and Amazon are reportedly advancing storage architectures that allow GPUs to directly control storage devices such as SSDs. NVIDIA is said to plan the introduction of GPU-Initiated Direct Storage Access (GIDS) starting with its Vera Rubin AI platform, a shift that could accelerate the emergence of high-bandwidth flash (HBF), the report notes.  Citing Song Ki-hwan, a professor in the Department of System Semiconductor Engineering at Yonsei University, the report explains that GIDS goes beyond existing GPU Direct Storage (GDS) architecture. Under GDS, CPUs issue data requests to storage devices before data is transferred to GPUs. GIDS advances this by allowing GPUs to access storage directly, bypassing CPUs and DRAM.  Both GIDS and GDS aim to overcome data-transfer bottlenecks tied to traditional von Neumann computing architectures. Microsoft and AMD are also said to be exploring similar approaches. The report, citing Song, adds that traditional data-transfer methods are inefficient because CPUs are structurally limited in thread processing, while GPUs can generate tens of thousands of parallel threads. Song also notes that GPU-HBM data transfer already accounts for roughly half of total system power, strengthening the case for HBF architectures that place ultra-fast NAND closer to GPUs to address future AI bottlenecks.  GIDS Could Accelerate HBF and Expand NAND’s Role in AI Memory  The emergence of GIDS could allow NAND storage to take on a larger role in AI memory systems while easing pressure on HBM capacity. As the report notes, this shift would require higher-performance NAND flash capable of keeping pace with GPU processing speeds. One proposed approach is high-bandwidth flash (HBF), which stacks NAND flash vertically in a structure similar to HBM and connects it using through-silicon vias (TSVs).  The report notes that NAND flash offers roughly 30 times higher bit density than DRAM, enabling far greater memory capacity in a similar footprint. According to Song, combining six HBF units with two HBM units could increase GPU memory capacity more than 16 times, from 192GB to 3,120GB, potentially supporting AI models with parameter sizes around 16 times larger than current architectures.  Still, NAND flash has endurance limits, typically supporting only around 100,000 write-and-erase cycles versus DRAM’s near-unlimited write capability. As a result, HBF is seen as better suited for storing AI model parameters, which remain largely unchanged during inference and function as read-only workloads.  Meanwhile, memory makers have also been exploring GPU-driven memory architectures. According to an Edaily report last year, sources said Samsung Electronics is actively researching next-generation high-performance Z-NAND. The company is also developing GIDS technology that would allow GPUs to directly access Z-NAND-based storage devices. If implemented, GPUs would be able to access Z-NAND devices without intermediaries, potentially shortening processing times for AI workloads.
2026-05-20 11:20 阅读量:1829
NVIDIA Confirms Development of “Compliance Chips” for the Chinese Market
  According to IJIWEI’s report, NVIDIA recently confirmed that it is actively working on new “compliant chips” tailored for the Chinese market. However, these products are not expected to make a substantial contribution to fourth-quarter revenue.  On November 21, during NVIDIA’s earnings briefing for the third quarter of 2024, executives acknowledged the significant impact of tightened U.S. export controls on AI. They anticipated a significant decline in data center revenue from China and other affected countries/regions in the fourth quarter. The controls were noted to have a clear negative impact on NVIDIA’s business in China, and this effect is expected to persist in the long term.  NVIDIA’s Chief Financial Officer, Colette Kress, also noted that the company anticipates a significant decline in sales in China and the Middle East during the fourth quarter of the 2024 fiscal year. However, she expressed confidence that robust growth in other regions would be sufficient to offset this decline.  Kress mentioned that NVIDIA is collaborating with some customers in China and the Middle East to obtain U.S. government approval for selling high-performance products. Simultaneously, NVIDIA is attempting to develop new data center products that comply with U.S. government policies and do not require licenses. However, the impact of these products on fourth-quarter sales is not expected to materialize immediately.  Previous reports suggested that NVIDIA has developed the latest series of computational chips, including HGX H20, L20 PCIe, and L2 PCIe, specifically designed for the Chinese market. These chips are modified versions of H100, ensuring compliance with relevant U.S. regulations.  As of now, Chinese domestic manufacturers have not received samples of H20, and they may not be available until the end of this month or mid-next month at the earliest. IJIWEI’s report has indicated that insiders have revealed the possibility of further policy modifications by the U.S., a factor that NVIDIA is likely taking into consideration.
2023-11-23 13:24 阅读量:4454
  • 一周热料
  • 紧缺物料秒杀
型号 品牌 询价
RB751G-40T2R ROHM Semiconductor
TL431ACLPR Texas Instruments
BD71847AMWV-E2 ROHM Semiconductor
MC33074DR2G onsemi
CDZVT2R20B ROHM Semiconductor
型号 品牌 抢购
IPZ40N04S5L4R8ATMA1 Infineon Technologies
STM32F429IGT6 STMicroelectronics
TPS63050YFFR Texas Instruments
BP3621 ROHM Semiconductor
ESR03EZPJ151 ROHM Semiconductor
BU33JA2MNVX-CTL ROHM Semiconductor
热门标签
ROHM
Aavid
Averlogic
开发板
SUSUMU
NXP
PCB
传感器
半导体
相关百科
关于我们
AMEYA360微信服务号 AMEYA360微信服务号
AMEYA360商城(www.ameya360.com)上线于2011年,现 有超过3500家优质供应商,收录600万种产品型号数据,100 多万种元器件库存可供选购,产品覆盖MCU+存储器+电源芯 片+IGBT+MOS管+运放+射频蓝牙+传感器+电阻电容电感+ 连接器等多个领域,平台主营业务涵盖电子元器件现货销售、 BOM配单及提供产品配套资料等,为广大客户提供一站式购 销服务。

请输入下方图片中的验证码:

验证码