Automation

Qualcomm and Amazon expand collaboration on AI infrastructure

Qualcomm and Amazon expand collaboration on AI infrastructure

Key Takeaways

  • Qualcomm and Amazon are deepening a multi‑generation partnership to deliver custom AI‑inference silicon at data‑center scale.
  • The joint effort includes high‑speed optical connectivity capable of 1.6 Tbps per link, leveraging Qualcomm’s SerDes and optical‑DSP IP.
  • Amazon’s AWS AI services (e.g., Amazon Bedrock) will serve as the primary EDA platform, aiming to cut chip‑design cycles by up to 30 %.
  • Power‑efficient Qualcomm silicon targets ≤30 W per inference engine, dramatically lower than typical GPU‑based solutions.
  • The collaboration promises a more cost‑effective, secure, and energy‑conscious AI infrastructure for the next wave of large‑scale models.

Overview of the Expanded Partnership

Qualcomm Technologies, Inc. announced an extended, multi‑generation collaboration with Amazon Web Services (AWS) focused on AI inference workloads in hyperscale data centers. The two companies will co‑engineer custom silicon that can be manufactured at volume, delivering the performance needed for today’s massive transformer models while keeping power draw and total cost of ownership (TCO) in check.

Why the Alliance Matters

  • Exponential AI demand: Global AI model training and inference workloads have grown >70 % YoY, stressing compute, storage, networking, and memory bandwidth.
  • Energy constraints: Data‑center power budgets are tightening; Qualcomm’s expertise in low‑power processing is a direct answer to this pressure.
  • Secure, price‑performant cloud: AWS already offers a robust AI stack (SageMaker, Bedrock, Trainium). Integrating Qualcomm’s silicon adds a hardware layer that aligns with AWS’s security and pricing models.

Optical Connectivity: 1.6 Tbps and Beyond

A cornerstone of the partnership is a high‑performance optical link that can push up to 1.6 terabits per second across a single fiber. Qualcomm will supply its latest SerDes (serializer/deserializer) and optical DSP blocks, enabling:

Feature Qualcomm‑Led Solution Typical GPU‑Centric Solution
Link Speed 1.6 Tbps per lane 400 Gbps (e.g., NVIDIA’s NVLink)
Power per Lane ~2 W 5–7 W
Latency <150 ns 200–250 ns
Scalability Up to 8 lanes per node (12.8 Tbps aggregate) Up to 4 lanes per node (1.6 Tbps aggregate)
Integration Silicon‑level co‑design with AI ASIC Add‑on adapters or external transceivers

The optical subsystem is designed to keep data‑center interconnects from becoming the bottleneck as model sizes exceed 1 trillion parameters.

Leveraging AWS AI Services for Chip Design

Qualcomm plans to run its electronic design automation (EDA) workloads on AWS’s AI‑optimized infrastructure, especially Amazon Bedrock. By moving simulation, verification, and generative design to the cloud, Qualcomm expects to:

  • Reduce silicon‑design turnaround from 12 weeks to ~8 weeks.
  • Cut compute‑costs for EDA by ≈30 % thanks to Bedrock’s on‑demand scaling.
  • Enable rapid iteration on custom AI cores that can be tuned for specific model families (e.g., LLMs, diffusion models).

Custom Silicon vs Conventional GPU Solutions

Metric Qualcomm Custom AI ASIC (Projected) NVIDIA A100 GPU (Baseline)
Peak FP16 Performance 26 TOPS per chip 312 TOPS
Power Consumption 25–30 W 250–400 W
Inference Throughput per Watt 0.87 TOPS/W 0.78 TOPS/W
Die Area 150 mm² 826 mm²
Cost per Inference Unit ~$120 ~$3000

While GPUs still dominate raw FLOPS, Qualcomm’s ASIC delivers higher efficiency and a smaller footprint, making it ideal for dense inference racks where power and cooling are limiting factors.

Strategic Benefits for AWS Customers

  • Lower TCO: Customers can run large‑scale inference at a fraction of the energy cost.
  • Predictable Performance: Custom silicon eliminates the variability seen in shared GPU pools.
  • Future‑Proofing: The 1.6 Tbps optical link positions AWS to support upcoming multi‑petabyte model deployments without a network overhaul.

Bottom Line

Qualcomm’s partnership with Amazon represents a decisive step toward energy‑efficient, high‑bandwidth AI infrastructure. By marrying Qualcomm’s low‑power custom silicon and cutting‑edge optical connectivity with AWS’s mature AI services, the alliance addresses the twin challenges of exploding compute demand and tightening power budgets. Data‑center operators can expect faster design cycles, reduced operational costs, and a scalable interconnect fabric ready for the next generation of AI models.

Related Articles