Senior AI Infrastructure Engineer

Inference & Optimization  |  Montreal (hybrid-friendly)  |  Full-time  |  Founding team

About CarbonForge

AI adoption is accelerating, but the infrastructure required to run AI models remains expensive, energy-intensive, and increasingly difficult to scale. Organizations are spending millions on GPU capacity while struggling to maximize the performance of the hardware they already have.

CarbonForge exists to solve this problem.

Founded by AI researchers and entrepreneurs from Mila, CarbonForge is building technology that helps organizations run AI models faster, more energy-efficient, and at lower cost. Our platform enables AI teams to get more value from their existing GPU infrastructure by increasing performance, reducing latency, and lowering energy consumption-without requiring them to rebuild their AI systems.

Backed by VC funding and entering an exciting growth stage, CarbonForge is a team of experts helping shape the future of scalable, cost-effective, and sovereign AI infrastructure.

The role

Reporting to the Chief Technology Officer, we are seeking a Senior AI Infrastructure Engineer to design, build, and operate large‑scale infrastructure that powers AI inference workloads on public cloud and on-prem.

As a founding team member and individual contributor, you will carry significant influence combining strong software engineering skills with deep systems and cloud expertise to deliver secure, scalable, reliable and efficient platforms for serving AI models.


What you’ll do

• Build and manage Cloud infrastructure on GCP, AWS, Azure and On-Prem infrastructures for internal and external needs.

• Build and Manage our Infrastructure Lab

• Benchmark AI Inference workloads

• Support customers in the deployment of our solution for their infrastructure

• Build and run infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users

• Build monitoring systems to ensure the highest quality service for our customers

What we’re looking for

• 5+ years of professional experience in AI infrastructure or a related field

• Experience with Ansible, Terraform, and Kubernetes

• Experience with Agentic workflows required

• Experience with Helm

• Experience with Ray, RayClusters, KubeRay

• Proficiency in Python

• Experience shipping LLM serving systems at scale in production environments

• Experience building and supporting APIs

• Experience developing and operating scalable platforms

• Bachelor's degree in Computer Science or a related field, or equivalent practical experience

On credentials

No PhD required. We care about what you’ve shipped and what you can prove on a GPU. A pull request closes the loop faster than a CV.

Why join CarbonForge

• Mission that compounds. Power is the binding constraint for AI deployment this decade. You’ll build the layer that makes every joule count — and every token more useful.

• World-class science bench. Work alongside two Canada CIFAR AI Chairs and core Mila researchers: Pierre-Luc Bacon (UdeM, scientific co-founder) and Christophe Dubach (McGill, scientific advisor). Full support of Mila, Canada’s leading AI research institute, with access to its talent pipeline and research bench.

• Real hardware from day one. H100, H200, AMD MI-series, and design-partner engagements already in motion.

• Resources to match the ambition. Seed-funded by strong operator and institutional investors. We have the resources to hire the best, give them the compute they need, and run the long experiments that matter. Founding-engineer equity, direct ownership, no bureaucracy - your code reaches production in weeks, not quarters.

• Remote-friendly. Montreal preferred for regular in-person work with the founding team.

A note on fit

If not every bullet above describes you perfectly, apply anyway. We’re hiring for trajectory and proof of work, not a checklist. What matters is whether you can ship the outcomes we’ve described and push us to be better at the work.

CarbonForge is committed to building a team where the best engineers want to work, from any background. We welcome applicants from all origins, identities, and paths into this field. Equal opportunity employer.