AI Infrastructure Engineer vs AI Prompt / LLM Engineer: Salary & Career Benchmarks in New Zealand

In New Zealand, AI Infrastructure Engineer roles typically command a higher median salary than AI Prompt / LLM Engineer positions. According to our 2026 live benchmark data, a mid-level AI Infrastructure Engineer earns a median salary of NZ$135K, whereas a AI Prompt / LLM Engineer brings in roughly NZ$126K (a gap of NZ$9K at the median).

Seniority, tech stack, and location all move this gap. Senior practitioners in either discipline can exceed the upper range through specialist skills. See the skills premium section below for the specific certifications and tools that push offers to the top of the range.

While both positions are vital to a modern tech organisation, AI Infrastructure Engineer and AI Prompt / LLM Engineer have fundamentally different daily workflows.

AI Infrastructure Engineer focuses primarily on designing and operating the GPU and cluster infrastructure that model training and inference workloads run on. Day-to-day work revolves around provisioning GPU clusters, tuning distributed training jobs, managing model-serving infrastructure, and optimising compute cost across cloud and on-prem hardware.

AI Prompt / LLM Engineer focuses on designing, testing, and tuning prompts and retrieval pipelines that get reliable, safe output out of large language models in production applications. Their time is spent writing and version-controlling prompt templates, building evaluation harnesses to catch regressions, tuning retrieval-augmented generation (RAG) pipelines, and working with product teams to turn LLM output into a dependable feature.

Transitioning between these two paths is achievable but requires targeted upskilling.

Moving from AI Infrastructure Engineer to AI Prompt / LLM Engineer: Software engineers with strong Python skills and hands-on LLM API experience are the most common entry point; a portfolio of shipped prompt-based features or evaluation tooling is the main differentiator New Zealand employers look for.

Moving from AI Prompt / LLM Engineer to AI Infrastructure Engineer: Strong Linux, Kubernetes, and cloud infrastructure fundamentals are the entry point, with GPU scheduling and distributed training experience the main differentiator senior candidates need.

Neither path requires starting from scratch. Professionals in both roles share underlying technology fluency; the gap is usually domain knowledge and specific tooling rather than core engineering fundamentals.

In New Zealand in 2026, both roles are seeing demand, but with different drivers.

AI Infrastructure Engineer demand is very high, particularly in Data and AI teams inside Xero, Datacom, and the big Auckland and Wellington banks (ANZ, ASB, Westpac NZ), where ai infrastructure engineer work increasingly sits alongside MBIE's Digital Technologies Industry Transformation Plan push to lift the sector's economic output.. AI Prompt / LLM Engineer demand is high, concentrated in Product teams at Xero, Datacom, and Trade Me building LLM-backed features, plus a growing cluster of Auckland and Wellington SaaS companies experimenting with AI-assisted workflows, reinforced by Callaghan Innovation's AI adoption grants for smaller New Zealand tech firms..

Workspace flexibility significantly impacts total compensation value in New Zealand.

AI Infrastructure Engineer roles score 60% on our remote-friendliness index (Moderate). This is because model-building and data-pipeline work is largely asynchronous and tool-driven, and New Zealand's small local talent pool means employers routinely hire remote specialists across the country or accept candidates returning from OE (Overseas Experience) in the UK or Australia. Where in-office attendance is required, it is typically driven by cross-functional model reviews and stakeholder workshops, which Xero and the Auckland-based banks still prefer to run in person at least a couple of days a week.

AI Prompt / LLM Engineer roles score 65% (High). Prompt and evaluation work is largely asynchronous and tool-driven, and New Zealand's thin local specialist pool means Xero and Datacom both hire remote-first across the country or take candidates back from OE is the primary driver of flexibility. When office days are required, it is usually for product reviews and cross-functional evaluation sessions with design and legal stakeholders, which Xero and Trade Me still prefer to run with the team in the same Auckland or Wellington office a few days a week.