AI Engineer Job at Expert Technology Services, Phoenix, AZ

VStLNVVlaE1kMUJBNE1Gb29xSm1TbGhycnc9PQ==
  • Expert Technology Services
  • Phoenix, AZ

Job Description

AI Engineer.

About the Role


We are seeking an experienced AIML Engineer to design, build, and operate AI/ML infrastructure and agentic systems. This role involves developing MCP servers and agents, integrating LLMs, and implementing RAG pipelines for production environments.

Key Responsibilities

Design, build and operate MCP servers and MCP agents that host, orchestrate and monitor AI/agent workloads.

Develop agentic AI, prompt engineering patterns, LLM integrations and developer tooling for production use.

Own deployment, scaling, reliability and cost-efficiency on Kubernetes/Docker and Google Cloud with automated CI/CD

Design and implement RAG (Retrieval Augmented Generation) pipelines and integrations with vector stores and retrieval tooling; use LangChain and Langfuse for orchestration, chaining, and observability.

Core Responsibilities

Implement and maintain MCP server and agent code, APIs, and SDKs for model access and agent orchestration.

Design agent behavior, workflows and safety guards for agentic AI systems.

Create, test and iterate prompt templates, evaluation harnesses and grounding/chain of thought strategies.

Integrate LLMs and model providers (self hosted and cloud APIs) with unified adapters and telemetry.

Build developer tooling: CLI, local runner, simulators, and debugging tools for agents and prompts.

Containerize services (Docker), manage orchestration (Kubernetes/GKE), and optimize nodes, autoscaling and resource requests.

Ensure observability: logging, metrics, traces, dashboards, alerting and SLOs for model infra and agents.

Create runbooks, playbooks and incident response procedures; reduce MTTR and perform postmortems.

Design and maintain RAG workflows: document chunking, embeddings, vector indexing, retrieval strategies, re ranking and context injection.

Integrate and instrument LangChain for composable chains, agents and tooling; use Langfuse (or equivalent tracing) to capture prompts, model calls, RAG traces and evaluation telemetry.

Required Skills & Experience

5+ years of Strong Software Engineering (Python/NodeJS), system design and production service experience.

2+ years of Experience with LLMs, prompt engineering, and agent frameworks.

2+ years of Experience Practical experience implementing RAG: embeddings, vector DBs and retrieval tuning.

2+ years of Experience with LangChain patterns and with toolchain telemetry (Langfuse or similar) for prompt/model traceability.

5+ years of Experience with Kubernetes, Docker, CI/CD and infrastructure as code experience.

2+ years of Experience with Practical experience with Google Cloud Platform services

2+ years of Experience with Observability, testing, and security best practices for distributed systems.

2+ years of Experience with evaluating and mitigating retrieval/augmentation failures, hallucinations, and leakage risks in RAG systems.

Familiarity with vendor and open source vector stores and embedding providers.

Familiarity with CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI, or ArgoCD).

Job Tags

Local area,

Similar Jobs

Grand River Health Main Campus

IT Help Desk Technician Job at Grand River Health Main Campus

IT Help Desk FT, DaysGrand River Health | Rifle, COAt Grand River, we are more than a hospital - we are neighbors taking care of neighbors proudly serving residents of Western Colorado and beyond. Our supportive culture is built on respect, friendliness, and a shared... 

Elevance Health

Telephonic Nurse Case Manager II Job at Elevance Health

 ...move forward in the process, you must complete the assessment within 48 hours of receipt and meet the criteria._ The Telephonic Nurse Case Manager II is responsible for care management within the scope of licensure for members with complex and chronic care needs by... 

Moda Health

​​Health Promotion & Wellness Consultant​ Job at Moda Health

 ...experiences and perspectives help us become a stronger organization. Lets be better together. Position Summary The Health Promotion and Wellness Consultant will partner with Moda Healths employer groups to consult on high-impact workplace wellness program. The... 

Blyss Journeys

Remote Client Experience Advisor Job at Blyss Journeys

 ...We are seeking a Remote Client Experience Advisor to support clients with planning, booking coordination, and general guidance all...  ...promptly Prepare and share confirmations and itineraries Review details for accuracy and completeness Provide friendly and... 

Perkins

IT Service Desk Technician Job at Perkins

 ...insurance ~ Vision insurance Job Summary: The IT Service Desk Technician acts as the face of the help desk, providing customer service and first-tier...  ...Technology, Computer Science or related field, or equivalent work experience. At least 1-2 years of experience in a...