GenAI Product Engineering Lead

We're hiring a GenAI Product Engineering Lead for a professional services firm with 60+ years of experience delivering accounting, tax, and advisory services across government, healthcare, franchise, and construction sectors.

Summary

We are seeking an accomplished and strategic GenAI Product Engineering Lead to drive the design, development, and delivery of an enterprise-grade AI platform on Microsoft Azure. This role is ideal for a technical leader with deep expertise in Generative AI, agent-based systems, and cloud-native engineering. You will lead a multidisciplinary team to build scalable, secure, and intelligent solutions that transform business operations and deliver exceptional value to clients and internal users. Your leadership will be instrumental in shaping the technical direction, fostering innovation, and ensuring operational excellence across all aspects of platform engineering.

Position Summary

Our client is a leading accounting and consulting firm and seeks an experienced and visionary GenAI Product Engineering Lead to architect, build, and scale their next-generation enterprise platform on Microsoft Azure. You will lead a multidisciplinary team of developers and engineers, driving innovation and operational excellence in building intelligent, secure, and scalable business solutions.

Technical Leadership & Team Management

• Lead, mentor, and grow a high-performing engineering team, fostering a culture of innovation, accountability, and continuous improvement.
• Establish and enforce engineering best practices, focusing on code quality, reliability, and operational efficiency.
• Set technical direction and ensure alignment with enterprise goals and standards.

Enterprise Platform Architecture

• Architect scalable, secure, and resilient AI systems on Azure (and other cloud environments as needed), working with Large Language Models (LLMs), and collaborating with cross-functional teams to integrate AI into products and processes. A strong technical foundation in areas like Python, AI/ML frameworks, and cloud platforms, combined with project management and leadership skills, are essential for this role.
• Define and enforce architectural standards, including microservices, event-driven design, and API-first principles.

Multi-Tenancy & SaaS Architecture

• Architect multi-tenant B2B environments with tenant-aware data partitions using Cosmos DB and Azure AD B2C/Entra ID to ensure data, security, and cost isolation.
• Build per-tenant vector stores, knowledge bases, and connectors to support customer-specific document ingestion and retrieval.

GenAI & Agent Integration

• Design and implement advanced GenAI solutions, including agent-based systems for automation, orchestration, and intelligent workflows.
• Integrate large language models (LLMs), Retrieval-Augmented Generation (RAG), and custom agents with business processes and user-facing applications.
• Lead design using frameworks such as Microsoft Agent Framework, Semantic Kernel, LangChain, AutoGen to build orchestration among multiple specialized agents.
• Design modular fine-tuning workflows to create tenant-aware or task-specific models that enhance personalization while maintaining shared governance and security.
• Implement automated evaluation loops to continuously improve response accuracy, tone, and compliance across tenants.
• Design agent toolkits that connect external APIs, databases, power apps, etc for automated workflows.

Model Lifecycle and LLMOps

• Lead model evaluation, tuning, and continuous improvement through RLHF, synthetic data augmentation, and automated retraining based on model drift detection.
• Monitor model performance, accuracy, and user engagement using usage analytics, while managing model, prompt, and embedding versioning for traceability and governance.
• Optimize token consumption, compute resources, and operational costs through Azure Cost Management and GenAI lifecycle best practices.

Full Stack Management

• End-to-End Application Development: Design, develop, and maintain robust, scalable, and secure full-stack web applications.
• Frontend Development: Build dynamic and responsive user interfaces using React, TypeScript, and modern state management libraries.
• Backend & API Development: Architect and implement scalable backend services and RESTful APIs using Python (with frameworks like FastAPI or Flask) and caching technologies like Redis.
• Database Management: Design and manage data models and interact with both relational (SQL) and NoSQL databases (e.g., Cosmos DB).

Data Engineering & Processing

• Lead the design and implementation of robust data ingestion, transformation, and processing pipelines using Azure Data Factory, Databricks, Synapse, or equivalent.
• Ensure data quality, governance, and compliance with enterprise and regulatory standards.
• Develop secure pipelines for fine-tuning data preparation, ensuring data labeling, anonymization, and quality scoring to meet Responsible AI standards.

Security, Compliance & Reliability

• Champion security best practices, including identity management, data protection, and compliance (e.g., SOC2, GDPR).

Stakeholder Engagement & Communication

• Act as a technical liaison between engineering, product, business, and executive teams.
• Communicate complex technical concepts clearly to non-technical stakeholders.

Required Qualifications

• Proven experience leading engineering teams in building enterprise-grade platforms on Azure.
• Deep expertise in cloud architecture, distributed systems, and scalable frameworks.
• Advanced proficiency in GenAI, agent-based systems, and LLMs. Understanding of agent frameworks and orchestration tools.
• Generative AI Expert with: Direct experience integrating LLMs (e.g., Azure OpenAI), developing RAG workflows, and using vector databases (e.g., Azure AI Search).
• Strong proficiency in languages like Python, with experience in AI/ML frameworks such as TensorFlow, PyTorch, or Keras.
• Experience with LLMs, prompt engineering, agentic flows, and foundational AI techniques.
• Experience with cloud-native development (e.g., AWS, Azure) and building scalable microservices.
• Strong fundamentals in software engineering, system architecture, and lifecycle management
• Knowledge of enterprise security, compliance, and governance standards.
• Track record of delivering large-scale, multi-tenant platforms.
• Excellent leadership, communication, and stakeholder management skills.
• Experience working in Agile, Scrum, or Kanban environments.

Preferred Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• Working knowledge of agent framework, preferably Microsoft Agent Framework.
• Understanding of API Gateway & Identity federation (Azure API Management, Entra ID multi-tenant apps).
• Experience integrating AI agent toolkits with Microsoft Power Apps.
• SaaS Experience: Experience building and supporting multi-tenant SaaS applications.
• Azure Ecosystem: Expertise with specific Azure services such as Azure AI Services, Azure App Services, Azure Functions, Azure DevOps, and Azure Kubernetes Service (AKS).
• Infrastructure as Code (IaC): Experience using IaC tools like Bicep or Terraform to manage cloud resources.
• Containerization: Proficiency with Docker and container orchestration tools like Kubernetes.
• Modern Frontend Tooling: Experience with TypeScript and state management libraries (e.g., Redux, Zustand).