Skip to main content

External opportunity

Large Language Model Architect

Bengaluru, India Full-time
Apply for this role

Added 7 Nov 2026 · Engineering

Job description

Project Role : Large Language Model Architect Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data. Must have skills : Large Language Models (LLMs) Good to have skills : NA Minimum 18 year(s) of experience is required Educational Qualification : 15 years full time education Summary: We are building out a world-class AI Delivery and Architecture team and are looking for exceptional engineers who want to shape how enterprise AI systems are designed, built, and operated at scale. This is a senior hands-on technical role that sits at the intersection of cloud engineering, LLM/GenAI application development, and AI infrastructure platform design. You will drive architecture decisions, lead delivery across complex multi-cloud AI programs, and act as a force multiplier for the engineers around you. You will be equally at home writing production Python, reviewing infrastructure-as-code, and presenting architecture trade-offs to senior stakeholders. Roles & Responsibilities: - Architect and deliver end-to-end GenAI solutions Define the AI roadmap for our key customers Design RAG pipelines, agentic workflows, and multi-model orchestration patterns that go beyond prototypes into production-grade systems. Lead technical design and governance Own Architecture Decision Records , run design reviews, establish engineering standards, and ensure solutions are reusable and maintainable across teams. Drive AI infrastructure platform engineering Build and scale model-serving infrastructure (Bedrock, Vertex AI, Azure OpenAI), and AI gateway/routing layers. Strong system integration Skills Own multi-cloud delivery Architect and deliver across AWS, Azure, and GCP using IaC (Terraform/Pulumi), Kubernetes (EKS/AKS/GKE), and GitOps workflows. Embed observability and LLMOps from day one Instrument AI systems with OpenTelemetry, LLM-specific tooling , token/cost dashboards, and drift detection. Champion responsible AI and security Implement guardrails, output filtering, prompt injection defenses, data residency controls, and OWASP LLM Top 10 mitigations. Mentor and grow the team Guide engineers through complex technical challenges, lead code and architecture reviews, and help set the bar for engineering quality. Translate strategy into delivery Work closely with product, data science, and business stakeholders to turn AI objectives into executable technical roadmaps. Professional & Technical Skills: 12+ years of software engineering experience, with at least 2 years in AI/ML or GenAI delivery in production environments. Demonstrated track record of leading end-to-end delivery of complex, multi-cloud AI solutions — not just prototypes. Prior experience as a tech lead or principal engineer who had managed 10+ engineers . Core engineering Advanced Python — packaging, production-grade code quality. Go or Java/Kotlin for platform and infrastructure services (advantageous). REST, gRPC, event-driven architecture (Kafka / Kinesis), clean architecture and domain-driven design. LLM & GenAI engineering Prompt engineering RAG pipeline design — chunking strategies, embedding models, vector stores Knowledge graph design Agentic frameworks — LangChain, LlamaIndex, AutoGen, or equivalent Fine-tuning experience — LoRA, QLoRA, PEFT dataset curation and evaluation. – vry good to have LLM evaluation frameworks — RAGAS, LLM-as-judge, regression testing, quality gates. Cloud & infrastructure Deep expertise in at least one of AWS, Azure, and GCP — compute, networking, IAM, storage. Kubernetes (EKS, AKS, GKE) IaC — Terraform (primary) Pulumi or AWS CDK also valued. Architecture & leadership Ability to produce and communicate architecture artefacts — ADRs, solution design documents — to technical and non-technical audiences. Well-Architected Framework knowledge across cloud providers. Responsible AI — guardrails, PII redaction, output filtering, OWASP LLM Top 10, AI Act / GDPR awareness. Strong FinOps sensibility — cost governance, token cost optimization, multi-cloud spend visibility. Additional Information: Cloud certifications — AWS Solutions Architect Pro, Azure AI Engineer, Google Professional ML Engineer. Experience with AI ethics, model cards, bias auditing, or fairness testing. Background in platform engineering or building internal developer platforms (IDPs). Exposure to service mesh (Istio / Linkerd) and API gateway patterns for AI microservices. Experience working in regulated industries (finance, healthcare, public sector). 15 years full time education Important Notice We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at india.fc.check@accenture.com immediately. Equal Employment Opportunity Statement All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
Pay, skills & work eligibility

Compensation

A clear compensation amount was not identified. Ask the employer for the range, currency, pay period and whether it covers base pay or total compensation.

Location, eligibility & working hours

Listed work location
Bengaluru, India
Visa sponsorship
Not stated clearly
Relocation support
Not stated clearly
Working hours / time zone
Not stated clearly
Work authorization wording
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by

Remote does not automatically mean work from any country. A location match does not confirm work authorization, sponsorship or relocation eligibility.

Requirements at a glance

Experience mentioned: 12+ years

PythonJavaKotlinAWSAzureGoogle CloudKubernetesTerraform

Named skills identified in the listing. A mention is not always a requirement; read the full description and employer conditions.

Location & work arrangement

Listed work locations

  • Bengaluru, India

Explore related jobs