Senior Software Engineer, Developer Experience (AI Tools) at Coupa Software – Pune

Are you a senior engineer who gets excited about building tools that make other engineers better, faster, and smarter? Coupa Software is searching for a high-impact Senior Software Engineer to join their innovative Developer Experience and Productivity Engineering team in Pune.

This isn’t a typical product engineering role. Your mission will be to architect, build, and enhance a sophisticated internal AI orchestration platform. You will leverage Large Language Models (LLMs) and cloud-native technology (AWS) to build tools that supercharge Coupa’s entire engineering organization and integrate Coupa-specific intelligence into the development lifecycle.

Key Responsibilities

As a key member of the Developer Experience team, you will focus on building the next generation of internal AI-powered tools. Your responsibilities will include:

  • Designing and implementing a scalable architecture for AI and Model Context Protocol (MCP) tools intended for internal developer use.
  • Developing robust integration mechanisms to connect Coupa’s central AI platform with various internal systems and data sources.
  • Creating and enhancing AWS Retrieval-Augmented Generation (RAG) systems to effectively utilize Coupa’s vast institutional knowledge within AI decision-making.
  • Building secure connectors and domain-specific tools that understand Coupa’s unique operational environment.
  • Optimizing tool selection and execution to ensure efficient, accurate, and low-latency LLM interactions.
  • Collaborating with internal product managers and engineering teams to define requirements and deliver high-value productivity features.
  • Mentoring junior engineers and actively contributing to engineering best practices related to AI, cloud architecture, and system design.

What You Will Bring (Requirements)

We are looking for a senior engineer with a strong background in backend systems and a passion for AI technology.

  • Experience: 5+ years of professional software engineering experience.
  • Core Skills: Strong, expert-level proficiency in Python and extensive experience designing and building RESTful APIs.
  • Cloud Expertise: Proven experience building and deploying cloud-native applications, preferably on AWS.
  • AI Knowledge: A solid understanding of AI/ML concepts, specifically in the context of Large Language Models (LLMs) and their practical applications.
  • Architecture: Deep knowledge of software design patterns, system architecture, performance optimization, and experience integrating multiple complex systems.
  • Soft Skills: Strong analytical and problem-solving skills, combined with excellent communication abilities to explain complex technical concepts clearly.

Preferred Qualifications (Nice to Have)

  • Direct experience building AI orchestration platforms or developing developer tools for LLMs.
  • Hands-on knowledge of vector databases, embeddings, and RAG systems.
  • Familiarity with monitoring tools (like New Relic), observability patterns, or SRE practices.
  • Experience with domain-driven design (DDD) or microservices architecture.

Why Join Coupa?

  • Work on the cutting edge of AI integration (LLMs, RAG) and solve complex technical challenges with a direct business impact.
  • Join a collaborative, transparent, and innovative team culture.
  • Receive a competitive compensation package, including stock units (RSUs) and comprehensive health benefits.
  • Benefit from a culture that values work-life balance and provides Volunteer Time Off (VTO).

How to Apply

If you are a senior developer passionate about building the next generation of AI-powered developer tools, this is your role. We want to hear from you!

Click the “Apply Now” button below to submit your application.

Apply Now
Share the Post:

Entry Level Jobs