Senior Platform AI Engineer

  • R10407
  • Pune, India

Overview

We are looking for a hybrid AI Platform Engineer to lead the design of high-performance prompts and the development of custom AI agents and integrations across our internal platforms. Collaborating closely with our AI Platform Manager and functional business units, this role bridges the creative precision of prompt engineering with the technical fluency required to build and deploy powerful LLM-based tools using APIs, system integrations, and emerging AI infrastructure.

Key Responsibilities

  • Prompt Engineering & Optimization

    • Design, test, and refine prompts for general and use-case-specific applications.

    • Evaluate and improve LLM output quality based on accuracy, latency, hallucination, and user satisfaction.

    • Maintain a scalable prompt library with robust documentation and experimentation tracking.
       

  • Custom Agent & GPT Development

    • Build and maintain custom GPTs (via OpenAI) or Google Agents (Gemini, Vertex AI).

    • Configure tools, memory, system prompts, and API-calling capabilities for agent workflows.

    • Ensure agents follow internal data governance and compliance policies.
       

  • API & Platform Integration

    • Integrate LLM functionality into internal systems (e.g., dashboards, Slack, CRMs, internal portals).

    • Work with APIs from OpenAI, Google Cloud, Azure, and others to create functional pipelines.

    • Support rapid prototyping and deployment of AI features in close coordination with product and automation teams.
       

  • Evaluation & Instrumentation

    • Define key performance metrics (quality, reliability, usage patterns).

    • Collaborate with data engineering to log, analyze, and visualize LLM performance.

    • Implement feedback loops to continuously optimize prompt and agent behavior.
       

  • Enablement & Documentation

    • Provide tooling and guidance to business users and product teams for prompt-based workflows.

    • Contribute to internal AI playbooks and best practices around prompt usage and API integration.

Requirements

  • 5+ years of experience in AI/ML, NLP applications, or full-stack product development

  • Hands-on experience with OpenAI APIs, Google Cloud Vertex/Gemini, or similar platforms

  • Strong experience with prompt engineering and LLM evaluation methods

  • Proficiency in Python and working with APIs, JSON, and vector databases

  • Familiarity with LangChain, LlamaIndex, or custom agent frameworks

  • Excellent collaboration and communication skills

Security and Compliance
Rapid7 is committed to keeping customers secure. As a first line of defense, all employees are expected to uphold the highest standards of security and privacy, ensuring the protection of sensitive information and compliance with relevant regulations.

Apply Now

Not You?

We have emailed you a code to verify your identity. Please check your spam/junk folder if you don't receive the email in your inbox.

Application loading...

 

Jobs you may be interested in

Senior Manager, Paid Media

R10516 United States United States Marketing Marketing Full_time JOB_LEVEL-3-30
Senior Manager, Paid Media Are you a Paid Media expert with B2B SaaS experience ready to make a significant impact? We're looking for someone to drive customer acquisition, retention, and revenue by leading the design, execution, and optimization ...

Senior Sales Trainer

R10528 Boston MA United States Boston, MA, United States Business Support Sales Full_time JOB_LEVEL-3-24
Senior Sales Trainer  As a Senior Sales Trainer at Rapid7, you will be a key part of the Growth Enablement organization at Rapid7. You will be responsible for co-owning the administration, management, and execution of the global new hire onboardi...

Sr. Security Engineer, IT Infrastructure

R10408 Pune India Pune, India Information Security Information Security Full_time JOB_LEVEL-3-24
Obsessed with security? Are you looking for a new opportunity to channel your security expertise into building, integrating, and automating security controls across cloud and on-premise environments? Do you find yourself daydreaming about novel wa...

Senior Software Engineer - Golang / Cloud Security

R10040 Prague Czechia Prague, Czechia Product & Engineering Development Engineering Full_time JOB_LEVEL-3-24
As a Senior Software Engineer, you will own a full life cycle of development and be a senior contributor on a team responsible for the end-to-end delivery of increasingly complex features that are correctly implemented and high quality. You will t...

Apply Now

Not You?

We have emailed you a code to verify your identity. Please check your spam/junk folder if you don't receive the email in your inbox.

Application loading...