Senior Software Engineer (Python) at Ailevate

About Us 

At Ailevate, we believe AI should do the work—not create more of it. Our platform powers fully autonomous AI agents that operate behind the scenes, eliminating friction, resolving tasks in real time, and recovering revenue with zero manual intervention. 
 
Built for businesses that demand more from their technology, Ailevate delivers secure, on-prem, and cost-effective AI solutions that quietly transform operations. No hand-holding. Just results. From denial management in healthcare to operational workflows across industries, we’re making AI as effortless—and powerful—as it should be. 

Your Role 

As a Senior Software Engineer (Python) on the Agentic Platform team, you will help architect and implement the foundational systems that power Ailevate’s LLM-based AI Agents. This platform serves as the technical backbone for all AI-driven services across the organization, setting the standards for scalability, performance, and maintainability. 

In this role, you’ll design and deliver high-performance microservices for real-time AI execution, contribute to our core AI services (including RAG pipelines, multi-worker orchestration, and inference layers), and enforce platform-wide standards around API contracts, system design, and infrastructure automation. 

You’ll work closely with AI researchers, cloud infrastructure engineers, and other platform contributors to ensure that all services meet strict performance, reliability, and security benchmarks. As the Agentic Platform evolves, your work will also help define the development guidelines and operational best practices used across every AI initiative at Ailevate. 

This is a hands-on, impact-driven role where you’ll contribute to critical backend services that allow AI Agents to reason, automate, and interact with external data systems in real time. 

Your Responsibilities 

• Develop, optimize, and scale backend services using Python and FastAPI. 

• Design and implement microservices for LLM-powered AI Agents, focusing on real-time processing, inference, and decision-making. 

• Integrate LLM APIs (OpenAI, Anthropic, vLLM, etc.) to power AI-driven insights and automation. 

• Enhance our Retrieval-Augmented Generation (RAG) pipeline, enabling AI Agents to retrieve, process, and synthesize knowledge. 

• Implement messaging and event-driven workflows using RabbitMQ. 

• Fine-tune and optimize LLMs using TensorFlow and PyTorch as the platform evolves. 

• Deploy and manage AI workloads on Kubernetes, ensuring scalability and high availability. 

• Collaborate with infrastructure and DevOps teams to streamline CI/CD pipelines and cloud-based deployments. 

• Write well-structured, maintainable, and testable code following best practices. 

• Mentor junior engineers and contribute to technical decision-making.

Requirements

Required Skills & Experience 

• 5+ years of Python software development experience. 

• Strong experience with FastAPI (or Flask) for building scalable APIs. 

• Experience with LLMs, NLP, and AI-driven applications. 

• Experience integrating LLM APIs such as OpenAI, Anthropic, or vLLM. 

• Proficiency in microservices architecture and distributed systems. 

• Familiarity with frameworks such as TensorFlow and PyTorch and model optimization techniques. 

• Experience with SQL and NoSQL databases such as Elasticsearch or PostgreSQL. 

• Cloud experience with Azure, AWS, or GCP, along with CI/CD automation. 

• Proficiency in containerization with Docker and orchestration using Kubernetes. 

• Experience with event-driven architectures using RabbitMQ or similar message brokers. 

• Strong problem-solving and debugging skills with a focus on performance optimization. 

Nice-to-Have 

• Experience fine-tuning LLMs and optimizing inference workloads. 

• Familiarity with Neo4j, graph databases, or knowledge graphs. 

• Contributions to open-source AI or LLM projects. 

• Understanding of vector databases such as Elasticsearch, Weaviate, or Pinecone. 

• Experience in healthcare, fintech, or other highly regulated industries. 

Benefits

Why Join Us? 

We’re not just building software—we’re building a new way of working. At Ailevate, you’ll join a team of engineers, product leaders, and go-to-market pros who are all working toward one shared mission: making AI autonomous, accessible, and impactful. 
 
Whether you’re developing new features, scaling adoption, or shaping our brand—you’ll be part of a high-impact team focused on solving big problems with bold ideas. We move fast, support each other, and stay laser-focused on results. 

What You’ll Get 

• Fully remote role—work from wherever you do your best work 

• Early-stage startup environment where your impact is immediate 

• Competitive salary and early equity ownership 

• Collaborative, execution-driven culture across teams 

• Access to AI technologies and projects that are reshaping industries 

• Full benefits through Ankura, including medical, dental, vision, 401(k), PTO, and more