Ajay Raut : A Technology Leader Powering Cloud Journeys For The Future Of The AI Era
Ajay Raut
Technology Leader, AI Cloud Architect
As Senior Director and Cloud Architect at Krutrim, he led initiatives to design and deploy advanced cloud infrastructure for AI-powered, homegrown chips, accelerating India’s progress in intelligent computing and edge applications. Ajay’s visionary strategies at Krutrim laid the foundation for scalable, resilient platforms, and his technical acumen continues to redefine modern cloud architectures in the e-commerce sector.
Ajay sharpened his tech prowess through InMobi and Flipkart, India's first two unicorns of the internet economy. From constructing massive cloud and data center infrastructure that powered the global business of InMobi to assisting Flipkart technologically transform and scale during its initial Big Billion Day sale, he has been at the cutting edge of things throughout his career.
After Flipkart, he also co-founded a deep-tech startup focused on edge computing, where he navigated the full lifecycle of entrepreneurship, from ideation and prototyping to securing pre-seed funding, pitching to global investors, and working with early customers across fintech, e-Commerce, and OTT. He has also completed two postgraduate programs in addition to his engineering degree and management education at IIM.
With more than 20 years of experience, he continues to spearhead high-scale AI cloud projects, such as designing the next -generation infrastructures of international vendors. We are delighted to engage in an exclusive conversation with Ajay, who walks us through his journey, leadership approach, and future.
What strategies do you use to ensure effective know -
ledge transfer of cloud best practices within your organization?
We ensure effective knowledge transfer and cloud best practices through a system-driven approach focused on transparency and continuous validation against intended design. Using orchestrated life cycles with feedback loops, we enable auto-remediation and minimize manual inter vention.
From a reliability perspective, we apply observability to validate system behaviour in real time, leveraging Infrastructure as Code (Terraform) workflow engines and orchestration layers integrated with our observability stack—ensuring automation, consis - tency, scalability, and faster turn around critical for AI cloud environments.
How do you ensure the technology strategy aligns with the organization’s business goals?
Technology stacks must always align with business use cases. In e-Commerce, the focus is on performance to handle traffic spikes; in FinTech, it's privacy, security, and regulatory compliance.
In my current role, building an AI cloud stack, the priority is governance and self service, enabling users to run workloads, monitor, and manage billing independently. Across industries, tech choices evolve to meet business goals while enabling use cases effectively.
How do you foster a culture of innovation and colla - boration within your team?
I foster innovation by emphasizing autonomy and mentorship over micro- management. Engineers take ownership of their domains, automate repetitive tasks, and focus on creative problem-solving. With a flat structure and guided mentorship, I enable professionals to grow, make independent decisions, and drive impactful solutions.
How do you guide your team to navigate day-to-day challenges?
The biggest challenge is balancing speed with quality in deliveries. Engineers often face trade-offs between adopting new technologies and maintaining required standards, which can cause delays. Startups unlike larger organizations with extensive planning and testing cycles, demand a “fail fast” approach. This requires greater
We ensure effective knowledge transfer and cloud best practices through a system-driven approach focused on transparency and continuous validation against intended design. Using orchestrated life cycles with feedback loops, we enable auto-remediation and minimize manual inter vention.
From a reliability perspective, we apply observability to validate system behaviour in real time, leveraging Infrastructure as Code (Terraform) workflow engines and orchestration layers integrated with our observability stack—ensuring automation, consis - tency, scalability, and faster turn around critical for AI cloud environments.
Leverage both wisdom and experience to understand and adapt to these new waves of technology
How do you ensure the technology strategy aligns with the organization’s business goals?
Technology stacks must always align with business use cases. In e-Commerce, the focus is on performance to handle traffic spikes; in FinTech, it's privacy, security, and regulatory compliance.
In my current role, building an AI cloud stack, the priority is governance and self service, enabling users to run workloads, monitor, and manage billing independently. Across industries, tech choices evolve to meet business goals while enabling use cases effectively.
How do you foster a culture of innovation and colla - boration within your team?
I foster innovation by emphasizing autonomy and mentorship over micro- management. Engineers take ownership of their domains, automate repetitive tasks, and focus on creative problem-solving. With a flat structure and guided mentorship, I enable professionals to grow, make independent decisions, and drive impactful solutions.
How do you guide your team to navigate day-to-day challenges?
The biggest challenge is balancing speed with quality in deliveries. Engineers often face trade-offs between adopting new technologies and maintaining required standards, which can cause delays. Startups unlike larger organizations with extensive planning and testing cycles, demand a “fail fast” approach. This requires greater
flexibility, quicker decision-making, and alignment with the broader vision. Keeping up with it and still making sure that the delivery is timely without significant sacrifice of quality becomes an important element of the learning curve.
What plans do you have for the future?
I previously worked at a stealth AI cloud startup, focusing on building an AI cloud stack. Currently, I am developing a complete stack for agentic AI and GenAI workloads, covering both training and inference, and overseeing end-to-end architecture to support diverse models like LLMs and GenAI.
With over 20 years of experience in infrastructure, platforms, and cloud technologies, my aspiration is to build a deep-tech company from India, one where the product itself is the technology—delivering world-class, home grown innovations.
What advice would you give to aspiring technology leaders?
The technology landscape, particularly in cloud and related fields, is evolving rapidly, and it is crucial for industry leaders to keep pace. Continuous learning is essential, as the changes never stop.
My advice would be to leverage both wisdom and experience to understand and adapt to these new waves of technology. Leaders are uniquely positioned to grasp emerging trends and apply them effectively to solve diverse business problems.
The key responsibility is to bridge the gap between evolving technologies and real business use cases, ensuring that new innovations are harnessed in meaningful ways. This requires staying adaptable, embracing lifelong learning, and consistently aligning new technology with business needs.
Ajay Raut, Technology Leader, AI Cloud Architect
Ajay’s tech leadership at Coupang, and previously at Krutrim, is redefining India’s place in the global advanced computing landscape. With over two decades of experience, he now drives the development of homegrown AI-focused chips and next-generation cloud infra - structure, positioning India at the forefront of deep-tech innovation.
•Hobbies: Cricket and spending time with family
•Favorite Travel Destination: India
•Favorite Cui- sine: Maharashtrian
•Favorite Book: Jonathan Livingston Seagull by Richard Bach
What plans do you have for the future?
I previously worked at a stealth AI cloud startup, focusing on building an AI cloud stack. Currently, I am developing a complete stack for agentic AI and GenAI workloads, covering both training and inference, and overseeing end-to-end architecture to support diverse models like LLMs and GenAI.
With over 20 years of experience in infrastructure, platforms, and cloud technologies, my aspiration is to build a deep-tech company from India, one where the product itself is the technology—delivering world-class, home grown innovations.
What advice would you give to aspiring technology leaders?
The technology landscape, particularly in cloud and related fields, is evolving rapidly, and it is crucial for industry leaders to keep pace. Continuous learning is essential, as the changes never stop.
My advice would be to leverage both wisdom and experience to understand and adapt to these new waves of technology. Leaders are uniquely positioned to grasp emerging trends and apply them effectively to solve diverse business problems.
The key responsibility is to bridge the gap between evolving technologies and real business use cases, ensuring that new innovations are harnessed in meaningful ways. This requires staying adaptable, embracing lifelong learning, and consistently aligning new technology with business needs.
Ajay Raut, Technology Leader, AI Cloud Architect
Ajay’s tech leadership at Coupang, and previously at Krutrim, is redefining India’s place in the global advanced computing landscape. With over two decades of experience, he now drives the development of homegrown AI-focused chips and next-generation cloud infra - structure, positioning India at the forefront of deep-tech innovation.
•Hobbies: Cricket and spending time with family
•Favorite Travel Destination: India
•Favorite Cui- sine: Maharashtrian
•Favorite Book: Jonathan Livingston Seagull by Richard Bach