Source URL: https://cloud.google.com/blog/topics/telecommunications/revolutionizing-ai-accessibility-and-innovation-at-magyar-telekom/
Source: Cloud Blog
Title: Pluto AI: Revolutionizing AI accessibility and innovation at Magyar Telekom
Feedly Summary: In today’s rapidly evolving technological landscape, artificial intelligence (AI) stands as a transformative force, reshaping industries and redefining possibilities. Recognizing AI’s potential and leveraging its data landscape on Google Cloud, Magyar Telekom, Deutsche Telekom’s Hungarian operator, embarked on a journey to empower its workforce with AI knowledge and tools. This endeavor led to the creation of Pluto AI — an internal AI platform that has grown into a comprehensive framework for diverse AI solutions.
As one of Hungary’s largest telecommunications operators, Magyar Telekom’s ultimate vision is to embed AI into every aspect of its operations, empowering every employee to leverage AI’s potential. Pluto AI is a significant step toward achieving this goal, fostering a culture of innovation and data-driven decision-making.
Magyar Telekom’s leadership recognized that AI proficiency is now essential for future success. However, the company faced challenges, including employees with varying levels of AI understanding and a lack of accessible tools for experimentation and practical application. As a result, Magyar Telekom aimed to democratize AI knowledge and foster a culture of experimentation by building a scalable solution that could adapt to its evolving AI needs and support a wide range of use cases.
To enable business teams across Magyar Telekom to utilize generative AI, the Pluto AI team developed a simple tool that provided a safe and compliant way to prompt large language models (LLMs). They also created educational content and training for business teams on how to use gen AI and what opportunities it brings. This approach provided other teams with the building blocks to quickly construct the AI solutions they needed.
With Pluto AI, Magyar Telekom spearheaded the successful adoption of gen AI across the company, quickly expanding the platform to support additional use cases without the need for the central platform team to have a deep understanding of them.
aside_block
Developing Pluto AI
Magyar Telekom’s AI Team partnered with Google Cloud Consulting to accelerate the development of Pluto AI. This collaboration ensured that the platform was built on best practices, aligned with industry standards, and met security and compliance requirements of a regulated industry.
Here are some of the key features and functionality of Pluto AI:
1. Modular framework
Pluto AI’s modular architecture allows teams to seamlessly integrate, change, and update various AI models, tools and various architectural patterns. This flexibility enables the platform to cater to a wide range of use cases and rapidly evolve alongside Magyar Telekom’s AI strategy.
The core modules of Pluto AI include:
Large language models: Pluto AI integrates with state-of-the-art LLMs, enabling natural language understanding, text and image generation, and conversational AI applications.
Code generation and assistance: The platform supports code generation, autocompletion, and debugging, boosting developer productivity and code quality. Pluto AI provides both a coding model, accessible via its user interface, for all development levels and IDE integration for experienced coders.
API: Pluto AI’s models can be called via API, enabling all parts of Magyar Telekom to utilize and integrate AI capabilities into their existing and new solutions.
Retrieval augmented generation (RAG) with grounding capabilities: RAG combines LLMs with internal knowledge sources, including multimodal content like images and videos. This enables teams to build AI assistants that can access and synthesize information from vast datasets and add evidence like extended citations from both corporate and public data to their responses.
Customizable AI assistants: Users can create tailored, personalized AI assistants by defining system prompts, uploading documents, and fine-tuning model behavior to meet their business needs.
2. Technical implementation
Pluto AI runs on Compute Engine using virtual machines, providing scalability, reliability, and efficient resource management. The platform also utilizes foundation models from the Model Garden on Vertex AI, including Google’s Gemini, Imagen, and Veo models, Anthropic’s Claude 3.5 Sonnet, and more. Magyar Telekom also deployed ElasticSearch on Google Cloud to store the knowledge bases necessary for enabling RAG workflows.
In addition to these core components, Pluto AI also utilizes other Google Cloud services to help develop production-ready applications, such as Cloud Logging, Pub/Sub, Cloud Storage, Firestore, and Looker.
3. User interface and experience
Pluto AI’s intuitive interface makes AI tools accessible to users with varying technical expertise. A dropdown menu allows users to easily navigate between different modules and functionalities. The platform’s design prioritizes user experience, ensuring that employees can leverage AI capabilities without a steep learning curve.
Impact and adoption
Pluto AI has seen impressive adoption rates, with hundreds of daily active users across different departments. The platform’s user-friendly design and practical applications have garnered positive feedback from Magyar Telekom employees.
In addition, Pluto AI has enabled the development of various AI assistants, including legal and compliance assistants that accelerate contract review, identify compliance risks, and analyze legal documents. Knowledge management assistants have enhanced knowledge sharing and retrieval across the organization, while software development has benefited from code generation and assistance tools. Additionally, AI-powered chatbots that handle routine inquiries have significantly improved customer support experiences.
Magyar Telekom has seen quantifiable results since rolling out Pluto AI. These include hundreds of daily unique users, tens of thousands of API calls, an estimated 20% reduction in the time spent reviewing legal documents, and a 15% decrease in code defects.
Vision and future roadmap for Pluto AI
Magyar Telekom sees Pluto AI as a key part of its AI strategy going forward. To maximize its impact, the company intends to expand the platform to more markets, business units, and departments within the organization. Additionally, Magyar Telekom is looking into the possibility of offering Pluto AI as a service or a product to other Deutsche Telekom markets. The company is also planning to build a library of reusable AI modules and frameworks that can be easily adapted to different use cases.
Magyar Telekom is pursuing several key initiatives to enhance Pluto AI and expand its capabilities. These efforts include investigating the potential of agent-based AI systems to automate complex tasks and workflows, adding a language selector for multilingual support to cater to a diverse user base, and developing an enhanced interface for managing RAG solutions, monitoring usage, and tracking performance metrics. Magyar Telecom also plans to continue developing dashboards for monitoring and optimizing cloud resource usage and costs.
Pluto AI has transformed Magyar Telekom’s AI landscape, making AI accessible, practical, and impactful. By providing a user-friendly platform, fostering experimentation, and delivering tangible business value, Pluto AI has set a new standard for internal AI adoption.
AI Summary and Description: Yes
**Summary:** The text discusses Magyar Telekom’s implementation of Pluto AI, an internal AI platform that enhances organizational capabilities through generative AI tools and large language models. It highlights the platform’s modular architecture and user-friendly interface, which empower employees to utilize AI effectively across various business functions. This initiative reflects a significant stride towards democratizing AI knowledge and fostering innovation within the company.
**Detailed Description:**
Magyar Telekom has undertaken a transformative initiative by developing Pluto AI, a comprehensive internal AI platform built in collaboration with Google Cloud Consulting. This effort aims to leverage AI’s potential to empower employees, streamline operations, and foster a culture of data-driven decision-making. The platform signifies significant advancements in the integration of AI technologies within a regulated industry.
**Key Points:**
– **Modular Framework:**
– Pluto AI features a modular architecture that allows for the integration, modification, and updating of various AI models and tools.
– This flexibility supports a wide array of use cases, enabling the platform to adapt alongside Magyar Telekom’s evolving AI strategies.
– **Core Features:**
– **Integration of Large Language Models (LLMs):** The platform utilizes advanced LLMs for natural language processing, text and image generation, and conversational applications.
– **Code Generation and Assistance:** Pluto AI supports code generation and debugging, enhancing the productivity of developers at all skill levels.
– **API Accessibility:** Models can be accessed via API, encouraging seamless integration of AI capabilities across all operations within Magyar Telekom.
– **Retrieval-Augmented Generation (RAG):** Combines LLMs with internal databases to create AI assistants capable of accessing and synthesizing large volumes of data.
– **Customizable AI Assistants:** Users can personalize their AI assistants to meet specific business requirements.
– **Technical Implementation:**
– Pluto AI operates on Google Cloud’s Compute Engine, providing reliability and scalable resource management.
– Runs various foundation models from Google’s Model Garden and utilizes services like ElasticSearch for knowledge management.
– **User Interface and Experience:**
– Designed to be intuitive and user-friendly, enabling employees of varying technical expertise to harness AI capabilities easily.
– Navigation is simplified through a dropdown menu, catering to diverse user needs.
– **Impact and Adoption:**
– The platform has witnessed significant daily user engagement, with positive feedback highlighting its practical value.
– Pluto AI has facilitated the development of various AI applications, including legal compliance assistants and AI chatbots aimed at enhancing customer support.
– Quantifiable benefits have emerged, such as a 20% reduction in legal document review time and a 15% decrease in software code defects.
– **Future Roadmap:**
– Magyar Telekom aims to expand Pluto AI to additional markets and business units while considering offering it as a service to other Deutsche Telekom entities.
– Future plans include the development of multilingual support, enhanced monitoring interfaces, and resource usage optimization dashboards.
Overall, Pluto AI represents a significant advancement in AI adoption within Magyar Telekom, transforming the way employees interact with AI by making it accessible and practical, and serves as a model for internal AI initiatives in similarly structured organizations.