Browsing, Plugins, Images, and many more are in the video below.
As part of our ongoing mission to improve ChatGPT, we're excited to announce the gradual rollout of plugins that will expand its functionality and enhance its user experience. These plugins have been eagerly anticipated since ChatGPT's launch and will unlock numerous potential use cases.
Gradual Deployment of ChatGPT Plugins
Our iterative deployment strategy allows us to study these new features' real-world impact, use, safety, and alignment challenges. Starting with a select group of users, we plan to expand access to plugin developers, ChatGPT users, and API users over time.
Featured Plugins and Their Creators
Among the first plugins created are those from Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier. OpenAI is hosting a web browser and code interpreter plugin and has open-sourced a knowledge base retrieval plugin for developers.
Access Expansion for Users and Developers
Initially, priority will be given to a limited number of developers and ChatGPT Plus users. As we learn more and improve our safety systems, we plan to roll out larger-scale access in the coming months.
Benefits and New Use Cases of Plugins
Plugins offer the opportunity to address current limitations in language models, including outdated training data and text-only output. They can access recent or personalized information, perform safe actions upon user request, and enable novel use cases like product browsing, flight booking, or food ordering.
Safety Concerns and Mitigations
Connecting language models to external tools presents new risks, such as harmful actions, bad actor empowerment, or misaligned actions in new domains. We have conducted red-teaming exercises to identify potential issues and implemented safeguards that restrict risky plugin behavior and improve transparency in user experience.
Societal Implications of Plugins
Plugins are expected to have far-reaching effects on the economy, job transformation, displacement, and creation. We are eager to collaborate with external researchers and customers to study these impacts.
Browsing Alpha: Web Browsing for Language Models
The Browsing Alpha plugin allows ChatGPT to access up-to-date information from the internet, providing users with more accurate and relevant information. Safety measures and browsing limitations have been implemented to minimize risks.
Code Interpreter Alpha: Python Integration and File Handling
With the Code Interpreter Alpha plugin, ChatGPT can use Python in a sandboxed environment, handle file uploads and downloads, and assist users with mathematical problems, data analysis, visualization, and file conversion.
Retrieval: Open-Source Plugin for Personal and Organizational Information Access
The Retrieval plugin allows ChatGPT to access authorized personal or organizational information sources. Developers can deploy their own version of this open-source, self-hosted plugin and register it with ChatGPT.
Third-Party Plugins: Enabling Custom APIs and Capabilities
Developers can create third-party plugins using an API, an OpenAPI specification, and a manifest file. Users can enable these plugins during a conversation on chat.openai.com, allowing ChatGPT to access new features and functionality.
With this new suite of plugins, ChatGPT is poised to revolutionize how users interact with AI, making it more versatile and powerful. As we continue to learn from deployment and expand access, we look forward to building a strong community dedicated to shaping the future of human-AI interaction. Whether you're a developer, user, or researcher, we invite you to join us on this exciting journey as we push the boundaries of AI capabilities with ChatGPT and its growing range of plugins.
Embracing the potential of plugins, ChatGPT aims to overcome the limitations of traditional language models by providing access to real-time information and integrating with various third-party applications. As we broaden the availability of plugins to a wider audience, we are committed to maintaining a keen focus on safety and addressing potential risks associated with AI-powered applications.
With an expanding suite of plugins at our disposal, we hope to bring forth innovative use cases and empower users to leverage AI in unique ways. From browsing the internet for the latest news to solving complex mathematical problems or converting file formats, ChatGPT has become an indispensable tool for many tasks.
As we move forward, we recognize the importance of collaboration and welcome input from developers, researchers, and users alike. Together, we can shape the future of AI by pushing the envelope on what is possible and ensuring that ChatGPT continues to evolve in response to the ever-changing landscape of human-AI interaction. Join us as we embark on this groundbreaking journey, redefining the limits of artificial intelligence with ChatGPT and its diverse array of plugins.