In the meantime another hot news.
Microsoft опубликовал работу про прикольную мультимодальную языковую модель (Multimodal Large Language Model, MLLM) под названием Kosmos-1. Мультимодальность в том, что кроме текста на вход модель может принимать картинки и звук (в текущей версии только картинки), и решать множество разных задач, включая image captioning, OCR-free NLP, мультимодальный диалог, visual question answering, классификацию изображений по инструкциям.
Language Is Not All You Need: Aligning Perception with Language Models
https://arxiv.org/abs/2302.14045
Microsoft опубликовал работу про прикольную мультимодальную языковую модель (Multimodal Large Language Model, MLLM) под названием Kosmos-1. Мультимодальность в том, что кроме текста на вход модель может принимать картинки и звук (в текущей версии только картинки), и решать множество разных задач, включая image captioning, OCR-free NLP, мультимодальный диалог, visual question answering, классификацию изображений по инструкциям.
Language Is Not All You Need: Aligning Perception with Language Models
https://arxiv.org/abs/2302.14045
🔥17👍2
Good news! The model behind ChatGPT is available through OpenAI API!
The new Chat API calls gpt-3.5-turbo, the same model used in the ChatGPT product. It’s also our best model for many non-chat use cases; we’ve seen early testers migrate from text-davinci-003 to gpt-3.5-turbo with only a small amount of adjustment needed to their prompts. Learn more about the Chat API in our documentation.
Pricing
It’s priced at $0.002 per 1K tokens, which is 10x cheaper than the existing GPT-3.5 models.
Model updates
We are constantly improving our Chat models, and want to make these improvements available to developers as well. Developers who use the gpt-3.5-turbo model will always get our recommended stable model, while still having the flexibility to opt for a specific model version.
For example, today we’re releasing “gpt-3.5-turbo-0301”, which will be supported through at least June 1st, and we’ll update gpt-3.5-turbo to a new stable release in April. The models page will provide switchover updates.
Traditionally, GPT models consume unstructured text, which is represented to the model as a sequence of “tokens.” ChatGPT models instead consume a sequence of messages together with metadata. (For the curious: under the hood, the input is still rendered to the model as a sequence of “tokens” for the model to consume; the raw format used by the model is a new format called Chat Markup Language (“ChatML”).)
We’ve created a new endpoint to interact with our ChatGPT models: https://api.openai.com/v1/chat/completions
More details:
https://platform.openai.com/docs/guides/chat/chat-vs-completions
Also Whisper API is available.
https://openai.com/blog/introducing-chatgpt-and-whisper-apis
The new Chat API calls gpt-3.5-turbo, the same model used in the ChatGPT product. It’s also our best model for many non-chat use cases; we’ve seen early testers migrate from text-davinci-003 to gpt-3.5-turbo with only a small amount of adjustment needed to their prompts. Learn more about the Chat API in our documentation.
Pricing
It’s priced at $0.002 per 1K tokens, which is 10x cheaper than the existing GPT-3.5 models.
Model updates
We are constantly improving our Chat models, and want to make these improvements available to developers as well. Developers who use the gpt-3.5-turbo model will always get our recommended stable model, while still having the flexibility to opt for a specific model version.
For example, today we’re releasing “gpt-3.5-turbo-0301”, which will be supported through at least June 1st, and we’ll update gpt-3.5-turbo to a new stable release in April. The models page will provide switchover updates.
Traditionally, GPT models consume unstructured text, which is represented to the model as a sequence of “tokens.” ChatGPT models instead consume a sequence of messages together with metadata. (For the curious: under the hood, the input is still rendered to the model as a sequence of “tokens” for the model to consume; the raw format used by the model is a new format called Chat Markup Language (“ChatML”).)
We’ve created a new endpoint to interact with our ChatGPT models: https://api.openai.com/v1/chat/completions
More details:
https://platform.openai.com/docs/guides/chat/chat-vs-completions
Also Whisper API is available.
https://openai.com/blog/introducing-chatgpt-and-whisper-apis
Openai
OpenAI Platform
Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.
❤23👍1
The 6th chapter of the book is ready and available in MEAP!
We changed the book's noscript from "JAX in Action" to "Deep Learning with JAX" to better reflect the contents.
https://www.manning.com/books/deep-learning-with-jax
Chapter 6 is dedicated to vectorization and covers:
🗺- Different ways to vectorize a function
🔬- Using vmap() and its arguments
🧭- Real-life use cases for vmap()
Chapters 7 & 8 on parallelization are soon to come!
We changed the book's noscript from "JAX in Action" to "Deep Learning with JAX" to better reflect the contents.
https://www.manning.com/books/deep-learning-with-jax
Chapter 6 is dedicated to vectorization and covers:
🗺- Different ways to vectorize a function
🔬- Using vmap() and its arguments
🧭- Real-life use cases for vmap()
Chapters 7 & 8 on parallelization are soon to come!
Manning Publications
Deep Learning with JAX - Grigory Sapunov
Accelerate deep learning and other number-intensive tasks with JAX, Google’s awesome high-performance numerical computing library.
👍19🔥12💅1
Пятничное чтиво про историю появления ChatGPT и соображения непосредственных участников соревнований
https://www.technologyreview.com/2023/03/03/1069311/inside-story-oral-history-how-chatgpt-built-openai/
MIT Technology Review
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
👍10
И новости дистрибуции
Facebook LLAMA is being openly distributed via torrents:
https://news.ycombinator.com/item?id=35007978
Facebook LLAMA is being openly distributed via torrents:
https://news.ycombinator.com/item?id=35007978
❤16😢1