A year ago DeepMind released the Chinchilla paper, forever changing the direction of LLM training. Without Chinchilla, there would be no LLaMa, Alpaca, or Cerebras-GPT.
Deepmind
An empirical analysis of compute-optimal large language model training
We investigate the optimal model and dataset size for training a transformer language model under a given compute budget. We find that current large language models are significantly undertrained, a consequence of the recent focus on scaling language models…
Google AI researchers have developed a new aging clock that can predict a person's biological age with greater accuracy than previous methods.
The clock, which is based on deep learning models of retinal images, was trained on a dataset of over 800,000 people.
This is an exciting development in the field of aging research. The aging clock could have a major impact on our understanding of aging and our ability to prevent and treat age-related diseases.
The clock, which is based on deep learning models of retinal images, was trained on a dataset of over 800,000 people.
This is an exciting development in the field of aging research. The aging clock could have a major impact on our understanding of aging and our ability to prevent and treat age-related diseases.
Googleblog
Developing an aging clock using deep learning on retinal images
🔥2👏2❤1
The Startup Industry Map for Pre-Seed Fundraising
It’s based on US startups mostly in SF, California and New York.
Data is from January 1, 2023 to March 14, 2023 (so incredibly recent).
What are the key findings?
• Biotech companies raise the most money at the highest valuation caps - but not a lot of them actually get funded.
• SaaS is middle of the pack in valuation cap and total raised, but by far the biggest category.
• Investors seem less enthused about food startups lately.
It’s based on US startups mostly in SF, California and New York.
Data is from January 1, 2023 to March 14, 2023 (so incredibly recent).
What are the key findings?
• Biotech companies raise the most money at the highest valuation caps - but not a lot of them actually get funded.
• SaaS is middle of the pack in valuation cap and total raised, but by far the biggest category.
• Investors seem less enthused about food startups lately.
New stablecoin bill draft introduced in US House of Representatives
Members of the U.S. House of Representatives are taking another crack at creating a comprehensive regulatory framework for stablecoins, like USDC and Tether, digital assets intended for payments whose price is supposed to remain the same at all times.
The House Financial Services Committee released a new discussion draft bill with no official notice on Saturday.
Here are highlights of what the draft bill would do if it becomes law:
1. Put the Federal Reserve in charge of nonbank stablecoins
The U.S. central bank would approve and regulate non-bank companies like Circle and Tether that currently issue or want to issue their own stablecoins in the U.S. Credit unions and banks that want to issue their own stablecoins could do so with approval from the main financial regulator they fall under, the National Credit Union Administration, Federal Deposit Insurance Corp. or Office of the Comptroller of the Currency. Failure to register would be punishable by up to five years in prison and a $1 million fine. Any issuer that wants to do business in the U.S., regardless of where the company is based, would need to register.
2. A (temporary) ban on new stablecoins without fiat backing
The new draft bill includes a two-year ban on stablecoins that aren't backed by a hard asset, and it directs the Treasury Department to lead a study on the topic of such "endogenously backed" stablecoins. Tokens already in existence before the bill passes into law would be grandfathered in.
3. Allow the government to set interoperability standards
Banking regulators and the National Institute of Standards and Technology would have the ability to set standards for interoperability between stablecoins to allow for ease of use, including mandatory technical and legal specifications to allow users to clear and settle across different payment systems without buying native stablecoins for each.
4. Direct the Fed to study a digital dollar
If the bill becomes law, Congress and the president would direct the Federal Reserve to study the effects of a digital dollar issued by the central bank. The Fed has already begun studying whether to issue a digital dollar, but the bill would mandate certain areas of focus, like the potential impacts on monetary policy, financial stability and privacy for individuals.
Members of the U.S. House of Representatives are taking another crack at creating a comprehensive regulatory framework for stablecoins, like USDC and Tether, digital assets intended for payments whose price is supposed to remain the same at all times.
The House Financial Services Committee released a new discussion draft bill with no official notice on Saturday.
Here are highlights of what the draft bill would do if it becomes law:
1. Put the Federal Reserve in charge of nonbank stablecoins
The U.S. central bank would approve and regulate non-bank companies like Circle and Tether that currently issue or want to issue their own stablecoins in the U.S. Credit unions and banks that want to issue their own stablecoins could do so with approval from the main financial regulator they fall under, the National Credit Union Administration, Federal Deposit Insurance Corp. or Office of the Comptroller of the Currency. Failure to register would be punishable by up to five years in prison and a $1 million fine. Any issuer that wants to do business in the U.S., regardless of where the company is based, would need to register.
2. A (temporary) ban on new stablecoins without fiat backing
The new draft bill includes a two-year ban on stablecoins that aren't backed by a hard asset, and it directs the Treasury Department to lead a study on the topic of such "endogenously backed" stablecoins. Tokens already in existence before the bill passes into law would be grandfathered in.
3. Allow the government to set interoperability standards
Banking regulators and the National Institute of Standards and Technology would have the ability to set standards for interoperability between stablecoins to allow for ease of use, including mandatory technical and legal specifications to allow users to clear and settle across different payment systems without buying native stablecoins for each.
4. Direct the Fed to study a digital dollar
If the bill becomes law, Congress and the president would direct the Federal Reserve to study the effects of a digital dollar issued by the central bank. The Fed has already begun studying whether to issue a digital dollar, but the bill would mandate certain areas of focus, like the potential impacts on monetary policy, financial stability and privacy for individuals.
❤1🤔1
3 CAMEL datasets released: Physics, Chemistry and Biology. Each dataset contains 20K problem-solution pairs, consisting of 25 topics, 25 subtopics and 32 problems for each "topic, subtopic" pair generated and solved by GPT4.
huggingface.co
camel-ai (CAMEL-AI.org)
Large Language Models, Cooperative AI, AI Society, Multi Agent Systems, Deep Learning, Artificial Intelligence, Natural Language Processing, Communicative AI
🔥2
Web LLM is insane.
1) Go download the latest Chrome beta, which shipped WebGPU support: google.com/chrome/beta/
2) Now use a 7B-param LLM in your browser! mlc.ai/web-llm/
3) Marvel at the "How" section on their GitHub: https://github.com/mlc-ai/web-llm
1) Go download the latest Chrome beta, which shipped WebGPU support: google.com/chrome/beta/
2) Now use a 7B-param LLM in your browser! mlc.ai/web-llm/
3) Marvel at the "How" section on their GitHub: https://github.com/mlc-ai/web-llm
Google
Try New Features with Google Chrome Beta
Feeling adventurous? Preview upcoming Google Chrome features before they’re released and give us feedback to make Chrome a better browser.
🔥2
NY financial regulator adopts virtual currency assessment rule
The regulation will require companies to meet rigorous standards for capitalization, cybersecurity protection, and anti-money laundering protocols, NYDFS said in a statement Monday.
“As the first prudential regulator of virtual currency in the nation, New York has created a framework that sets the highest standards for safety, soundness, and consumer protection while fostering responsible growth,” said NYDFS Superintendent Adrienne Harris. “This regulation provides the Department with additional tools and resources to regulate the virtual currency industry now and in the future as innovators create new products and use cases for digital assets.”
The regulation will require companies to meet rigorous standards for capitalization, cybersecurity protection, and anti-money laundering protocols, NYDFS said in a statement Monday.
“As the first prudential regulator of virtual currency in the nation, New York has created a framework that sets the highest standards for safety, soundness, and consumer protection while fostering responsible growth,” said NYDFS Superintendent Adrienne Harris. “This regulation provides the Department with additional tools and resources to regulate the virtual currency industry now and in the future as innovators create new products and use cases for digital assets.”
Department of Financial Services
Press Release- April 17, 2023: DFS Superintendent Adrienne A. Harris Announces Adoption of Virtual Currency Assessment Regulation
Press Release April 17, 2023
Today OpenAssistant released, we got a contender for open source chat!
The future of AI development depends heavily on high quality datasets and models being made publicly available, and that’s exactly what this project does.
https://huggingface.co/OpenAssistant
The future of AI development depends heavily on high quality datasets and models being made publicly available, and that’s exactly what this project does.
https://huggingface.co/OpenAssistant
🔥2
Meta AI announced DINOv2
The new Self-supervised Vision Transformer Model can be used as a backbone for almost all your CV tasks. No fine-tunning needed.
• Train CV models without the need for large amounts of labeled data.
• Multipurpose backbone: image classification, segmentation, image retrieval, and depth estimation.
• Learn features directly from images without relying on text denoscriptions, which can lead to a better understanding of local information.
• Can learn from any collection of images.
• The pretrained version of DINOv2 is already available and competes with CLIP and OpenCLIP on a wide array of tasks.
Code https://github.com/facebookresearch/dinov2
Demo https://dinov2.metademolab.com/
The new Self-supervised Vision Transformer Model can be used as a backbone for almost all your CV tasks. No fine-tunning needed.
• Train CV models without the need for large amounts of labeled data.
• Multipurpose backbone: image classification, segmentation, image retrieval, and depth estimation.
• Learn features directly from images without relying on text denoscriptions, which can lead to a better understanding of local information.
• Can learn from any collection of images.
• The pretrained version of DINOv2 is already available and competes with CLIP and OpenCLIP on a wide array of tasks.
Code https://github.com/facebookresearch/dinov2
Demo https://dinov2.metademolab.com/
GitHub
GitHub - facebookresearch/dinov2: PyTorch code and models for the DINOv2 self-supervised learning method.
PyTorch code and models for the DINOv2 self-supervised learning method. - facebookresearch/dinov2
❤4
Huge announcements in the world of AI today from Adobe, Elon Musk, the NBA, and Meta.
Here's a rundown on everything you need to know:
1. Adobe adds Firefly to video editing
Edit videos using simple text commands, plus:
-AI color corrections/enhancements
-Animated text and motion graphics generation
-Matching B-roll footage
-Music and sound effects
-Auto-generated storyboards
2. Elon Musk reveals TruthGPT
In a recent interview, Elon Musk said he will start a maximum truth-seeking AI called ‘TruthGPT.’
The AI will try to understand the nature of the universe.
3. ChatGPT got featured in a new NBA commercial with Jack Harlow
ChatGPT has gone mainstream, fast.
Here's a rundown on everything you need to know:
1. Adobe adds Firefly to video editing
Edit videos using simple text commands, plus:
-AI color corrections/enhancements
-Animated text and motion graphics generation
-Matching B-roll footage
-Music and sound effects
-Auto-generated storyboards
2. Elon Musk reveals TruthGPT
In a recent interview, Elon Musk said he will start a maximum truth-seeking AI called ‘TruthGPT.’
The AI will try to understand the nature of the universe.
3. ChatGPT got featured in a new NBA commercial with Jack Harlow
ChatGPT has gone mainstream, fast.
👍2
Everyone is talking about ChatGPT and Generative AI.
Beyond the hype and novelty applications, its important to start thinking about how it impacts our economy and our businesses.
This is a good way to get your thinking started
This roadmap is a good place to start.
Beyond the hype and novelty applications, its important to start thinking about how it impacts our economy and our businesses.
This is a good way to get your thinking started
This roadmap is a good place to start.
BCG Global
Generative AI
Generative artificial intelligence is a form of AI that uses deep learning and GANs for content creation. Learn how it can disrupt or benefit businesses.
❤2👍1
UK’s new technology department to tackle country’s metaverse, Web3 strategy
The U.K.'s newly formed Department of Science, Innovation and Technology will advance the country's metaverse and Web3 strategy.
The country’s 2023 Spring Budget, released in March, said the government wanted to “lead on the future of web technology, sometimes known as Web3 or the metaverse.”
The new tech department, set up in February, will lead the charge in this work.
The department’s work will not focus on specific technologies like blockchain and virtual reality but will instead look at potential economic growth opportunities, investment and business models associated with concepts including the Metaverse and Web3, along with implications for regulation, according to the source.
The U.K.'s newly formed Department of Science, Innovation and Technology will advance the country's metaverse and Web3 strategy.
The country’s 2023 Spring Budget, released in March, said the government wanted to “lead on the future of web technology, sometimes known as Web3 or the metaverse.”
The new tech department, set up in February, will lead the charge in this work.
The department’s work will not focus on specific technologies like blockchain and virtual reality but will instead look at potential economic growth opportunities, investment and business models associated with concepts including the Metaverse and Web3, along with implications for regulation, according to the source.
CoinDesk
UK’s New Technology Department to Tackle Country’s Metaverse, Web3 Strategy
The department will explore economic growth, investment and business opportunities in these areas along with implications on regulation.
🔥3
NVIDIA just released a very impressive text-to-video paper
Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos.
Here's a brief overview of how it works:
1. Pre-train image LDM on a dataset of images.
2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames.
3. Fine-tune the Video LDM on encoded video sequences to create a video generator.
4. Temporally align diffusion model upsamplers to generate high-resolution videos.
5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance.
6. Apply the approach in creative content creation with text-to-video modeling.
Paper: https://arxiv.org/abs/2304.08818
Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos.
Here's a brief overview of how it works:
1. Pre-train image LDM on a dataset of images.
2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames.
3. Fine-tune the Video LDM on encoded video sequences to create a video generator.
4. Temporally align diffusion model upsamplers to generate high-resolution videos.
5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance.
6. Apply the approach in creative content creation with text-to-video modeling.
Paper: https://arxiv.org/abs/2304.08818
Nvidia
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models
We develop Video Latent Diffusion Models (Video LDMs) for computationally efficient high-resolution video synthesis. We first pre-train an LDM on images only; then, we turn the image generator
into a video generator by introducing a temporal…
into a video generator by introducing a temporal…
👍3
New smart glasses tell u what to say on dates using GPT-4
A team of crafty student researchers at Stanford University have come up with a pair of smart glasses that can display the output of OpenAI's GPT-4 large language model — potentially giving you a leg up during the next job interview, or even coaching you during your next date.
The device, dubbed rizzGPT, offers its wearer "real-time Charisma as a Service" (CaaS) and "listens to your conversation and tells you exactly what to say next," as Stanford student Bryan Hau-Ping Chiang explained in a recent tweet.
The glasses were made using a monocle-like device that can be snapped onto practically any glasses, built and donated by Brilliant Labs. It features a camera, microphone, and a high-resolution display that can output text generated by GPT-4.
OpenAI's speech recognition software, Whisper, allows the glasses to feed speech directly to the chatbot, which can generate answers in a matter of seconds to its wearer.
A team of crafty student researchers at Stanford University have come up with a pair of smart glasses that can display the output of OpenAI's GPT-4 large language model — potentially giving you a leg up during the next job interview, or even coaching you during your next date.
The device, dubbed rizzGPT, offers its wearer "real-time Charisma as a Service" (CaaS) and "listens to your conversation and tells you exactly what to say next," as Stanford student Bryan Hau-Ping Chiang explained in a recent tweet.
The glasses were made using a monocle-like device that can be snapped onto practically any glasses, built and donated by Brilliant Labs. It features a camera, microphone, and a high-resolution display that can output text generated by GPT-4.
OpenAI's speech recognition software, Whisper, allows the glasses to feed speech directly to the chatbot, which can generate answers in a matter of seconds to its wearer.
🔥4
This paper provides a comprehensive analysis of GPT-4, an AI chatbot, and its potential applications, benefits, limitations, and risks in the field of Medicine.
The authors discuss the potential of GPT-4 in medical diagnostics, patient care, and medical education, as well as the ethical, legal, and security concerns surrounding its use.
Key messages:
1. GPT-4 has shown promising results in medical diagnostics, patient care, and medical education, but several challenges need to be addressed.
2. Ethical, legal, and security concerns are crucial factors that need to be considered when implementing GPT-4 in healthcare.
3. Ensuring data privacy and addressing biases in the AI model are essential to ensure the safe and responsible use of GPT-4 in medicine.
This paper is worth reading because it offers a well-rounded understanding of GPT-4's potential in revolutionizing Healthcare while also highlighting the challenges and concerns that need to be addressed to ensure its safe and responsible use.
The authors discuss the potential of GPT-4 in medical diagnostics, patient care, and medical education, as well as the ethical, legal, and security concerns surrounding its use.
Key messages:
1. GPT-4 has shown promising results in medical diagnostics, patient care, and medical education, but several challenges need to be addressed.
2. Ethical, legal, and security concerns are crucial factors that need to be considered when implementing GPT-4 in healthcare.
3. Ensuring data privacy and addressing biases in the AI model are essential to ensure the safe and responsible use of GPT-4 in medicine.
This paper is worth reading because it offers a well-rounded understanding of GPT-4's potential in revolutionizing Healthcare while also highlighting the challenges and concerns that need to be addressed to ensure its safe and responsible use.
The New England Journal of Medicine
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine | NEJM
Chatbots are computer programs with which one can have a conversation. In this article,
the authors describe how the GPT-4 chatbot, which has been given a general education,
could affect the practi...
the authors describe how the GPT-4 chatbot, which has been given a general education,
could affect the practi...
🔥5
EU lawmakers voted 517 in favor of MiCA, making it the first major jurisdiction in the world to introduce comprehensive crypto laws. It also voted 529 in favor of a separate law called which would require crypto operators to identify their customers.
Coindesk
EU Parliament Approves Crypto Licensing, Funds Transfer Rules
The vote clears the way for landmark MiCA regulation to take effect in 2024.
❤2😁1
Amazon to power 3M's clinical AI development
3M Health Information Systems announced this week it is partnering with Amazon Web Services to use Amazon’s machine learning and generative AI models to improve 3M products, including its AI medical scribe product, Fluency Align.
The news comes on the heels of Nuance announcing plans to integrate GPT-4 into its DAX medical scribe product.
The race to integrate large language models like GPT-4 into health care products has swiftly sparked concerns among experts who say it’s not clear yet whether the tools are accurate or reliable enough for use in medicine.
3M Health Information Systems announced this week it is partnering with Amazon Web Services to use Amazon’s machine learning and generative AI models to improve 3M products, including its AI medical scribe product, Fluency Align.
The news comes on the heels of Nuance announcing plans to integrate GPT-4 into its DAX medical scribe product.
The race to integrate large language models like GPT-4 into health care products has swiftly sparked concerns among experts who say it’s not clear yet whether the tools are accurate or reliable enough for use in medicine.
3M News Center
3M Health Information Systems collaborates with AWS to accelerate AI innovation in clinical documentation
3M Health Information Systems (HIS) announces a collaboration with Amazon Web Services (AWS) to accelerate the innovation and advancement of 3M M*Modal ambient intelligence. As part of the...
⚡️Yokosuka becomes Japan's first city to use ChatGPT for administrative tasks
The city of Yokosuka in Kanagawa Prefecture has a few claims to fame: It’s home to a major U.S. naval base, it’s the birthplace of former Prime Minister Junichiro Koizumi, and it lends its name to a local variation of Japanese curry.
On Thursday, it staked out a new claim as the first municipality in the country to use ChatGPT in its municipal offices.
Roughly 4,000 employees at Yokosuka’s municipal government office began using the artificial intelligence-powered chatbot, which was created by OpenAI late last year, for a one-month trial in efforts to improve operations.
The city of Yokosuka in Kanagawa Prefecture has a few claims to fame: It’s home to a major U.S. naval base, it’s the birthplace of former Prime Minister Junichiro Koizumi, and it lends its name to a local variation of Japanese curry.
On Thursday, it staked out a new claim as the first municipality in the country to use ChatGPT in its municipal offices.
Roughly 4,000 employees at Yokosuka’s municipal government office began using the artificial intelligence-powered chatbot, which was created by OpenAI late last year, for a one-month trial in efforts to improve operations.
The Japan Times
Yokosuka becomes Japan's first city to use ChatGPT for administrative tasks
Roughly 4,000 municipal employees at Yokosuka’s city office began using the artificial intelligence-powered chatbot for a one-month trial in an effort to improve operations.
😁4👍3😱1
Greg Brockman’s TED talk demoed ChatGPT plugins.
Right away he had:
- ChatGPT create a meal idea
- DALL-E generate an image of it
- Retrieval save the chat
- Instacart add the ingredients from memory to the cart
- Zapier create & send a Tweet about it
This is the future.
Right away he had:
- ChatGPT create a meal idea
- DALL-E generate an image of it
- Retrieval save the chat
- Instacart add the ingredients from memory to the cart
- Zapier create & send a Tweet about it
This is the future.
Ted
Greg Brockman: The inside story of ChatGPT's astonishing potential
In a talk from the cutting edge of technology, OpenAI cofounder Greg Brockman explores the underlying design principles of ChatGPT and demos some mind-blowing, unreleased plug-ins for the chatbot that sent shockwaves across the world. After the talk, head…
🔥4