I really think that we could be entering a third epoch of computing. The microchip brought the marginal cost of compute to 0. The internet brought the marginal cost of distribution to 0. These large models actually bring the marginal cost of creation to 0. When those previous epochs happened, you had no idea what new companies were going to be created. Nobody predicted Amazon. Nobody predicted Yahoo. We should all get ready for a new wave of iconic companies.
🔥1
Silicon Valley titans behind buying spree
On Friday, the New York Times reported that more than 100 unexplained land purchases by an entity called Flannery Associates were made by Jan Sramek, a 36-year-old former Goldman Sachs trader backed with with $800m from some of the tech’s industry’s biggest investors. These include Sequoia Capital’s former Chairman Mike Moritz, LinkedIn co-founder Reid Hoffman, venture capitalists Marc Andreessen and Chris Dixon, Laurene Powell Jobs and others.
According to the Times, Moritz pitched a kind of urban development that could involve novel methods of design, construction and governance — all within driving distance of San Francisco and Silicon Valley.
On Friday, the New York Times reported that more than 100 unexplained land purchases by an entity called Flannery Associates were made by Jan Sramek, a 36-year-old former Goldman Sachs trader backed with with $800m from some of the tech’s industry’s biggest investors. These include Sequoia Capital’s former Chairman Mike Moritz, LinkedIn co-founder Reid Hoffman, venture capitalists Marc Andreessen and Chris Dixon, Laurene Powell Jobs and others.
According to the Times, Moritz pitched a kind of urban development that could involve novel methods of design, construction and governance — all within driving distance of San Francisco and Silicon Valley.
인공 지능으로 마침내 동물과 대화할 수 있게 될 것입니다.
Artificial Intelligence Could Finally Let Us Talk with Animals
https://www.scientificamerican.com/article/artificial-intelligence-could-finally-let-us-talk-with-animals/
https://www.earthspecies.org
https://twitter.com/earthspecies
제프 라스킨의 아들이자 트리스탄 해리스(소셜 딜레마의 그 분)와 협업을 많이 했던 Aza Raskin( https://twitter.com/aza )이 코파운더인 Earthspecies의 프로젝트군요~
Artificial Intelligence Could Finally Let Us Talk with Animals
https://www.scientificamerican.com/article/artificial-intelligence-could-finally-let-us-talk-with-animals/
https://www.earthspecies.org
https://twitter.com/earthspecies
제프 라스킨의 아들이자 트리스탄 해리스(소셜 딜레마의 그 분)와 협업을 많이 했던 Aza Raskin( https://twitter.com/aza )이 코파운더인 Earthspecies의 프로젝트군요~
Scientific American
Artificial Intelligence Could Finally Let Us Talk with Animals
AI is poised to revolutionize our understanding of animal communication
Spatial Computing and the Metaverse: The Next Frontier in Democratizing Technology
In a world captivated by rapid technological advances, recent events like Meta's Connect Conference(https://lnkd.in/guP2dswt) and Lex Fridman's in-depth Metaverse interview(https://lnkd.in/gs4XSPYz) with Mark Zuckerberg offer a glimpse into an extraordinary future. These conversations, where real-world and digital interactions converge, hint that spatial computing could become as transformative as the personal computer itself. If made accessible and affordable, mixed reality has the potential to become the next big thing, fundamentally altering how we communicate, work, and play.
The Allure of Democratization
Just as YouTube and TikTok democratized content creation, enabling anyone with a smartphone to capture global attention, spatial computing holds the promise of democratizing our digital experiences. From Minecraft and Roblox empowering users as game developers to the vibrant ecosystems on social platforms, democratization is the wind beneath technology's wings.
The Significance of the Metaverse
The compelling interviews and demonstrations at Meta's recent Connect Conference have set the stage for what the Metaverse could truly offer. Imagine not just chatting with friends online but interacting with them as if you were face-to-face. While there's work to be done, the merging of physical and digital worlds has profound implications, from professional collaboration to social connection.
A Word of Caution
However, it's wise to heed the cautionary insights of tech veterans like John Carmack, who questions whether mixed reality(https://lnkd.in/gQ9Cde2z), as it stands, has a "killer app" to catalyze mass adoption. His skepticism serves as a reminder that successful technologies need to offer tangible utility, not just wow factor.
Lessons from the Past
The successes and failures of previous technological shifts offer guidance. The internet revolutionized communication and information access because it was both accessible and useful. On the flip side, 3D printing, despite its revolutionary potential, hit roadblocks like high costs and a steep learning curve.
The Path Forward
To make spatial computing and the Metaverse mainstream, we must focus on accessibility and real-world utility. These elements are vital in cultivating a robust user community, acting as a catalyst for wider adoption.
In conclusion, as we stand at the threshold of a new digital era, balancing aspiration with practicality becomes increasingly crucial. Informed by the past, and inspired by the likes of Meta's vision, we can aim to create a future that is not only breathtakingly innovative but also inclusively democratized.
https://www.linkedin.com/posts/activity-7113426158074957824-3zon
In a world captivated by rapid technological advances, recent events like Meta's Connect Conference(https://lnkd.in/guP2dswt) and Lex Fridman's in-depth Metaverse interview(https://lnkd.in/gs4XSPYz) with Mark Zuckerberg offer a glimpse into an extraordinary future. These conversations, where real-world and digital interactions converge, hint that spatial computing could become as transformative as the personal computer itself. If made accessible and affordable, mixed reality has the potential to become the next big thing, fundamentally altering how we communicate, work, and play.
The Allure of Democratization
Just as YouTube and TikTok democratized content creation, enabling anyone with a smartphone to capture global attention, spatial computing holds the promise of democratizing our digital experiences. From Minecraft and Roblox empowering users as game developers to the vibrant ecosystems on social platforms, democratization is the wind beneath technology's wings.
The Significance of the Metaverse
The compelling interviews and demonstrations at Meta's recent Connect Conference have set the stage for what the Metaverse could truly offer. Imagine not just chatting with friends online but interacting with them as if you were face-to-face. While there's work to be done, the merging of physical and digital worlds has profound implications, from professional collaboration to social connection.
A Word of Caution
However, it's wise to heed the cautionary insights of tech veterans like John Carmack, who questions whether mixed reality(https://lnkd.in/gQ9Cde2z), as it stands, has a "killer app" to catalyze mass adoption. His skepticism serves as a reminder that successful technologies need to offer tangible utility, not just wow factor.
Lessons from the Past
The successes and failures of previous technological shifts offer guidance. The internet revolutionized communication and information access because it was both accessible and useful. On the flip side, 3D printing, despite its revolutionary potential, hit roadblocks like high costs and a steep learning curve.
The Path Forward
To make spatial computing and the Metaverse mainstream, we must focus on accessibility and real-world utility. These elements are vital in cultivating a robust user community, acting as a catalyst for wider adoption.
In conclusion, as we stand at the threshold of a new digital era, balancing aspiration with practicality becomes increasingly crucial. Informed by the past, and inspired by the likes of Meta's vision, we can aim to create a future that is not only breathtakingly innovative but also inclusively democratized.
https://www.linkedin.com/posts/activity-7113426158074957824-3zon
lnkd.in
LinkedIn
This link will take you to a page that’s not on LinkedIn
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval
A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.
I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.
TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.
https://x.com/karpathy/status/1707437820045062561?s=46&t=h5Byg6Wosg8MJb4pbPSDow
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval
A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.
I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.
TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.
https://x.com/karpathy/status/1707437820045062561?s=46&t=h5Byg6Wosg8MJb4pbPSDow
X (formerly Twitter)
Andrej Karpathy (@karpathy) on X
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability…
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability…
Meta starts open-sourcing a lot and is now becoming one of the best companies in the world at shipping AI features. Coincidence? I don’t think so.
Contrary to popular belief, a company (or a country) sharing their research, models and datasets publicly in open-source makes them MORE competitive, not LESS, even more so in AI. IMO, that’s how the US and some companies like Google & OAI established their leadership in the past few years IMO (even though they are not so open anymore).
Some of the reasons why open-sourcing makes companies more competitive:
- Open science and open source attracts and motivates the best talents who want to to contribute to the field
- It focuses organization on the speed of building - not on taking advantage of the current tech - especially important on a fast moving domain like AI
- It motivates the whole field to improve what you’re building on (bug fixing, optimization, new capabilities) that you can then really easily integrate in your products).
Is your company sharing their research, models and datasets? If not, they’re missing out!
Source: https://lnkd.in/e5cE93Tp
Contrary to popular belief, a company (or a country) sharing their research, models and datasets publicly in open-source makes them MORE competitive, not LESS, even more so in AI. IMO, that’s how the US and some companies like Google & OAI established their leadership in the past few years IMO (even though they are not so open anymore).
Some of the reasons why open-sourcing makes companies more competitive:
- Open science and open source attracts and motivates the best talents who want to to contribute to the field
- It focuses organization on the speed of building - not on taking advantage of the current tech - especially important on a fast moving domain like AI
- It motivates the whole field to improve what you’re building on (bug fixing, optimization, new capabilities) that you can then really easily integrate in your products).
Is your company sharing their research, models and datasets? If not, they’re missing out!
Source: https://lnkd.in/e5cE93Tp
lnkd.in
LinkedIn
This link will take you to a page that’s not on LinkedIn
김한재님 페북. 왜 중국은 거대 모델 Race에서 뒤떨어져있나?_공산당, Tech Giants들의 복잡한 이해관계가 넘쳐나는 인재/자본
Image / Video 관련 AI Application 및 관련 분야는 솔직히 중국이 전 세계에서 가장 앞서있지 않나 싶다
당장 Tiktok만 보더라도.. AI 필터를 보더라도 그렇고. 중국에는 이미 가상의 아바타로 필터 씌워서 24시간 비디오 커머스하는 서비스도 존재한다 (!!). 이게 AI의 끝판왕이 아니라면, 도대체 무엇이 AI의 실제 application layer란 말인가.
멀리갈 것 없이.. 지금 당장 최근 CVPR paper만 봐도.. 모두 중국/중국인 연구가 압도적.
이미지/비디오 AI 가 중국에서는 처음에야 surveilance 로 시작한 태동한 분야겠지만.. 모바일/embedded/실제 사용가능한 application 분야, 아니 그냥 모든 분야에서 전체적으로 앞서있다.
멀티모달이 앞으로 대세가 될 것이란 것은 너무나도 자명하고, AI가속기 및 하드웨어 역시 이를 잘 서포트 하는 것들이 주류가 될텐데..
중국의 AI관련 HW/SW 생태계는 상당히 무서울정도의 수준과 더불어, 제재와 상관없이 어느정도 독자적인 수준에 이르지 않았나.. 라고 혼자서 지난 몇 달간 생각해왔는데..
물론, 미국을 위시한 서방권 (그래봤자 미국/영국 말고 뭐 있나 싶긴 하다. 유럽은 아무것도 못하고 있는 중) 이 앞서있는 것은 사실이지만, 중국이 AI 하드웨어/반도체 관련 제재를 받아서 스스로 나자빠질것이란 생각 자체는 상당히 나이브한 동시에, 중국의 AI 기술 성숙도 및 실제 applicable 한 제품 및 서비스가 어디까지 왔는지 잘 모를때만 얘기할 수 있다고 생각.
p.s. 중국의 cambricon 같은 애들이 뭐 만드는 애들인지 한국에 계신 분들은 다들 관심도 없으신것 같더라고. 일본의 preferred networks는 개인적으로 한껏 기대했는데.. 결국 일본애들이 일본하는거 아닌가 싶다.
Image / Video 관련 AI Application 및 관련 분야는 솔직히 중국이 전 세계에서 가장 앞서있지 않나 싶다
당장 Tiktok만 보더라도.. AI 필터를 보더라도 그렇고. 중국에는 이미 가상의 아바타로 필터 씌워서 24시간 비디오 커머스하는 서비스도 존재한다 (!!). 이게 AI의 끝판왕이 아니라면, 도대체 무엇이 AI의 실제 application layer란 말인가.
멀리갈 것 없이.. 지금 당장 최근 CVPR paper만 봐도.. 모두 중국/중국인 연구가 압도적.
이미지/비디오 AI 가 중국에서는 처음에야 surveilance 로 시작한 태동한 분야겠지만.. 모바일/embedded/실제 사용가능한 application 분야, 아니 그냥 모든 분야에서 전체적으로 앞서있다.
멀티모달이 앞으로 대세가 될 것이란 것은 너무나도 자명하고, AI가속기 및 하드웨어 역시 이를 잘 서포트 하는 것들이 주류가 될텐데..
중국의 AI관련 HW/SW 생태계는 상당히 무서울정도의 수준과 더불어, 제재와 상관없이 어느정도 독자적인 수준에 이르지 않았나.. 라고 혼자서 지난 몇 달간 생각해왔는데..
물론, 미국을 위시한 서방권 (그래봤자 미국/영국 말고 뭐 있나 싶긴 하다. 유럽은 아무것도 못하고 있는 중) 이 앞서있는 것은 사실이지만, 중국이 AI 하드웨어/반도체 관련 제재를 받아서 스스로 나자빠질것이란 생각 자체는 상당히 나이브한 동시에, 중국의 AI 기술 성숙도 및 실제 applicable 한 제품 및 서비스가 어디까지 왔는지 잘 모를때만 얘기할 수 있다고 생각.
p.s. 중국의 cambricon 같은 애들이 뭐 만드는 애들인지 한국에 계신 분들은 다들 관심도 없으신것 같더라고. 일본의 preferred networks는 개인적으로 한껏 기대했는데.. 결국 일본애들이 일본하는거 아닌가 싶다.
👍1