Technical Report: Evaluation of ChatGPT Model for Vulnerability Detection

Authors found that current GPT-3 and ChatGPT capabilities for effectively detecting vulnerabilities in code are limited. While natural language processing models have demonstrated impressive results in numerous areas, their application in vulnerability detection tasks requires further refinement and investigation.

Superintelligence

Discussion with philosopher David Chalmers and his fellow experts on the concepts of consciousness, intelligence, and the possibility that we are living in a simulated universe. They delve into the works of Douglas Hofstadter, the idea of an intelligence explosion, and the challenge of aligning artificial general intelligence with human goals. The conversation also touches on the limitations of intelligence, the relationship between complexity and consciousness, and the potential motivations behind simulating a universe.

Table of Contents:
- Introduction to David Chalmers and his work
- The influence of Douglas Hofstadter on AI and philosophy
- The concept of the intelligence explosion
- Aligning artificial general intelligence with human goals
- Consciousness, introspection, and the meta problem
- The relationship between complexity and consciousness
- What makes a simulation interesting?

OpenAI’s CEO Says the Age of Giant AI Models Is Already Over

OpenAI’s CEO warned that the research strategy that birthed ChatGPT is played out. “I think we're at the end of the era where it's going to be these, like, giant, giant models,” he told an audience at an event held at MIT late last week. “We'll make them better in other ways.”

Altman’s statement suggests that GPT-4 could be the last major advance to emerge from OpenAI’s strategy of making the models bigger and feeding them more data.

Nick Frosst, a cofounder at Cohere who previously worked on AI at Google, says Altman’s feeling that going bigger will not work indefinitely rings true. He, too, believes that progress on transformers, the type of machine learning model at the heart of GPT-4 and its rivals, lies beyond scaling. “There are lots of ways of making transformers way, way better and more useful, and lots of them don’t involve adding parameters to the model.”

AI / ML / LLM / Transformer Models Timeline

This is a collection of important papers in the area of LLMs and Transformer models.
PDF file.

The Anatomy of Autonomy: Why Agents are the next AI Killer App after ChatGPT

GPTs are General Purpose Technologies, but every GPT needs a killer app. The fifth killer app is here, and it is Autonomous Agents.

Bard now helps you code

Bard can help with programming and software development tasks, including code generation, debugging and code explanation in more than 20 programming languages including C++, Go, Java, Javanoscript, Python and Typenoscript. And you can easily export Python code to Google Colab — no copy and paste required. Bard can also assist with writing functions for Google Sheets.

Systemization of Knowledge: Machine Learning for Continuous Integration

This paper reports an systemization of knowledge of different aspects of the use of ML for CI. The systematic analysis highlights the deficiencies of the existing ML-based solutions that can be improved for advancing the state-of-the-art.

- RQ1: What are the CI phases that have been addressed by ML-based solutions?
- RQ2: What are the techniques employed in the development of state-of-the-art ML solutions for each CI phase?

ICAT'23: 11th International Conference on Advanced Technologies

11th International Conference on Advanced Technologies (ICAT'23) will be organized in Istanbul Ticaret University, Istanbul, Turkey on August 17-19, 2023.

The main objective of ICAT'23 is to present the latest research and results of scientists related to Computer Sciences, Electrical and Electronics, Energy Technologies, Manufacturing Technologies, Mechatronics and Biomedical Technologies. This conference provides opportunities for the different areas delegates to exchange new ideas and application experiences face to face, to establish business or research relations and to find global partners for future collaboration.

All paper submissions will be double-blind and peer-reviewed and evaluated based on originality, technical and/or research content/depth, correctness, relevance to conference, contributions, and readability.

DEADLINES :
- Submission Abstract: 2023 June 1
- Notification of acceptance: Within 7-10 days after submission

Visual Blocks for ML: Accelerating machine learning prototyping with interactive tools

Paper describes a visual programming platform for rapid and iterative development of end-to-end ML-based multimedia applications. Visual Blocks for ML, formerly called Rapsai, provides a no-code graph building experience through its node-graph editor. Users can create and connect different components (nodes) to rapidly build an ML pipeline, and see the results in real-time without writing any code.

ChatGPT could cost over $700,000 per day to operate

- ChatGPT could cost OpenAI up to $700,000 a day to run due to "expensive servers".
- ChatGPT requires massive amounts of computing power on expensive servers to answer queries.
- Microsoft is secretly building an AI chip to reduce the cost.

https://news.1rj.ru/str/ml4se/363

ICCQ-2023 stream

Finetuning Large Language Models

Fine-tuning all layers of a pretrained LLM remains the gold standard for adapting to new target tasks, but there are several efficient alternatives for using pretrained transformers. Methods such as feature-based approaches, in-context learning, and parameter-efficient finetuning techniques enable effective application of LLMs to new tasks while minimizing computational costs and resources.

- In-Context Learning and Indexing
- The 3 Conventional Feature-Based and Finetuning Approaches
- Feature-Based Approach
- Finetuning I – Updating The Output Layers
- Finetuning II – Updating All Layers
- Parameter-Efficient Finetuning
- Reinforcement Learning with Human Feedback
- Conclusion

ENASE 2024

The mission of ENASE (Evaluation of Novel Approaches to Software Engineering) is to be a prime international forum to discuss and publish research findings and IT industry experiences with relation to novel approaches to software engineering.

DEADLINES:
Regular Paper Submission: December 13, 2023
Position Paper Submission: January 25, 2024
Doctoral Consortium Paper Submission: March 6, 2024

Long-term Forecasting with TiDE: Time-series Dense Encoder

Authors propose a MLP-based encoder-decoder model, Time-series Dense Encoder (TiDE), for long-term time-series forecasting that enjoys the simplicity and speed of linear models while also being able to handle covariates and non-linear dependencies. They prove that the simplest linear analogue of the model can achieve near optimal error rate for linear dynamical systems under some assumptions. The method can match or outperform prior approaches on popular long-term time-series forecasting benchmarks while being 5-10x faster than the best Transformer based.

Google AI Blog