As we venture into the new year, the realm of artificial intelligence (AI) stands on the brink of remarkable transformation, poised to undergo an array of advancements that will ripple through both its software and hardware domains, ultimately leaving an indelible mark on the global economy.
Renowned AI and data science expert Carsten Kraus shares compelling insights into the AI developments poised to redefine the landscape of 2024.
Software advancements
The founder and managing director of Omicron Data Quality and Casablanca.ai anticipates a spotlight on smaller Large Language Models (LLMs) in the coming year. These compact yet potent models have achieved a level of sophistication where they can be effectively deployed across a spectrum of applications.
Recent strides in this arena, epitomized by Google’s Gemini Nano and Microsoft’s Phi-2, highlight the remarkable progress. Notably, the latter achieves performance levels akin to models 25 times its size, such as Llama 2. This trend towards smaller LLMs not only enhances cost-effectiveness but also widens their utility across diverse tasks, owing to their reduced computational requirements.
Simultaneously, Deep Reinforcement Learning (Deep RL) emerges as a pivotal area of focus, with Carsten Kraus predicting further breakthroughs. Pioneering companies like Google, notably through its subsidiary DeepMind, lead innovations in this domain. The integration of LLMs with Deep RL holds the promise of deeper and more nuanced processing of complex information by AI systems. DeepMind’s groundbreaking achievements, such as Alpha Fold in medicine and advancements in mathematics and materials research, underscore the vast potential of this amalgamation of technologies.
Hardware innovations
In the hardware realm, AMD emerges as a formidable contender to nVidia with its MI300 cards tailored for data centers. This development could potentially lead to a reduction in prices for high-end graphics cards, fostering greater accessibility to advanced AI infrastructure. Meanwhile, IBM showcases promising...
Subscribe to Continue Reading
Get exclusive AI insights for marketers and business leaders - newsletters, strategies, and expert tips included.
