Pre-training underpins the capabilities of large-scale language models like BERT and GPT, enabling them to capture linguistic patterns from extensive text corpora. This process equips models with versatile language understanding and adaptability through fine-tuning for tasks such as translation or sentiment analysis. The principles, methods, and mechanisms of pre-training reveal
A new milestone in European artificial intelligence development is EuroLLM-9B, which debuted on December 2, 2024. The 9 billion parameter, open-source language model supports 35 languages, including all 24 official languages of the European Union. The project aims to promote the preservation of European linguistic diversity in the digital space.
US President Donald Trump and Nvidia CEO Jensen Huang held a crucial meeting at the White House on January 31, 2025, concerning Chinese DeepSeek's market expansion and the potential tightening of export regulations for high-tech chips. The discussion is particularly timely as the US Department of Commerce investigates
OpenAI CEO Sam Altman acknowledged on January 31, 2025, in a Reddit forum, OpenAI CEO Sam Altman acknowledged that his company had been "on the wrong side of history" regarding open-source artificial intelligence after the Chinese company DeepSeek AI's R1 model shook global markets. The announcement
A new Momentum research group led by Boldizsár Szentgáli-Tóth will begin its operation in 2024 at the HUN-REN Centre for Social Sciences, examining the frameworks and limitations of algorithmic constitutionalism. The five-year project analyses the relationship between AI and fundamental rights. The research defines algorithmic constitutionalism as a set of
Twenty leading European research institutes, companies, and EuroHPC centres have joined forces to launch the OpenEuroLLM project, which is developing open-source language models with a budget of €52 million to strengthen European digital sovereignty. The initiative, launched on February 1, 2025, is coordinated by Jan Hajič (Charles University, Czech Republic)
On 20 January, the Chinese AI firm DeepSeek announced that it had developed a chatbot matching OpenAI’s performance while requiring significantly fewer computational resources. This revelation sent shockwaves through the market, culminating in a 17% plunge in NVIDIA’s stock price by 27 January. Tech industry leaders, including Microsoft
Building upon the foundational principles of the attention mechanism discussed in the previous section, the Transformer architecture represents a paradigm shift by leveraging attention exclusively, completely replacing the recurrent structures that once dominated sequence modeling. This architectural innovation, first unveiled by Vaswani et al. (2017), has since catalysed a seismic
On 31 January 2025, OpenAI introduced the o3-mini model, marking a significant advancement in the company’s cost-efficient artificial intelligence development. Replacing the previous o1-mini, the new model features enhanced STEM capabilities while delivering a 24% faster response time than its predecessor. The o3-mini delivers outstanding performance in mathematics, coding,
The study "Identification of Social Scientifically Relevant Topics in an Interview Repository: A Natural Language Processing Experiment" presents a pioneering experiment in the automated processing of qualitative data in social sciences. The joint project of the Research Documentation Centre at the Centre for Social Sciences (TK KDK) and
Led by the HUN-REN Centre for Social Sciences, the MORES project (Moral Emotions in Politics: How They Unite, How They Divide) was launched as a collaboration between nine European institutions. The project examines the challenges facing liberal democracy, with a particular focus on the political role of moral emotions and
Addressing artificial intelligence (AI) hallucinations is a critical challenge for ensuring the technology’s reliability. A recent study suggests that multi-level agent systems, combined with natural language processing (NLP)-based frameworks, could significantly mitigate this issue. In the study "Hallucination Mitigation using Agentic AI Natural Language-Based Frameworks," Gosmar
