Chapter 4

Future Trends: Towards Autonomous Research Agent Systems

Artificial intelligence and large language models (LLMs) are reshaping scientific research by enabling autonomous research assistants that can perform complex tasks such as literature review, hypothesis generation, and experimental design. A key emerging approach is the use of multi-agent systems, where specialised AI agents collaborate to achieve research goals. Multi-agent

Common Mistakes and Pitfalls in Prompt Engineering

Prompt engineering, the deliberate crafting of inputs to guide large language models (LLMs) towards precise and effective outputs, is pivotal in harnessing AI capabilities across diverse applications, from research to creative tasks. Attention to prompts is essential because poorly constructed inputs can lead to inaccurate, irrelevant, or biased responses, wasting

Comparing leading large language models: architectures, performance and specialised capabilities

Most contemporary LLMs employ a decoder‑only transformer architecture, which processes sequences in parallel via self‑attention. However, scaling dense transformers linearly in size increases computation and cost. Mixture‑of‑experts (MoE) approaches address this by activating only a subset of parameters per token. In the Switch Transformer, MoE routing

Benchmark-based Evaluation of Language Models and Their Limits

Benchmarking is the practice of evaluating artificial intelligence models on a standard suite of tasks under controlled conditions. In the context of large language models (LLMs), benchmarks provide a common yardstick for measuring capabilities such as factual knowledge, reasoning, and conversational coherence. They emerged because the proliferation of new models

Neural networks as specialised models within machine learning

Neural networks represent one of the most significant developments in machine learning, offering computational models inspired by the biological neural networks of animal brains. As specialised models within the broader machine learning paradigm, neural networks have evolved from theoretical constructs to practical tools that drive modern artificial intelligence applications. The