How Can Immediate Engineering Remodel LLMs Reasoning Potential?

Introduction

For those who’ve labored with Giant Language Fashions (LLMs), you’re seemingly accustomed to the challenges of tuning them to reply exactly as desired. This wrestle usually stems from the fashions’ restricted reasoning capabilities or problem in processing advanced prompts. Regardless of being skilled on huge datasets, LLMs can falter with nuanced or context-heavy queries, resulting in frustration amongst builders. The core problem is to steadiness the mannequin’s generalization with the necessity for particular, correct responses.

LLMs have certainly made exceptional advances in pure language processing, enabling them to generate human-like textual content, have interaction in conversations, and even help with decision-making. However, their logical reasoning skills—resembling downside decomposition, cause-and-effect understanding, and sustaining consistency—nonetheless have room for development. Improved reasoning is important for duties like scientific analysis and strategic planning, the place output precision and coherence are essential. It’s evident how vital it’s to reinforce reasoning in LLMs, noting that it’s essential for functions requiring advanced problem-solving, decision-making, and understanding of cause-and-effect relationships. This text talks all about how we will enhance the reasoning capabilities of LLMs by means of Immediate Engineering, and it’s based mostly on the current talks by Anant Agarwal on the Information Hack Summit 2024, which targeted on Enhancing Logical Reasoning in LLMs Via Immediate Engineering.

Overview

• Immediate engineering is a strong instrument for enhancing LLM reasoning with out intensive retraining.
• Chain of Thought (CoT) prompting is a key approach for guiding LLMs by means of step-by-step reasoning.
• Least to Most Successive Prompting successfully breaks down advanced issues for LLMs to unravel sequentially.
• Step-back Prompting encourages LLMs to think about high-level ideas earlier than diving into particular issues.
• Interleaved Retrieval with CoT Prompting combines data retrieval with reasoning for extra complete responses.

Why Reasoning is Necessary for LLMs?

Reasoning is taken into account a cornerstone of intelligence. Whereas LLMs excel at many duties, their reasoning capability is essential for functions requiring advanced problem-solving, decision-making, and understanding of cause-and-effect relationships. Improved reasoning capabilities can result in extra dependable and reliable AI techniques throughout varied domains. Right here’s why reasoning capabilities are important for LLMs:

• Advanced Drawback Fixing: Reasoning permits LLMs to interrupt down and clear up advanced, multi-step issues extra successfully.
• Determination Making: Logical reasoning is important for making knowledgeable choices, significantly in fields like strategic planning and medical analysis.
• Understanding Causality: It helps LLMs grasp cause-and-effect relationships, which is vital for predicting outcomes and analyzing occasions.
• Improved Explanations: Reasoning permits LLMs to supply clear, logical explanations, enhancing transparency and consumer belief.
• Dealing with Ambiguity: LLMs with robust reasoning can navigate ambiguous knowledge and queries, providing extra dependable responses.
• Generalization: Reasoning aids in making use of realized data to new conditions, bettering the flexibility of LLMs.
• Reality-Checking and Consistency: It helps preserve inner consistency and accuracy, decreasing contradictions or misinformation.
• Moral Issues: Robust reasoning permits LLMs to navigate moral dilemmas, essential as AI integrates extra into decision-making.
• Scientific and Mathematical Functions: It’s essential for fixing logical proofs and equations in fields like math and science.
• Inventive Drawback Fixing: Reasoning fosters creativity by enabling LLMs to mix concepts logically in novel methods.
• Improved Human-AI Interplay: LLMs with good reasoning abilities can have interaction in additional significant, context-aware dialogues with people.
• Robustness Towards Adversarial Inputs: Higher reasoning makes LLMs extra resilient towards deceptive or adversarial inputs.

Enhancing reasoning in LLMs results in extra highly effective, versatile, and reliable AI techniques that higher perceive and work together with the world, carefully resembling human cognition.

Additionally learn: What are Giant Language Fashions(LLMs)?

Limitations of LLMs in Reasoning

LLMs are skilled as next-token prediction fashions, not as devoted reasoning engines. This elementary structure can restrict their capability to carry out advanced logical operations, particularly when confronted with multi-step issues or duties requiring the combination of a number of items of knowledge. Understanding these limitations is essential for growing efficient methods to reinforce their reasoning capabilities. Right here’s an in-depth take a look at the important thing limitations:

Subsequent-Token Prediction Structure

• LLMs are basically designed as next-token prediction fashions, not as devoted reasoning engines.
• This structure can result in difficulties in sustaining long-term coherence and logical consistency throughout prolonged reasoning chains.
• The fashions could wrestle to backtrack or revise earlier steps in a reasoning course of, primarily specializing in producing the following most possible token.

Lack of Causal Understanding

• LLMs usually wrestle to differentiate correlation from causation.
• They could generate plausible-sounding however logically flawed explanations for phenomena, as they don’t perceive cause-and-effect relationships.

Issue with Summary Reasoning

• Whereas LLMs excel at sample recognition inside their coaching knowledge, they usually wrestle with summary reasoning duties that require generalization past their coaching examples.
• This will result in difficulties in fixing novel issues or making use of realized ideas to unfamiliar contexts.

Inconsistency in Multi-Step Reasoning

• LLMs could carry out nicely within the preliminary steps of a reasoning course of however lose coherence or introduce contradictions in later steps.
• They usually lack a worldwide “understanding” of your complete reasoning chain, resulting in domestically believable however globally inconsistent conclusions.

Vulnerability to Biases and Spurious Correlations

• LLMs can decide up and amplify biases current of their coaching knowledge.
• They could depend on superficial patterns or spurious correlations somewhat than deep, logical reasoning.

Issue with Quantitative Reasoning

• Many LLMs wrestle with exact numerical calculations or mathematical proofs.
• They could present approximations or qualitative solutions the place precise quantitative reasoning is required.

Regardless of their huge data, they usually wrestle with commonsense reasoning, lacking easy logical implications on account of a scarcity of real-world grounding. LLMs may also generate inaccurate data with excessive confidence, a phenomenon referred to as hallucination, resulting in false logical conclusions. Context size limitations additional hinder their reasoning capabilities, limiting their capability to keep up consistency over lengthy passages or advanced issues. Moreover, LLMs usually wrestle with duties requiring formal symbolic manipulation, resembling superior arithmetic or logic, and infrequently fail when reasoning about negations or hypothetical eventualities. 

Not like human reasoners, they can’t independently hunt down extra data and are restricted to the data of their coaching knowledge and supplied prompts. Moreover, LLMs lack meta-cognitive skills, which means they can’t assess their very own reasoning processes or acknowledge logical errors. These limitations spotlight the significance of ongoing analysis and improvement to reinforce the reasoning capabilities of LLMs, together with enhancements in immediate engineering, mannequin structure, and the combination of hybrid techniques.

Additionally Learn: Newbie’s Information to Construct Giant Language Fashions from Scratch

Current benchmarks to measure LLM reasoning capabilities

Giant language fashions (LLMs) usually appear to retailer intelligence, however they wrestle to purpose out easy issues like people do. Not like people, LLMs solely purpose successfully when supplied with the suitable context. This limitation arises from their design: they primarily function next-token prediction fashions somewhat than reasoning engines. Regardless of this, LLMs carry out virtually magical duties, demonstrating skills past their meant design. As mannequin dimension will increase, reasoning in LLMs turns into extra evident, rising as a functionality. Smaller fashions wrestle with reasoning duties, so fine-tuning bigger fashions is simpler than smaller ones utilizing methods like LoRA (Low-Rank Adaptation) or FLORA (High-quality-tuning LLMs with LoRA). (Wei et al., 2022). Leveraging bigger fashions is mostly really helpful for duties that demand superior reasoning. Researchers assess LLMs’ reasoning skills by means of a number of established benchmarks.

A number of benchmarks have been developed to evaluate the reasoning capabilities of LLMs:

1. ARC Problem: A multi-part Science query activity with various problem ranges (simple and superior questions). Right here, LLMs are noticed responding to those challenges with out offering any examples.
2. HellaSwag: It checks commonsense reasoning skills. Right here, LLMs are given easy duties that people inherently can reply, however we verify their capabilities to know the context. 
3. Grade College Math Issues (GSM8K): An 8,000-question benchmark for grade college math issues.
4. Discrete Reasoning over Paragraphs (DROP): A studying comprehension dataset with 96,000 questions requiring multi-step reasoning.

Word: All of the strategies we clarify can be applied utilizing the annotated DROP dataset in LangChain supplied by Dua et al. To run the code, you solely want the HuggingFace API Token.

Immediate Engineering for Improved Reasoning

Immediate engineering has emerged as a strong approach to reinforce the reasoning capabilities of LLMs with out the necessity for fine-tuning or retraining.

Right here’s a comparability between Normal Prompting and Chain of Thought (CoT) Prompting based mostly on the transcript supplied:

Normal Prompting

• Strategy: In customary prompting, the mannequin is given a single instance or instruction, anticipating it to supply the proper reply instantly.
• Instance Supplied: The transcript mentions a easy downside the place “Roger has 5 tennis balls and buys two extra cans of tennis balls, every can containing three balls.” The usual immediate asks, “What number of tennis balls does Roger have?” The anticipated reply is 11.
• Difficulty: The mannequin (GPT-3.5 on this case) struggles to reply a subsequent, equally structured query accurately. This highlights a limitation in reasoning or understanding the issue with out additional steering.
• End result: Normal prompting usually fails in additional advanced reasoning duties as a result of it doesn’t information the mannequin by means of the reasoning course of.

Chain of Thought (CoT) Prompting

• Strategy: CoT prompting entails breaking down the problem-solving course of into smaller, logical steps, guiding the mannequin to suppose by means of the issue step-by-step.
• Implementation: Within the CoT methodology, the mannequin is prompted with a thought course of as a substitute of simply asking for the ultimate reply. For instance, it would break down the tennis ball downside by first calculating the entire variety of balls Roger buys after which including that to the prevailing quantity.
• Advantages:
  • Steering: By explicitly instructing the mannequin to suppose step-by-step, it follows a logical sequence that results in the proper reply.
  • Effectiveness: CoT prompting can typically outperform even fine-tuned fashions, because it leverages the mannequin’s inherent reasoning capabilities with out requiring extra coaching.
  • Zero-Shot Reasoning: Analysis talked about within the transcript (by a Japanese scientist Kojima) means that LLMs are able to respectable zero-shot reasoning when guided by means of a step-by-step course of. This implies they will clear up new issues they haven’t been explicitly skilled on if given the suitable prompts.

Comparability Abstract

• Normal Prompting is simple however usually insufficient for advanced reasoning duties, because it lacks the required steering for the mannequin.
• CoT Prompting enhances the mannequin’s reasoning capability by offering a structured method to problem-solving, main to higher efficiency in duties requiring logical reasoning.

How can LLMs Act as Optimizers?

In a 2024 paper launched by Google, researchers evaluated varied prompting methods on the Nice College Math knowledge benchmark. The baseline methodology used was the “let’s suppose step-by-step” method from Kojima et al. (2022), which achieved the best accuracy with none examples (zero-shot). This methodology entails prompting the mannequin to “take a deep breath and work on the issue step-by-step.”

Different methods, resembling “break this down” with PaLM 2L, yielded barely decrease outcomes. The paper focuses on optimizing prompts to handle reasoning questions successfully. Researchers explored iterative strategies to find out the simplest immediate strings for answering questions, as understanding the mannequin’s inside workings could be difficult.

Right here’s the analysis paper:

Right here’s the Hyperlink: Giant Language Fashions as Optimizers

Different Immediate Engineering Strategies

Past Chain of Thought prompting, a number of different methods have proven promise in enhancing LLM reasoning capabilities:

Least to Most Successive Prompting

This method entails decomposing advanced issues into sub-questions, fixing them sequentially, and utilizing the solutions to construct as much as the ultimate answer. It’s significantly helpful for issues which are too advanced for normal CoT prompting.

A method launched at ICLR addresses limitations in Chain of Thought (CoT) prompting for advanced issues. This method, known as “Least to Most,” entails a two-step course of for dealing with extra intricate questions.

1. Decomposition: In step one, the big language mannequin (LLM) breaks down the principle query into smaller sub-questions. The LLM doesn’t clear up these questions at this stage however merely identifies and lists them.
2. Sequential Fixing: Within the second step, the LLM solves these sub-questions one after the other, utilizing the solutions from earlier sub-questions to tell the following ones.

As an illustration, suppose the principle query is about calculating the variety of instances Amy can slide down a slide inside a given timeframe. In that case, the LLM first determines the time taken for every slide (sub-question) after which makes use of this data to unravel the principle downside.

The approach is famous for its simplicity and effectiveness, and whereas it’s usually profitable, there are situations the place the LLM’s accuracy isn’t excellent. The method could be applied by producing sub-questions, fixing them iteratively, and utilizing codecs to information the LLM by means of problem-solving.

General, the “Least to Most” approach improves problem-solving accuracy in advanced eventualities, reaching an accuracy of 91.4% in comparison with 94% with Chain of Thought prompting.

To see how this really works in apply, undergo the given code – Least-to-Most Prompting

Successive Prompting

Right here’s the Hyperlink: Successive Prompting for Decomposing Advanced Questions

Right here, we’re discussing the approach known as “successive prompting,” developed by a researcher – Dheera Dua, presently at Google DeepMind however initially conceived earlier than their tenure on the firm. This method was introduced on the EMNLP convention and contrasted with the “least to most” prompting methodology.

In “least to most” prompting, all sub-questions of a posh downside are recognized and answered sequentially. In distinction, “successive prompting” decouples the question-answering course of. As a substitute of figuring out all sub-questions directly, it identifies and solutions one sub-question at a time, iterating till the ultimate reply is reached. This methodology is split into two phases: query decomposition and query answering.

Decomposition Stage

Within the query decomposition stage, the duty is to determine the following sub-question. This step isn’t about discovering the reply however figuring out which sub-question must be tackled subsequent. As soon as recognized, the question-answering stage entails fixing that sub-question. This iterative course of continues till all sub-questions are answered, resulting in the ultimate answer.

Additionally, the sensible implementation problem is that the size of prompts could make it tough to keep up give attention to crucial components of the issue. The answer proposed entails a standardized format to assist the mannequin determine construction and relevance. Nonetheless, this method could face limitations in advanced real-life functions, particularly the place hallucinations (incorrect or irrelevant outputs from the mannequin) are a priority.

The approach was examined with a selected instance, figuring out sub-questions and making an attempt to reply them. Whereas the strategy confirmed some potential, it solely achieved 82% accuracy, suggesting that it might not at all times outperform easier strategies like “least to most.” The dialogue additionally touches on potential enhancements, resembling incorporating retrieval-augmented technology (RAG) to reinforce the relevance of the examples utilized in every iteration.

Whereas successive prompting gives a versatile, iterative method to problem-solving, its effectiveness varies with context and the issue’s nature.

Step-back Prompting

Right here’s the hyperlink: Take a Step Again: Evoking Reasoning through Abstraction in Giant Language Fashions

Step-back prompting encourages the LLM to think about high-level ideas or rules earlier than making an attempt to unravel the particular downside. This method could be particularly efficient for domain-specific reasoning duties. It’s a methodology for bettering the accuracy and effectiveness of huge language fashions (LLMs). This method contrasts with different strategies like Chain of Thought (CoT) and immediate decomposition.

Step-back prompting first identifies key ideas or rules earlier than fixing the principle query. For instance, as a substitute of instantly answering a query about a super fuel’s stress, the LLM identifies related physics rules, then makes use of this understanding to handle the principle query.

Additionally, the step-back prompting is especially helpful in strategic evaluation eventualities, resembling growing a go-to-market (GTM) technique. As a substitute of decomposing the issue into smaller components, one ought to first decide a normal strategic precept (the “step again query”) earlier than answering the particular query.

Furthermore, It emphasizes that combining step-back prompting with retrieval-augmented technology (RAG) usually yields higher outcomes than fine-tuning fashions from scratch. Additionally they define a structured immediate with examples, a principal query, and a step-back query to information the LLM in producing correct responses. Lastly, a comparability of various prompting methods exhibits that step-back prompting, whereas efficient, performs barely decrease than the “least to most” methodology by way of accuracy.

In a nutshell, when iterating over the step-back prompting approach, it achieves an accuracy of 81% on the particular dataset getting used. Compared, customary prompting yields an accuracy of 74%, whereas the Chain of Thought methodology reaches 90%. The “least to most” method performs greatest, with barely decrease outcomes for the successive prompting and step-back methods.

Interleaved Retrieval with CoT Prompting

Right here, we are going to talk about a course of known as “interleaved retrieval with Chain of Thought (CoT) prompting,” which mixes data retrieval with reasoning to reply advanced questions. This methodology operates as follows:

1. Preliminary Question and Retrieval: A query is posed, and step one entails retrieving a related doc chunk to reinforce the immediate.
2. Reasoning and Output Technology (T1): Primarily based on the retrieved doc and the query, the LLM (Giant Language Mannequin) generates an output (T1).
3. Subsequent Retrieval and Reasoning: The LLM then routinely retrieves one other doc wanted to reply the query, reasoning once more with this new data and the earlier output to generate the following response (T2).
4. Additional Iterations (T3): This means of retrieval and reasoning continues till sufficient related paperwork are gathered (T3) to reply the principle query comprehensively.
5. Ultimate Response: The outputs from all steps (T1, T2, T3) are mixed to kind the ultimate response.

The present implementation lacks steps resembling figuring out the particular sub-questions and making certain that the LLM’s responses totally reply the principle query. These steps have to be refined additional to enhance the method.

Right here’s the hyperlink: Interleaving Retrieval with Chain-of-Thought Reasoning for Data-Intensive Multi-Step Questions

Ensemble Strategies with Majority Voting

This methodology entails utilizing a number of LLM brokers or prompting methods to generate a number of solutions after which choosing the commonest reply. This method might help cut back hallucinations and enhance total accuracy.

Right here, we talk about a analysis method proposed by Tencent, emphasizing the idea of utilizing a number of LLM (Giant Language Mannequin) brokers to unravel advanced reasoning issues. Earlier methods, resembling LLM debates and Chain of Thought (CoT) self-consistency, encourage the thought, producing a number of reasoning chains or debates amongst LLM brokers to succeed in probably the most correct reply.

Right here’s the hyperlink: Extra Brokers Is All You Want

On this methodology, a number of LLM brokers are used to reply a question, after which a majority voting system is employed to find out the most effective reply. The rationale is that even when some responses include hallucinations, the bulk will present constant and dependable solutions, decreasing the influence of incorrect outputs.

The potential for utilizing totally different LLMs within the ensemble might result in extra different and strong outcomes, much like the variety seen in random forests. The effectiveness of this method was examined utilizing LLaMA 2, the place an ensemble dimension of 15 to twenty brokers matched the efficiency of GPT-3.5 on a benchmark take a look at. Nonetheless, the method requires important computational sources, because it entails operating a number of LLM situations and aggregating their outputs.

Hypothetical Doc Embeddings (HyDE)

The HyDE (Hypothetical Doc Embeddings) methodology presents a wise answer to the constraints of conventional dense retrieval techniques, significantly in zero-shot eventualities the place no related labels can be found. By producing hypothetical paperwork by means of giant language fashions, HyDE can create contextually related content material that aligns with a question, even when prior examples or coaching knowledge are missing. This makes it well-suited for duties that require retrieving data in unfamiliar or novel contexts.

A key energy of this method is its capability to filter out irrelevant data from the generated hypothetical doc when changing it into embedding vectors. This ensures that the retrieval system focuses on the core features of the question, thereby bettering accuracy. Not like conventional techniques that may wrestle with ambiguous or advanced queries, HyDE can simulate a spread of doable paperwork and match them to actual content material, which makes it extra strong.

For my part, HyDE represents an revolutionary development in retrieval methods by combining generative capabilities with vector-based retrieval. It leverages the creativity and adaptability of huge language fashions to create extra nuanced, contextually wealthy embeddings. This hybrid method can considerably enhance the retrieval of related paperwork, particularly in fields like authorized, tutorial, or technical domains, the place standard strategies would possibly fall brief on account of a scarcity of coaching knowledge or relevance labels.

Reasoning With out Commentary (ReWOO)

ReWOO, launched in 2023, marks a big development in AI reasoning techniques. Not like conventional approaches that intertwine reasoning with data retrieval, ReWOO effectively separates these processes. This results in fewer prompts, making the system extra environment friendly and faster.

ReWOO additionally demonstrates superior efficiency, reaching greater accuracy whereas requiring 5 instances much less computational energy than earlier fashions like ReACT. One other key benefit of ReWOO is its robustness; it successfully handles conditions the place exterior instruments would possibly fail, making certain extra dependable outcomes throughout varied eventualities.

In abstract, ReWOO stands out for its effectivity, enhanced efficiency, and resilience, providing a strong answer for AI-driven reasoning duties.

Working Sensible Experiments Utilizing Superior Prompting Strategies

We’ll discover an implementation utilizing the Discrete Reasoning over Paragraphs dataset to show the effectiveness of immediate engineering methods.

Description of the Dataset

The dataset contains 96,000 questions requiring multi-step reasoning based mostly on given paragraphs. This instance makes use of a subset of 240 annotated examples, 140 of that are for analysis and 100 of that are for few-shot examples.

Implementation Particulars (Utilizing LangChain)

The implementation makes use of the LangChain library and a Hugging Face API token. Key steps embrace:

1. Establishing the setting and loading the mannequin
2. Creating immediate templates for various prompting methods
3. Implementing analysis features

We began by organising the setting and shifting on to utilizing LangChain. Right here, Mannequin ID “Mixtral” with an open-source mannequin is used to create a tokenizer from the pre-trained mannequin. Utilizing the Hugging Face API, we name the language mannequin and format the immediate. We make a immediate template the place an enter variable is used, and this format is utilized by default when prompting the language mannequin. We use LangChain’s expression language to question and show the mannequin with an instance query about ECG (electrocardiography). Moreover, we created a perform to load the embedding mannequin.

Analysis Metrics: Comparability of Prompting Strategies for Giant Language Fashions

The first metric used is accuracy, evaluating the LLM’s solutions to the bottom reality solutions within the dataset.

Within the analysis activity, we restructured knowledge from JSON right into a extra structured format, specializing in a dataset of 240 examples categorized into 14 sorts of questions. We extracted 140 examples for our analysis. We employed a big language mannequin (LLM) to find out the correctness of solutions by prompting it to guage whether or not the LLM-generated responses have been right or incorrect.

In customary prompting, we ask the LLM to answer consumer queries with concise data, offering a one-shot instance and evaluating its accuracy. Utilizing this method, we noticed an accuracy charge of 74% from 140 examples.

We modified the method for Chain of Thought (CoT) prompting by together with an extra column in our knowledge body for CoT reasoning. This method concerned a two-step course of: first figuring out related knowledge after which performing the required reasoning to reply the query. Implementing CoT considerably improved accuracy to 90%.

After going by means of all of the methods, we showcase the effectiveness of assorted prompting methods by evaluating their accuracy and the variety of right solutions. Normal prompting, which asks a query instantly, has the bottom accuracy at 73.6%, with 103 right solutions. Chain-of-Thought (CoT) prompting, which guides the mannequin step-by-step, improves accuracy to 90.0%, with 126 right solutions. Least-to-most prompting, the place easier components are solved first, achieves the best accuracy at 91.4%, with 128 right solutions. Successive prompting, refining solutions by means of a number of prompts, reaches 82.1% accuracy with 115 right solutions. Step-back prompting, asking the mannequin to rethink, ends in 81.4% accuracy and 114 right solutions. Structured reasoning methods like Least-to-Most and CoT outperform customary prompting, highlighting the worth of guided reasoning.

For higher understanding, right here is the Colab pocket book.

Conclusion

Immediate engineering methods have proven important potential in enhancing the logical reasoning capabilities of LLMs. Within the instance implementation, Chain of Thought prompting improved accuracy from 74% to 90%, whereas Least to Most Successive Prompting achieved the best accuracy at 91.4%.

Future Analysis Instructions

• Interleaved Retrieval with CoT Prompting: Combining data retrieval with reasoning processes for extra advanced, real-world functions.
• Multi-agent Approaches: Exploring the usage of a number of LLM brokers for debate-style reasoning and ensemble strategies.
• Optimizing Immediate Technology: Growing methods to generate the simplest prompts for particular reasoning duties routinely.
• Addressing Hallucinations: Additional analysis is required to scale back hallucinations and enhance the reliability of LLM reasoning outputs.

As LLMs proceed to evolve, immediate engineering stays a vital space of analysis and improvement. By refining these methods, we will unlock LLMs’ full potential for advanced reasoning duties throughout varied domains, bringing us nearer to extra strong and dependable AI techniques.

If you’re in search of generative AI programs on-line then discover – GenAI Pinnacle Program

Ceaselessly Requested Questions

Hello, I’m Pankaj Singh Negi – Senior Content material Editor | Captivated with storytelling and crafting compelling narratives that rework concepts into impactful content material. I like studying about know-how revolutionizing our way of life.