{"id":954,"date":"2025-03-15T21:52:22","date_gmt":"2025-03-15T21:52:22","guid":{"rendered":"https:\/\/microregistrar.com\/?p=954"},"modified":"2025-05-15T20:58:21","modified_gmt":"2025-05-15T19:58:21","slug":"using-llms-effectively-for-academic-work","status":"publish","type":"post","link":"https:\/\/microregistrar.com\/?p=954","title":{"rendered":"Using LLMs effectively for academic work"},"content":{"rendered":"\n<p>This summary reflects my experience with LLMs over the past several months. I have interacted with Gemini (formerly Bard), ChatGPT (including version 4.5), Perplexity, Claude, and Grok3, along with some use of DeepSeek, Mistral, AllenAI, Leonardo, Midjourney and Copilot.<\/p>\n\n\n\n<p>Every LLM has its strengths and weaknesses, and no one LLM is the best at doing everything for your academic needs. However, the capabilities and functionalities are changing regularly and fast.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Search<\/td><td>Perplexity leads for research; Gemini excels with Google integration. Deepsearch of ChatGPT is excellent in my opinion. Grok DeepSearch is also good.<\/td><\/tr><tr><td>Hallucination<\/td><td>ChatGPT (DALL-E 3) and Gemini lead in generating stock images.<br>Claude is good at producing charts and graphics for academic purposes. ChatGPT cen refine academic images but is often unreliable.<\/td><\/tr><tr><td>Reliability<\/td><td>Claude for logic; Perplexity for facts<\/td><\/tr><tr><td>Deep Search<\/td><td>Perplexity offers it free; Grok, ChatGPT and Gemini shine in paid tiers.<\/td><\/tr><tr><td>Image Generation<\/td><td>ChatGPT (DALL-E 3) and Gemini lead in generating stock images.<br>Claude is good at producing charts and graphics for academic purposes. ChatGPT can refine academic images but is often unreliable.<\/td><\/tr><tr><td>Coding<\/td><td>Claude and DeepSeek are top-tier<\/td><\/tr><tr><td>Video<\/td><td>Gemini has this capability.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Aspect<\/strong><\/td><td><strong>ChatGPT<\/strong><\/td><td><strong>Perplexity<\/strong><\/td><td><strong>Grok<\/strong><\/td><td><strong>Claude<\/strong><\/td><td><strong>DeepSeek<\/strong><\/td><td><strong>Gemini<\/strong><\/td><\/tr><tr><td><strong>Search<\/strong><\/td><td>Paid only, decent<\/td><td>Best, real-time<\/td><td>Real-time, X (twitter) focus<\/td><td>Basic<\/td><td>Good, technical<\/td><td>Excellent, Google<\/td><\/tr><tr><td><strong>Risk of Hallucination<\/strong><\/td><td>Moderate<\/td><td>Low<\/td><td>Low<\/td><td>Very Low<\/td><td>Moderate<\/td><td>Moderate<\/td><\/tr><tr><td><strong>Reliability<\/strong><\/td><td>High, general<\/td><td>High, research<\/td><td>High, technical<\/td><td>Very High, logic<\/td><td>High, STEM<\/td><td>High, multimodal<\/td><\/tr><tr><td><strong>Deep Search (Free)<\/strong><\/td><td>No<\/td><td>Yes<\/td><td>Limited<\/td><td>No<\/td><td>Yes, limited<\/td><td>Yes<\/td><\/tr><tr><td><strong>Deep Search (Paid)<\/strong><\/td><td>Yes (Pro)<\/td><td>Yes (Pro)<\/td><td>Yes (Premium+)<\/td><td>No<\/td><td>Yes<\/td><td>Yes (Advanced)<\/td><\/tr><tr><td><strong>Image Generation<\/strong><\/td><td>Yes (Paid)<\/td><td>No<\/td><td>Yes (Paid)<\/td><td>No<\/td><td>No<\/td><td>Yes (Paid)<\/td><\/tr><tr><td><strong>Coding Capability<\/strong><\/td><td>Strong<\/td><td>Decent<\/td><td>Strong<\/td><td>Exceptional<\/td><td>Exceptional<\/td><td>Strong<\/td><\/tr><tr><td><strong>Video Generation<\/strong><\/td><td>No<\/td><td>No<\/td><td>No<\/td><td>No<\/td><td>No<\/td><td>Yes (Paid)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong>You can use LLMs for<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>\u2022searching literature, <br>\u2022generating ideas, <br>\u2022blog posts, <br>\u2022social media post, <br>\u2022generating structure for your article, <br>\u2022reviewing your paper or correcting spelling\/grammar\/structure <br>\u2022summarising<br>\u2022statistical analysis, <br>\u2022critically appraise a paper<\/td><td>\u2022Write an article (you must be careful about generating the whole article for a paper) <br>\u2022generating images (stock image, graph, tables, diagram, or just an absurd image for fun), <br>\u2022testing your understanding of a subject by conversing with you <br>\u2022generating podcast <br>\u2022generating code <br>\u2022generating a short video.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>How can you use LLM safely?<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>\u2022Do not upload confidential data (for example: no patient identifiable data or business intelligence\/business critical data)<br>\u2022Follow your organisation\u2019s AI\/data policy or your National policy<\/td><td><em>Although LLM use is considered sessional (the information you upload is not retained after you end the conversation, it might still be reviewed by someone to train the LLM.<\/em><br><em>Also, there is always a potential policy change from the LLM companies, leading to data retention<\/em><br><em>There is always some possibility of data retention if you are using services like ChatGPT scheduled task or perplexity spaces.<\/em><\/td><\/tr><tr><td>\u2022Use your prompts effectively (more on this later)<br>\u2022 Cross-check the output (text and reference)<\/td><td><em>There is always a risk of hallucination (LLM producing information or reference that does not exist). It is important to check the information if you are producing something that is not in the field of imaginative work (writing a story)<\/em><br><em>Any academic work must be checked for its validity. I find expert knowledge is important here. If you are not an expert in that field you risk missing the hallucination.<\/em><br><em>Appropriate prompt can help to some extent, but still cross checking is important<\/em><\/td><\/tr><tr><td>\u2022Check the AI use policy of the organisation<br>\u2022Declare the scope of use of AI in your work<\/td><td><em>If you are using AI\/LLM for serious work (preparing a journal article or business report) your organisation or the publisher may want to know the extent of the use of the AI. Always check what the scope is and comply.<\/em><\/td><\/tr><tr><td>\u2022Beware of the guardrail<br>\u2022Refrain from using AI\/LLM for offensive\/illegal purpose<\/td><td><em>There is always a risk of hallucination (LLM producing information or reference that does not exist). It is important to check the information if you are producing something that is not in the field of imaginative work (writing a story)<\/em><br><em>Any academic work must be checked for its validity. I find expert knowledge is important here. If you are not an expert in that field you risk missing the hallucination.<\/em><br><em>Appropriate prompt can help to some extent, but still cross-checking is important<\/em><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Using prompts effectively for an academic purpose<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Detailed and Explicit Prompts:<\/strong><\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>There is no such thing as a prompt that&#8217;s &#8220;too long.&#8221; If you have to use a long prompt to get an answer you want, go for it.<\/li>\n\n\n\n<li>Include context, specific tasks, intended outcomes, and any constraints clearly.<\/li>\n<\/ul>\n\n\n\n<p>2. <strong>Assign a Role or Character to the LLM:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Clearly define what role the LLM should adopt (e.g., &#8220;senior consultant,&#8221; &#8220;editor of a journal,&#8221; &#8220;statistician,&#8221; &#8220;historian&#8221;). This significantly influences the nature and depth of responses.<\/li>\n\n\n\n<li>Example: If you are asking LLM to review an article, write\u00a0 <em>&#8220;Assume you are an editor of a reputed medical journal evaluating a research article. Review this article {name}\u201d<\/em><\/li>\n\n\n\n<li>If you ask LLM &#8220;You are Napoleon Bonaparte, analyse the Battle of Gaugamela&#8221;, you will get a different answer than asking it \u201cYou are William Shakespeare \u2013 describe the Battle of Gaugamela&#8221;.<\/li>\n<\/ul>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p>As Napoleon Bonaparte, I would analyse the Battle of Gaugamela thus:<\/p>\n\n\n\n<p>The Battle of Gaugamela (331 BC) epitomises Alexander the Great\u2019s brilliance in battlefield strategy, a masterpiece of tactical flexibility and psychological dominance. Alexander&#8217;s deliberate use of the oblique order, combined with disciplined troops and precisely executed maneuvers, showcases his strategic genius. His deliberate weakening of the left flank to entice Darius III into committing heavily, thereby creating vulnerabilities in the Persian center, exemplifies masterful deception.<\/p>\n\n\n\n<p>Alexander\u2019s bold cavalry charge, precisely timed and directed straight at the heart of Darius&#8217; formation, demonstrated courage and calculated risk-taking\u2014principles essential to decisive victories. Darius&#8217;s inability to adapt to rapidly changing battlefield conditions and his premature retreat signified a failure in leadership and the psychological collapse of Persian morale.<\/p>\n\n\n\n<p>\u2022From my own perspective, victory demands decisiveness, clear communication, and exploitation of the enemy\u2019s psychological weaknesses\u2014all expertly demonstrated by Alexander. Had I faced Darius at Gaugamela, my approach would have resonated with Alexander\u2019s methods: breaking enemy cohesion, maintaining initiative, and achieving decisive victory through audacious yet calculated maneuvers. Alexander achieved a model of strategic victory that military leaders should study for centuries hence.<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p>As William Shakespeare, my depiction of the Battle of Gaugamela would unfold thus:<\/p>\n\n\n\n<p>Upon the plains of Gaugamela wide,<br>Two mighty hosts in fateful clash abide.<br>Great Alexander, fierce with youthful fire,<br>Met Darius, crowned by desperate desire.<\/p>\n\n\n\n<p>A sea of steel and courage brightly gleamed,<br>As spears like stars against the sunlight streamed.<br>Alexander, bold, with eagle\u2019s eyes did see<br>The Persian weakness\u2014fate\u2019s decree.<\/p>\n\n\n\n<p>He charged with valour&#8217;s flame, like tempest wind,<br>A sharpen\u2019d wedge, as Destiny had skinned<br>The fabric of the Persian king\u2019s array;<br>The centre shattered, courage fell away.<\/p>\n\n\n\n<p>The royal Darius fled the grievous sight;<br>His armies broken, routed from the fight.<br>Thus Fortune favoured daring hearts that day,<br>And Alexander claimed immortal sway.<\/p>\n\n\n\n<p>\u2022This battlefield, where glory spilt its flood,<br>Is ink\u2019d forever in the scrolls of blood.<br>O Gaugamela! Name remembered long,<br>Where pride did fall, and heroes\u2019 deeds belong.<\/p>\n<\/div>\n<\/div>\n\n\n\n<p>3. <strong>Demand factual accuracy explicitly:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>LLMs tend toward generating coherent narratives, occasionally at the expense of factual accuracy. Explicitly instruct the LLM to adhere strictly to factual information.<\/li>\n\n\n\n<li>LLMs are reluctant to say \u201cno\u201d unless you give it permission to do so.<\/li>\n\n\n\n<li>Tell it \u201cProvide answers based solely on factual information. Avoid generalisations, assumptions, or extrapolations beyond explicitly stated or verifiable data. If uncertain, explicitly state uncertainty, and if information is not available, say not available.&#8221;<\/li>\n<\/ul>\n\n\n\n<p>4. <strong>Set clear boundaries and constraints:<\/strong><\/p>\n\n\n\n<p>Specify clearly what kind of resources and guidelines to use or avoid. For instance:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cOnly cite peer-reviewed journal articles published within the last 10 years, prioritising systematic reviews and meta-analyses.\u201d<\/li>\n\n\n\n<li>\u201cPrimarily use UK guidelines (e.g., NICE, BIA, HIS, BASHH, BHIVA). If no UK guidelines are available, explicitly indicate this and cite European, US, or WHO guidelines.\u201d<\/li>\n\n\n\n<li>\u201cExplicitly state when using non-peer-reviewed or unofficial sources, clearly indicating their limitations.\u201d<\/li>\n<\/ul>\n\n\n\n<p>5. <strong>Ensure rigorous citation and verification:<\/strong><\/p>\n\n\n\n<p>Be extra-careful about citation. Citations are a frequent area of inaccuracies or hallucinations. Explicitly instruct the LLM to verify citations and clearly communicate citation details:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cList citations clearly with authors, title, journal\/guideline name, year, DOI or URL. Explicitly confirm that the cited information is accurately located within the provided source (mention page number, section, or heading).\u201d<\/li>\n\n\n\n<li> \u201cIf citation verification fails or is uncertain, explicitly flag this with statements like \u2018Citation existence not confirmed,\u2019 \u2018Information not found in cited source,\u2019 or \u2018Citation accessibility issue.\u2019\u201d<\/li>\n<\/ul>\n\n\n\n<p><strong>6. Provide a clear structure for answers:<\/strong><\/p>\n\n\n\n<p>Offer a detailed structure or framework for responses. This significantly improves consistency, completeness, and readability. Example:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cWhen describing a bacterial species, provide information under the following structured headings: Classification, Virulence Factors, Laboratory Characteristics (Gram stain, culture media, biochemical tests), Clinical Presentations, Differential Diagnoses, Investigations, and Management\/Treatment.\u201d<\/li>\n<\/ul>\n\n\n\n<p>7. <strong>Iterative refinement (Ask the LLM for Help):<\/strong><\/p>\n\n\n\n<p>If unsure, first ask the LLM to propose an initial outline, structure, or scope for your topic. Example:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cSuggest a comprehensive outline covering all relevant aspects of bacterial pathogens. Refine this outline based on my feedback.\u201d<\/li>\n<\/ul>\n\n\n\n<p><strong>8. Precision and language style:<\/strong><\/p>\n\n\n\n<p>Specify the desired tone and style of writing (e.g., formal academic tone, concise and technical, detailed yet concise). Example:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>&#8220;Write in a formal academic style, concise yet detailed, appropriate for postgraduate medical students.&#8221;<\/li>\n\n\n\n<li>Or you can ask \u2013 guideline style, short summary, summarise in 3 lines, use a language suitable for a lay person..<\/li>\n<\/ul>\n\n\n\n<p><strong>9. Start a conversation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>LLM, although not human but remarkably humanlike in its conversational capability. Do not consider it as a machine but assume it as a person who is willing to help you and will never be angry if you ask the same thing hundreds of times (well you can go over your usage limit).<\/li>\n\n\n\n<li>Start a conversation. If you do not like a part of the answer, suggest it. Ask for refinements. If you like a part \u2013 appreciate it. It will take these interactions on board and adjust its answer according to this. However, remember it&#8217;s memory is sessional, as soon as you close the conversation this small modification will be lost.<\/li>\n<\/ul>\n\n\n\n<p><strong>10. Make a list of common prompts and store:<\/strong><\/p>\n\n\n\n<p>\u2022Store your common prompts in a separate place.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>As the LLM&#8217;s memory is sessional, you can make a big prompt to set the tone of the conversation and then start your interaction.<\/li>\n\n\n\n<li>Your starting line could be something like \u2013 \u201cYou are a consultant in the NHS involved in patient care and teaching. You look for answers based solely on factual information. Avoid generalisations, assumptions, or extrapolations beyond explicitly stated or verifiable data. If uncertain, explicitly state uncertainty, and if information is not available, say not available\u2026.\u201d<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Invite LLM to all your workflows.. (as long as it is safe to do so)..<\/h2>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This summary reflects my experience with LLMs over the past several months. I have interacted with Gemini (formerly Bard), ChatGPT [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ngg_post_thumbnail":0,"footnotes":""},"categories":[194],"tags":[195,196],"class_list":["post-954","post","type-post","status-publish","format-standard","hentry","category-ai","tag-ai","tag-llm"],"_links":{"self":[{"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/posts\/954","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/microregistrar.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=954"}],"version-history":[{"count":1,"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/posts\/954\/revisions"}],"predecessor-version":[{"id":958,"href":"https:\/\/microregistrar.com\/index.php?rest_route=\/wp\/v2\/posts\/954\/revisions\/958"}],"wp:attachment":[{"href":"https:\/\/microregistrar.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=954"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/microregistrar.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=954"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/microregistrar.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=954"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}