{"id":34594,"date":"2024-01-08T09:01:40","date_gmt":"2024-01-08T17:01:40","guid":{"rendered":"https:\/\/salesforcedevops.net\/?p=34594"},"modified":"2024-01-21T09:18:16","modified_gmt":"2024-01-21T17:18:16","slug":"beyond-coding","status":"publish","type":"post","link":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/","title":{"rendered":"Beyond Coding: The New Era of AI Copilot Creation"},"content":{"rendered":"\n<p class=\"has-drop-cap wp-block-paragraph\">As artificial intelligence continues its steady march into mainstream software applications, many companies are racing to create their own \u201cAI copilots\u201d \u2013 intelligent assistants that can understand natural language requests and help users accomplish tasks. However, this new frontier of AI-powered software development comes loaded with obstacles, <a href=\"https:\/\/arxiv.org\/abs\/2312.14231\">according to a study by Microsoft researchers which arrived in pre-publication status last week<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The paper reveals the steep learning curve faced by software engineers tasked with integrating large language models into commercial applications. While the raw AI capabilities seem magical, putting that research into practice involves dealing with fragile systems, intricate testing requirements, and a lack of standards or best practices.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThis is an exploratory period for the new field of AI Engineering,\u201d explains lead author Chris Parnin, a senior researcher at Microsoft. \u201cOur participants are on the ground trying to figure out how to take cutting-edge AI research and turn it into reliable and useful software.\u201d<\/p>\n\n\n\n<div class=\"wp-block-yoast-seo-table-of-contents yoast-table-of-contents\"><h2>Table of contents<\/h2><ul><li><a href=\"#h-the-art-and-science-of-prompt-engineering\" data-level=\"2\">The Art and Science of Prompt Engineering<\/a><\/li><li><a href=\"#h-the-hidden-toil-of-orchestration\" data-level=\"2\">The Hidden Toil of Orchestration<\/a><\/li><li><a href=\"#h-testing-troubles\" data-level=\"2\">Testing Troubles<\/a><\/li><li><a href=\"#h-an-urgent-need-for-tools-and-training\" data-level=\"2\">An Urgent Need for Tools and Training<\/a><\/li><li><a href=\"#h-an-engineering-discipline-taking-shape\" data-level=\"2\">An Engineering Discipline Taking Shape<\/a><\/li><\/ul><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-art-and-science-of-prompt-engineering\">The Art and Science of Prompt Engineering<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Central to building any AI copilot is the process of \u201cprompt engineering\u201d \u2013 using carefully constructed text prompts to make a large language model understand a user\u2019s goal and provide a relevant, actionable response. For instance, an AI assistant meant to help developers write code would need prompts that can translate natural language requests into usable code snippets.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/origin.salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553.png\"><img decoding=\"async\" width=\"1024\" height=\"507\" data-src=\"https:\/\/origin.salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553-1024x507.png\" alt=\"Explore a comparative visual guide featuring various AI copilot products such as GitHub Copilot, Microsoft Windows Copilot, Google Codey in Project IDX, and others, showcasing their interfaces and capabilities in assisting developers with coding tasks and enhancing productivity\" class=\"wp-image-34597 lazyload\" data-srcset=\"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553-1024x507.png 1024w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553-300x149.png 300w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553-768x380.png 768w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085553.png 1200w\" data-sizes=\"(max-width: 1024px) 100vw, 1024px\" src=\"data:image\/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" style=\"--smush-placeholder-width: 1024px; --smush-placeholder-aspect-ratio: 1024\/507;\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">But as Parnin and his colleagues discovered, designing functional prompts involves far more guesswork than guidelines. \u201cIt\u2019s more of an art than a science,\u201d noted one survey participant. \u201cThe ecosystem is evolving quickly and moving so fast,\u201d said another. Engineers found themselves stuck in time-consuming cycles of trial-and-error, struggling to wrangle inconsistent model behaviors using makeshift methods.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once reasonably effective prompts were created, new issues emerged around version control and testing. Companies soon amassed large, fast-changing libraries of prompt components, but lacked established software engineering practices to manage them.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-hidden-toil-of-orchestration\">The Hidden Toil of Orchestration<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Beyond individual prompts, many AI copilots rely on orchestrating complex chains of prompts and model interactions. This helps handle multi-step tasks, translate between input commands and system actions, and integrate real-time context about users and applications.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/origin.salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619.png\"><img decoding=\"async\" width=\"1024\" height=\"470\" data-src=\"https:\/\/origin.salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619-1024x470.png\" alt=\"Discover the strategic stages of AI copilot development with this diagram outlining the high-level workflow, from exploration and implementation to evaluation and productization, informed by expert interviews and iterative feedback\" class=\"wp-image-34598 lazyload\" data-srcset=\"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619-1024x470.png 1024w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619-300x138.png 300w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619-768x353.png 768w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619-1536x706.png 1536w, https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-08-085619.png 1200w\" data-sizes=\"(max-width: 1024px) 100vw, 1024px\" src=\"data:image\/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" style=\"--smush-placeholder-width: 1024px; --smush-placeholder-aspect-ratio: 1024\/470;\" \/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">However, researchers discovered this orchestration layer breeds its own set of headaches. Engineers grappled to build reliable workflows using agent-based approaches, provide transparency into model reasoning, set safe boundaries around potentially harmful model behaviors, and carry user conversations across multiple turns.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThe behavior is really hard to manage and steer,\u201d explained one survey participant. The data highlights AI copilots\u2019 proclivity for getting stuck in loops or steering conversations completely off course.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-testing-troubles\">Testing Troubles<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Traditional testing methods also proved ill-suited for AI-powered systems that behave unpredictably by design. Attempts to write test cases with fixed assertions rarely worked, since language models generate new, varied responses each time. One approach involved simply running each test 10 times and passing if 7 outputs were valid \u2013 a brute force approach.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Engineers leaned more heavily into human evaluation and \u201cmetamorphic testing,\u201d which focuses on structural changes rather than scrutinizing every output. But best practices remain undefined, and resources for manual reviewing at scale are scarce. Companies have not yet solved challenges like developing representative benchmarks and setting adequate test coverage thresholds.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThe hard parts are testing and benchmarks, especially for more qualitative output,\u201d said one participant. \u201cHumans will always have to be in the loop.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-an-urgent-need-for-tools-and-training\">An Urgent Need for Tools and Training<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Across all areas, the lack of standards, centralized knowledge and tailored tools ranked among engineers\u2019 greatest obstacles. Most had to forge their own learning paths across scattered online resources and nascent communities of practice. Beginners must throw away engrained software methods and reimagine development fundamentals like testing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cSomeone coming into it needs to come in with an open mind,\u201d a survey respondent advised. \u201cThe idea of testing is not what you thought it was.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Ultimately, participants yearned for clearer guardrails around issues of responsible AI development like safety, security, privacy, and algorithmic bias. They also called for more integrated toolchains purpose-built for AI software lifecycles \u2013 spanning prompt authoring, orchestration, monitoring, evaluation, and benchmarking.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-an-engineering-discipline-taking-shape\">An Engineering Discipline Taking Shape<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">While the research illustrates AI Engineering\u2019s uncertain terrain, it also charts the rise of a new software methodology. Tools like prompt chaining interfaces, automated benchmark generators and model monitoring systems are beginning to emerge from both startups and tech giants. Online forums teem with advice on prompt strategies, toolkit combinations and hands-on lessons learned.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In time, these individual efforts may coalesce into defined procedures, formal educational programs, and an extensive toolkit ecosystem \u2013 much like earlier shifts that established client\/server programming, mobile development and devops as formal disciplines.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For now, much pioneering work remains to tame AI\u2019s wild promises into domesticated innovations. But the travails chronicled in this paper are a necessary step along the technology\u2019s monumental march into the mainstream. The researchers aim to spur more studies and tools that can ease future AI builders\u2019 roads.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThis serves as a foundation for guiding the way toward a more streamlined and efficient future for AI-first software development,\u201d Parnin concludes.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As artificial intelligence continues its steady march into mainstream software applications, many companies are racing to create their own \u201cAI copilots\u201d \u2013 intelligent assistants that can understand natural language requests&hellip;<\/p>\n","protected":false},"author":1,"featured_media":34596,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","footnotes":""},"categories":[3],"tags":[1509,1511,1512,1510,1508],"post_series":[],"class_list":["post-34594","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry-analysis","tag-advanced-ai-integration","tag-ai-copilot-development","tag-challenges-in-ai-engineering","tag-intelligent-software-assistance","tag-technological-innovations-in-ai","entry","has-media"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.9 (Yoast SEO v27.9) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net<\/title>\n<meta name=\"description\" content=\"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net\" \/>\n<meta property=\"og:description\" content=\"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/\" \/>\n<meta property=\"og:site_name\" content=\"SalesforceDevops.net\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/salesforcedevopsnet\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-08T17:01:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-21T17:18:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Vernon Keenan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@salesforcedevop\" \/>\n<meta name=\"twitter:site\" content=\"@salesforcedevop\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vernon Keenan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"TechArticle\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/\"},\"author\":{\"name\":\"Vernon Keenan\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#\\\/schema\\\/person\\\/f681893c994bc40406bb391546cd7ac8\"},\"headline\":\"Beyond Coding: The New Era of AI Copilot Creation\",\"datePublished\":\"2024-01-08T17:01:40+00:00\",\"dateModified\":\"2024-01-21T17:18:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/\"},\"wordCount\":873,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png\",\"keywords\":[\"Advanced AI Integration\",\"AI Copilot Development\",\"Challenges in AI Engineering\",\"Intelligent Software Assistance\",\"Technological Innovations in AI\"],\"articleSection\":[\"Industry Analysis\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#respond\"]}],\"copyrightYear\":\"2024\",\"copyrightHolder\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#organization\"},\"accessibilityFeature\":[\"tableOfContents\"]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/\",\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/\",\"name\":\"Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png\",\"datePublished\":\"2024-01-08T17:01:40+00:00\",\"dateModified\":\"2024-01-21T17:18:16+00:00\",\"description\":\"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/2024\\\/01\\\/08\\\/beyond-coding\\\/#primaryimage\",\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png\",\"contentUrl\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png\",\"width\":1200,\"height\":675,\"caption\":\"a half-human, half-robot figure engaged in prompt engineering, set against a backdrop of digital networks and AI algorithms\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#website\",\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/\",\"name\":\"SalesforceDevops.net\",\"description\":\"Elevating Salesforce Devops with Insights and Innovation\",\"publisher\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/salesforcedevops.net\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#organization\",\"name\":\"SalesforceDevops.net\",\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/7760e9c16fc75961659174739887197e-sticker.png\",\"contentUrl\":\"https:\\\/\\\/salesforcedevops.net\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/7760e9c16fc75961659174739887197e-sticker.png\",\"width\":421,\"height\":421,\"caption\":\"SalesforceDevops.net\"},\"image\":{\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/salesforcedevopsnet\",\"https:\\\/\\\/x.com\\\/salesforcedevop\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/vernonkeenan\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCOgOn9rD5gyXSOmV7-Q0n7g\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/salesforcedevops.net\\\/#\\\/schema\\\/person\\\/f681893c994bc40406bb391546cd7ac8\",\"name\":\"Vernon Keenan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g\",\"caption\":\"Vernon Keenan\"},\"description\":\"Vernon Keenan (LinkedIn) works as a senior information technology industry consultant based in Oakland, California. He earned his B.Sc. in Biomedical Engineering at Northwestern University where he programmed a PDP-8 with punched paper tape. In his 34-year-long career he has been a teacher, SPSS programmer, database administrator, clinical researcher, technology journalist, product marketing manager, market researcher, management consultant, and industry analyst. Most recently he is a telecom operator, cloud architect, Go devops engineer and Salesforce Developer\\\/Architect. For inquiries about Salesforce strategy briefings or solution architect work please contact Vern directly at +1-510-679-1900 or vern@vernonkeenan.com.\",\"sameAs\":[\"https:\\\/\\\/ceres-gw.tnxs.net\",\"https:\\\/\\\/linkedin.com\\\/in\\\/vernonkeenan\",\"https:\\\/\\\/x.com\\\/salesforcedevop\"],\"url\":\"https:\\\/\\\/salesforcedevops.net\\\/index.php\\\/author\\\/vern\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net","description":"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/","og_locale":"en_US","og_type":"article","og_title":"Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net","og_description":"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.","og_url":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/","og_site_name":"SalesforceDevops.net","article_publisher":"https:\/\/www.facebook.com\/salesforcedevopsnet","article_published_time":"2024-01-08T17:01:40+00:00","article_modified_time":"2024-01-21T17:18:16+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png","type":"image\/png"}],"author":"Vernon Keenan","twitter_card":"summary_large_image","twitter_creator":"@salesforcedevop","twitter_site":"@salesforcedevop","twitter_misc":{"Written by":"Vernon Keenan","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"TechArticle","@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#article","isPartOf":{"@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/"},"author":{"name":"Vernon Keenan","@id":"https:\/\/salesforcedevops.net\/#\/schema\/person\/f681893c994bc40406bb391546cd7ac8"},"headline":"Beyond Coding: The New Era of AI Copilot Creation","datePublished":"2024-01-08T17:01:40+00:00","dateModified":"2024-01-21T17:18:16+00:00","mainEntityOfPage":{"@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/"},"wordCount":873,"commentCount":0,"publisher":{"@id":"https:\/\/salesforcedevops.net\/#organization"},"image":{"@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#primaryimage"},"thumbnailUrl":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png","keywords":["Advanced AI Integration","AI Copilot Development","Challenges in AI Engineering","Intelligent Software Assistance","Technological Innovations in AI"],"articleSection":["Industry Analysis"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#respond"]}],"copyrightYear":"2024","copyrightHolder":{"@id":"https:\/\/salesforcedevops.net\/#organization"},"accessibilityFeature":["tableOfContents"]},{"@type":"WebPage","@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/","url":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/","name":"Beyond Coding: The New Era of AI Copilot Creation - SalesforceDevops.net","isPartOf":{"@id":"https:\/\/salesforcedevops.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#primaryimage"},"image":{"@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#primaryimage"},"thumbnailUrl":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png","datePublished":"2024-01-08T17:01:40+00:00","dateModified":"2024-01-21T17:18:16+00:00","description":"Explore the cutting-edge realm of AI copilot development in this insightful article, delving into the challenges and innovations in copilots.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/salesforcedevops.net\/index.php\/2024\/01\/08\/beyond-coding\/#primaryimage","url":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png","contentUrl":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png","width":1200,"height":675,"caption":"a half-human, half-robot figure engaged in prompt engineering, set against a backdrop of digital networks and AI algorithms"},{"@type":"WebSite","@id":"https:\/\/salesforcedevops.net\/#website","url":"https:\/\/salesforcedevops.net\/","name":"SalesforceDevops.net","description":"Elevating Salesforce Devops with Insights and Innovation","publisher":{"@id":"https:\/\/salesforcedevops.net\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/salesforcedevops.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/salesforcedevops.net\/#organization","name":"SalesforceDevops.net","url":"https:\/\/salesforcedevops.net\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/salesforcedevops.net\/#\/schema\/logo\/image\/","url":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2021\/03\/7760e9c16fc75961659174739887197e-sticker.png","contentUrl":"https:\/\/salesforcedevops.net\/wp-content\/uploads\/2021\/03\/7760e9c16fc75961659174739887197e-sticker.png","width":421,"height":421,"caption":"SalesforceDevops.net"},"image":{"@id":"https:\/\/salesforcedevops.net\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/salesforcedevopsnet","https:\/\/x.com\/salesforcedevop","https:\/\/www.linkedin.com\/in\/vernonkeenan","https:\/\/www.youtube.com\/channel\/UCOgOn9rD5gyXSOmV7-Q0n7g"]},{"@type":"Person","@id":"https:\/\/salesforcedevops.net\/#\/schema\/person\/f681893c994bc40406bb391546cd7ac8","name":"Vernon Keenan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f1183f1ebb5c059e052825760f95b25244abc5ef832145327f298f3697f980c7?s=96&d=mm&r=g","caption":"Vernon Keenan"},"description":"Vernon Keenan (LinkedIn) works as a senior information technology industry consultant based in Oakland, California. He earned his B.Sc. in Biomedical Engineering at Northwestern University where he programmed a PDP-8 with punched paper tape. In his 34-year-long career he has been a teacher, SPSS programmer, database administrator, clinical researcher, technology journalist, product marketing manager, market researcher, management consultant, and industry analyst. Most recently he is a telecom operator, cloud architect, Go devops engineer and Salesforce Developer\/Architect. For inquiries about Salesforce strategy briefings or solution architect work please contact Vern directly at +1-510-679-1900 or vern@vernonkeenan.com.","sameAs":["https:\/\/ceres-gw.tnxs.net","https:\/\/linkedin.com\/in\/vernonkeenan","https:\/\/x.com\/salesforcedevop"],"url":"https:\/\/salesforcedevops.net\/index.php\/author\/vern\/"}]}},"uagb_featured_image_src":{"full":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false],"thumbnail":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-150x150.png",150,150,true],"medium":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-300x169.png",300,169,true],"medium_large":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-768x432.png",768,432,true],"large":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-1024x576.png",980,551,true],"1536x1536":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-1536x864.png",1536,864,true],"2048x2048":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false],"lightbox":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false],"search_results":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39-125x125.png",125,125,true],"blog_entry":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",750,422,false],"blog_post":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",750,422,false],"blog_post_full":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false],"blog_related":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false],"gallery":["https:\/\/salesforcedevops.net\/wp-content\/uploads\/2024\/01\/presentation_slide_16_91920x1080-rid_b8b524af-3726-4ec4-a08b-6ec4d2acab39.png",1200,675,false]},"uagb_author_info":{"display_name":"Vernon Keenan","author_link":"https:\/\/salesforcedevops.net\/index.php\/author\/vern\/"},"uagb_comment_info":0,"uagb_excerpt":"As artificial intelligence continues its steady march into mainstream software applications, many companies are racing to create their own \u201cAI copilots\u201d \u2013 intelligent assistants that can understand natural language requests&hellip;","_links":{"self":[{"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/posts\/34594","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/comments?post=34594"}],"version-history":[{"count":0,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/posts\/34594\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/media\/34596"}],"wp:attachment":[{"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/media?parent=34594"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/categories?post=34594"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/tags?post=34594"},{"taxonomy":"post_series","embeddable":true,"href":"https:\/\/salesforcedevops.net\/index.php\/wp-json\/wp\/v2\/post_series?post=34594"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}