DECEMBER 2024CIOAPPLICATIONS.COM9originated in the realm of decision science, so you either need someone who understands things like "Cosine Similarity" or someone who is willing to learn the basics; a good tool will help abstract a lot of it.So, what do we build then? Where do we start creating generative AI tools integrated into the organization? Fortunately, there are some general things to consider, regardless of the problem being solved, but please note these things will change as the technology matures.Limit or abstain from customer-facing appsA "customer" in this case means the general public, not company employees. Legislation for consumer AI governance is still catching up to reality, so venture into this space accordingly. For example, the state of Colorado just passed a law requiring AI disclosures, so you don't want to build something only to have it retracted in a few months if it's out of compliance.Use Retrieval Augmented GenerationBasic chat bots have their limitations in the context of an organization but can be greatly enhanced when scoped to your data. Retrieval augmented generation (RAG) can help by increasing answer quality using data that is meaningful to your employees.Build an Agent with ToolsDid you know that LLMs can make decisions and call external tools (or functions)? Going beyond a chat interface with a human, these tools can be used as intelligent agents to analyze input and determine which tools to call. These can be existing APIs to reuse current investments.Human in the LoopThis concept keeps people in charge of the final decisions. Use generative AI to make some decisions which are presented to an employee who can act on it. If something is not right, they will spot it.Test HeavilyMore so than other technology, one should invest in test automation to validate generative AI builds, both on the positive and negative side; double that if you put it in front of customers. It's not cost-effective to do so manually.In the end, generative AI is just another tool for technologists to use to provide business solutions. If it fits the problem, include it; if not, pick another tool. New capabilities help us solve new problems. We must simply embrace the new and move forward with care. MORE SO THAN OTHER TECHNOLOGY, ONE SHOULD INVEST IN TEST AUTOMATION TO VALIDATE GENERATIVE AI BUILDS, BOTH ON THE POSITIVE AND NEGATIVE SIDE; DOUBLE THAT IF YOU PUT IT IN FRONT OF CUSTOMERS. IT'S NOT COST-EFFECTIVE TO DO SO MANUALLY
< Page 8 | Page 10 >