As a tech enthusiast, you probably also sense it. When some exciting new technology is going to get into productive applications within next couple of years, you can sense it. So you also probably sense what I call the advent of Edge LLM.

I am not sure if there is an official term yet. Maybe Edge LLM as a term is already out there. If not, let us coin a new term, Edge LLM. The terminology does not matter. What the underlying capability is, has been described in some of my posts like LLM at The Edge? and aiPhone? The Battle to Get LLMs On Our Phones Goes Beyond Hardware.

In this article, let us understand with an example how Edge LLM can revolutionize the world of AI-enabled solutions.

I have written about Edge LLM for few months now. I later learned that Apple already has made significant progress, making me believe that they may be testing the feasibility of Edge LLM on iPhones. When we talk about Edge, we are more fixated on devices like smart cameras and controllers but remember that iPhones are edge devices as well. And one of the most powerful out there.

LLMs on phones, iPhones or any comparatively phone out there will just explode the opportunities available. There will be two segments. The biggest pie is obviously the consumer segment, followed by commercial applications, where tablets can be leveraged to optimize business processes on the edge. In this article, let us explore a consumer application of Edge LLM. In the subsequent articles, we will explore commercial applications.

Let us explore how Edge LLM can help build our digital twins in an era where majority of our lives on our smart phones. An example is shown in the illustration below. It is kind of amazing to see that majority of data that helps define who we are, physically, mentally and professionally, is on our phones these days.

The scenario is exciting from a technology perspective (at least for technology nerds like me) but also scary from a privacy perspective. An App, that you allow to leverage all the documents and data on your phone, to become your digital self, can still send information to the cloud.

But we need to understand what this digital twin can realistically be, based on the illustration above. What does an App do when it is able to build your digital twin. Beyond scheduling and transcribing?

We will explore some scenarios in the second part of this article, to be published on 03/11. In the second part, we start exploring how digital twins can help us manage our lives better. We will conclude this discussion in the third part. But we will merely scratch the surface. The fact is that as I think more about it, there are som many amazing opportunities that Edge LLM can help open. Next few years are going to be exciting indeed !