How to resolve host name of kubernetes pod while creating grpc client from other pod?

Problem:

how to resolve host name of kubernetes pod?

I have the Following requirement we are using grpc with java where we have one app where we are running out grpc server other app where we are creating grpc client and connecting to grpc server (that is running on another pod).

We have three kubernetes pod running where our grpc server is running.

lets say :
my-service-0, my-service-1, my-service-2

my-service has a cluster IP as: 10.44.5.11

We have another three kubernetes pod running where our gprc client is running.

lets say:
my-client-0, my-client-1, my-client-2

Without Security:

i am try to connect grpc server pod with grpc client pod and it work fine.

grpc client (POD -> my-client) ----------------> groc server(POD -> my-service)

So without security i am giving host name as my-service and it's working fine without any problem..

ManagedChannel channel = ManagedChannelBuilder.forAddress("my-service", 50052)
                .usePlaintext()
                .build();

With SSL Security:

if i try to connect grpc server it will throw host name not match.
we have created a certificate with wild card *.default.pod.cluster.local

it will throw the below error:

java.security.cert.CertificateException: No name matching my-service found
	at java.base/sun.security.util.HostnameChecker.matchDNS(HostnameChecker.java:225) ~[na:na]
	at java.base/sun.security.util.HostnameChecker.match(HostnameChecker.java:98) ~[na:na]
	at java.base/sun.security.ssl.X509TrustManagerImpl.checkIdentity(X509TrustManagerImpl.java:455) ~[na:na]

Not Working Code:
     ManagedChannel channel = NettyChannelBuilder.forAddress("my-service", 50052)
                    .sslContext(GrpcSslContexts.forClient().trustManager(new File(System.getenv("GRPC_CLIENT_CA_CERT_LOCATION"))).build())
                    .build();

but if i give the host name as like this ==> 10-44-5-11.default.pod.cluster.local it will work fine correctly.

Working Code
      ManagedChannel channel = NettyChannelBuilder.forAddress("10-44-5-11.default.pod.cluster.local", 50052)
                        .sslContext(GrpcSslContexts.forClient().trustManager(new File(System.getenv("GRPC_CLIENT_CA_CERT_LOCATION"))).build())
                        .build();

Now my problem is cluster ip of pod is dynamic and it will change every time during app deploy. what is the right way to resolve this host name?

is it possible if i give host name and it will return me the ip then i will append default.pod.cluster.local to hostname and try to connect to grpc server?

Addressing your pod directly is not a good solution since Kubernetes may need to move your pods around the cluster. This can occur for example because of the failing node.

To allow you clients/traffic to easy find desired containers you can place them behind a service with single static IP address. Service IP can be look up through DNS.

This is how you can connect to the service through it`s FQDN:

my-service.default.svc.cluster.local 

Where my-service is your service name, default for your namespace and svc.cluster.local is a configurable cluster domain suffix used in all cluster services.

It's worth to know that you can skip svc.cluster.local suffix and even the namespace if the pods are in the same namespace. So you'll just refer to the service as my-service.

For more you can check K8s documents about DNS.