Hello -

I have my own Openshift 1.3 Origin Cluster and im launching Jenkins via s2i template.
Jenkins docker image was built close to openshift:jenkinsci (Ben Parees: https://github.com/openshift/jenkins) with few customizations plus Ubuntu OS instead of Centos.

When Jenkins is launched, it is filled with Kubernetes errors with unknown host. Although I dont think its a Jenkin bug, im looking for assistance.

oc describe pod jenkins-openshift5-6-msta8
Name: jenkins-openshift5-6-msta8
Namespace: atat
Security Policy: restricted
Node: 192.168.54.105/192.168.54.105
Start Time: Mon, 09 Jan 2017 15:43:04 -0600
Labels: deployment=jenkins-openshift5-6
deploymentconfig=jenkins-openshift5
name=jenkins-openshift5
Status: Running
IP: 192.168.194.4
Controllers: ReplicationController/jenkins-openshift5-6
Containers:
jenkins:
Container ID: docker://7edaa4e1e7969f4dca72a7bd3fde4458d1f98de43612fd5f7ce24446d5913253
Image: 192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec
Image ID: docker://f812f7844a03d5bccc63b7a558a8cf170f467e5b6a90850839a52eac00441689
Port:
Limits:
memory: 2Gi
Requests:
memory: 2Gi
State: Running
Started: Mon, 09 Jan 2017 15:44:45 -0600
Ready: True
Restart Count: 0
Liveness: http-get http://:8080/login delay=120s timeout=3s period=10s #success=1 #failure=30
Readiness: http-get http://:8080/login delay=3s timeout=3s period=10s #success=1 #failure=3
Volume Mounts:
/var/lib/jenkins from jenkins-openshift5-data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from jenkins-openshift5-token-flzoj (ro)
Environment Variables:
OPENSHIFT_ENABLE_OAUTH: false
OPENSHIFT_ENABLE_REDIRECT_PROMPT: true
KUBERNETES_MASTER: https://kubernetes.default:443
KUBERNETES_TRUST_CERTIFICATES: true
JNLP_SERVICE_NAME: jenkins-jnlp5
Conditions:
Type Status
Initialized True
Ready True
PodScheduled True
Volumes:
jenkins-openshift5-data:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
jenkins-openshift5-token-flzoj:
Type: Secret (a volume populated by a Secret)
SecretName: jenkins-openshift5-token-flzoj
QoS Tier: Burstable
Events:
FirstSeen LastSeen Count From SubobjectPath Type Reason Message
--------- -------- ----- ---- ------------- -------- ------ -------
26m 26m 1

{default-scheduler }

Normal Scheduled Successfully assigned jenkins-openshift5-6-msta8 to 192.168.54.105
26m 26m 1

{kubelet 192.168.54.105} spec.containers{jenkins} Normal Pulling pulling image "192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec"
24m 24m 1 {kubelet 192.168.54.105}

spec.containers

{jenkins} Normal Pulled Successfully pulled image "192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec"
24m 24m 1 {kubelet 192.168.54.105} spec.containers{jenkins}

Normal Created Created container with docker id 7edaa4e1e796
24m 24m 1

{kubelet 192.168.54.105} spec.containers{jenkins} Normal Started Started container with docker id 7edaa4e1e796
24m 22m 10 {kubelet 192.168.54.105}

spec.containers

{jenkins} Warning Unhealthy Readiness probe failed: Get http://192.168.194.4:8080/login: dial tcp 192.168.194.4:8080: getsockopt: connection refused
22m 22m 1 {kubelet 192.168.54.105} spec.containers{jenkins}

Warning Unhealthy Readiness probe failed: Get http://192.168.194.4:8080/login: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
22m 22m 1

{kubelet 192.168.54.105} spec.containers{jenkins} Warning Unhealthy Liveness probe failed: Get http://192.168.194.4:8080/login: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
22m 21m 5 {kubelet 192.168.54.105}

spec.containers

{jenkins} Warning Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 503
22m 21m 3 {kubelet 192.168.54.105} spec.containers{jenkins}

Warning Unhealthy Liveness probe failed: HTTP probe failed with statuscode: 503
[root@master1-openshift-prod centos]#

Logs from oc logs <jenkins_pod>
Unable to connect to the server: dial tcp: lookup openshift.default.svc.cluster.local: no such host
Unable to connect to the server: dial tcp: lookup openshift.default.svc.cluster.local: no such host
Generating kubernetes-plugin configuration (/opt/openshift/configuration/config.xml.tpl) ...
Generating kubernetes-plugin credentials (/var/lib/jenkins/credentials.xml.tpl) ...
Copying Jenkins configuration to /var/lib/jenkins ...
Copying 81 Jenkins plugins to /var/lib/jenkins ...
Creating initial Jenkins 'admin' user ...
Running from: /usr/share/jenkins/jenkins.war
webroot: EnvVars.masterEnvVars.get("JENKINS_HOME")
Jan 09, 2017 9:46:25 PM Main deleteWinstoneTempContents
WARNING: Failed to delete the temporary Winstone file /tmp/winstone/jenkins.war
Jan 09, 2017 9:46:25 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Logging initialized @836ms
Jan 09, 2017 9:46:25 PM winstone.Logger logInternal
INFO: Beginning extraction from war file
Jan 09, 2017 9:46:28 PM org.eclipse.jetty.util.log.JavaUtilLog warn
WARNING: Empty contextPath
Jan 09, 2017 9:46:28 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: jetty-9.2.z-SNAPSHOT
Jan 09, 2017 9:46:30 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
Jenkins home directory: /var/lib/jenkins found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Started w.@73db4768

{/,file:/var/lib/jenkins/war/,AVAILABLE} {/var/lib/jenkins/war}

Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Started ServerConnector@4de41af9

{HTTP/1.1} {0.0.0.0:8080}

Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Started @6459ms
Jan 09, 2017 9:46:31 PM winstone.Logger logInternal
INFO: Winstone Servlet Engine v2.0 running: controlPort=disabled
Jan 09, 2017 9:46:32 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Jan 09, 2017 9:46:45 PM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Jan 09, 2017 9:46:45 PM ruby.RubyRuntimePlugin start
INFO: Injecting JRuby into XStream
Trying to load models from /var/lib/jenkins/plugins/rvm/WEB-INF/classes/models
Loading /var/lib/jenkins/plugins/rvm/WEB-INF/classes/models/rvm_wrapper.rb
Jan 09, 2017 9:46:57 PM org.jvnet.hudson.plugins.m2release.M2ReleaseBuildWrapper$DescriptorImpl <clinit>
INFO: Using new style Permission with PermissionScope
Jan 09, 2017 9:47:07 PM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Jan 09, 2017 9:47:07 PM com.openshift.jenkins.plugins.pipeline.JenkinsServletFilter doFilter
INFO: OpenShift Pipeline: derived root URL: http://192.168.194.4:8080/
Jan 09, 2017 9:47:07 PM com.openshift.jenkins.plugins.pipeline.JenkinsServletFilter doFilter
INFO: OpenShift Pipeline: derived root URL: http://192.168.194.4:8080/
null
Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Jan 09, 2017 9:47:11 PM io.fabric8.jenkins.openshiftsync.GlobalPluginConfiguration$1 doRun
INFO: Waiting for Jenkins to be started
Jan 09, 2017 9:47:11 PM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher start
INFO: Now handling startup build configs!!
Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs
Jan 09, 2017 9:47:11 PM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Download metadata
Jan 09, 2017 9:47:12 PM org.jenkinsci.main.modules.sshd.SSHD start
INFO: Started SSHD at port 39764
Jan 09, 2017 9:47:13 PM org.springframework.context.support.AbstractApplicationContext prepareRefresh
INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@22ad4620: display name [Root WebApplicationContext]; startup date [Mon Jan 09 21:47:14 UTC 2017]; root of context hierarchy
Jan 09, 2017 9:47:14 PM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory
INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@22ad4620]: org.springframework.beans.factory.support.DefaultListableBeanFactory@33af2efe
Jan 09, 2017 9:47:14 PM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons
INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@33af2efe: defining beans [filter,legacy]; root of factory hierarchy
Jan 09, 2017 9:47:30 PM hudson.WebAppMain$3 run
INFO: Jenkins is fully up and running
Jan 09, 2017 9:47:34 PM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher$1 doRun
SEVERE: Failed to load BuildConfigs: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:483)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:60)
at io.fabric8.jenkins.openshiftsync.BuildConfigWatcher$1.doRun(BuildConfigWatcher.java:87)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.UnknownHostException: kubernetes.default
at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
at okhttp3.Dns$1.lookup(Dns.java:39)
at okhttp3.internal.connection.RouteSelector.resetNextInetSocketAddress(RouteSelector.java:172)
at okhttp3.internal.connection.RouteSelector.nextProxy(RouteSelector.java:138)
at okhttp3.internal.connection.RouteSelector.next(RouteSelector.java:80)
at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:178)
at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129)
at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98)
at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at io.fabric8.openshift.client.internal.OpenShiftOAuthInterceptor.intercept(OpenShiftOAuthInterceptor.java:65)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:170)
at okhttp3.RealCall.execute(RealCall.java:60)
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:235)
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:230)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:481)
... 10 more
Jan 09, 2017 9:47:34 PM io.fabric8.jenkins.openshiftsync.BuildWatcher$1 doRun
SEVERE: Failed to load initial Builds: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred.
at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:483)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:60)
at io.fabric8.jenkins.openshiftsync.BuildWatcher$1.doRun(BuildWatcher.java:78)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.UnknownHostException: kubernetes.default: unknown error
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
at okhttp3.Dns$1.lookup(Dns.java:39)
at okhttp3.internal.connection.RouteSelector.resetNextInetSocketAddress(RouteSelector.java:172)
at okhttp3.internal.connection.RouteSelector.nextProxy(RouteSelector.java:138)
at okhttp3.internal.connection.RouteSelector.next(RouteSelector.java:80)
at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:178)
at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129)
at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98)
at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at io.fabric8.openshift.client.internal.OpenShiftOAuthInterceptor.intercept(OpenShiftOAuthInterceptor.java:65)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92)
at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67)
at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:170)
at okhttp3.RealCall.execute(RealCall.java:60)
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:235)
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:230)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:481)
... 10 more