ISO 6.1 staging jobs failure due: can't access to github

[Vasyl Saienko]

http://jenkins-product.srt.mirantis.net:8080/view/All/job/6.1.test_staging_mirror/180
http://jenkins-product.srt.mirantis.net:8080/job/6.1.staging.iso/185

Started by upstream project "6.1.test_staging_mirror" build number 180
originally caused by:
 Started by upstream project "6.1.build_staging_mirror" build number 197
 originally caused by:
  Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mc0n1-msk.msk.mirantis.net in workspace /home/jenkins/workspace/6.1.staging.iso
Checkout:6.1.staging.iso / /home/jenkins/workspace/6.1.staging.iso - hudson.remoting.Channel@53abcc10:mc0n1-msk.msk.mirantis.net
Using strategy: Default
Last Built Revision: Revision 320b5f46fc1b2798f9e86ed7df51d3bda1686c10 (origin/master)
Fetching changes from 1 remote Git repository
Fetching upstream changes from https://github.com/stackforge/fuel-main.git
ERROR: Problem fetching from origin / origin - could be unavailable. Continuing anyway
hudson.util.IOException2: remote file operation failed: /home/jenkins/workspace/6.1.staging.iso at hudson.remoting.Channel@53abcc10:mc0n1-msk.msk.mirantis.net
 at hudson.FilePath.act(FilePath.java:901)
 at hudson.FilePath.act(FilePath.java:878)
 at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1064)
 at hudson.model.AbstractProject.checkout(AbstractProject.java:1376)
 at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:676)
 at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:581)
 at hudson.model.Run.execute(Run.java:1593)
 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
 at hudson.model.ResourceController.execute(ResourceController.java:88)
 at hudson.model.Executor.run(Executor.java:247)
Caused by: java.io.IOException: Remote call on mc0n1-msk.msk.mirantis.net failed
 at hudson.remoting.Channel.call(Channel.java:731)
 at hudson.FilePath.act(FilePath.java:894)
 ... 10 more
Caused by: java.lang.VerifyError: (class: org/apache/commons/codec/binary/Base64OutputStream, method: <init> signature: (Ljava/io/OutputStream;ZI[B)V) Incompatible argument to function
 at hudson.console.ConsoleNote.encodeToBytes(ConsoleNote.java:180)
 at hudson.console.ConsoleNote.encodeTo(ConsoleNote.java:158)
 at hudson.util.StreamTaskListener.annotate(StreamTaskListener.java:157)
 at hudson.util.StreamTaskListener._error(StreamTaskListener.java:132)
 at hudson.util.StreamTaskListener.error(StreamTaskListener.java:141)
 at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:815)
 at hudson.plugins.git.GitSCM.access$100(GitSCM.java:90)
 at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:1096)
 at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:1064)
 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2393)
 at hudson.remoting.UserRequest.perform(UserRequest.java:118)
 at hudson.remoting.UserRequest.perform(UserRequest.java:48)
 at hudson.remoting.Request$2.run(Request.java:326)
 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at hudson.remoting.Engine$1$1.run(Engine.java:63)
 at java.lang.Thread.run(Thread.java:745)
Archiving artifacts
Description set:
Email was triggered for: Failure
Sending email for trigger: Failure
Sending email to: <email address hidden> <email address hidden>
Triggering a new build of fuel_build_reports #566
Finished: FAILURE

[Vasyl Saienko (vsaienko)]

http://jenkins-product.srt.mirantis.net:8080/job/6.1.staging.iso/187 also failed

[Vasyl Saienko (vsaienko)]

Connection to githuib: 192.30.252.128 are timed out randomly from mks, bud, kha even my home. It looks like github issue

vsaienko@mc0n1-msk:~$ time telnet 192.30.252.128 80
Trying 192.30.252.128...
Connected to 192.30.252.128.
Escape character is '^]'.
^C^CConnection closed by foreign host.

real 0m0.996s
user 0m0.000s
sys 0m0.003s
vsaienko@mc0n1-msk:~$ time telnet 192.30.252.128 80
Trying 192.30.252.128...
^C

real 0m51.391s
user 0m0.002s
sys 0m0.000s
vsaienko@mc0n1-msk:~$ mtr -rn 192.30.252.128
Start: Fri Mar 27 08:09:02 2015
HOST: mc0n1-msk.msk.mirantis.net Loss% Snt Last Avg Best Wrst StDev
  1.|-- 172.18.8.2 0.0% 10 0.2 0.2 0.2 0.3 0.0
  2.|-- 172.18.25.125 0.0% 10 0.7 0.8 0.5 1.8 0.0
  3.|-- 172.18.25.106 0.0% 10 1.1 1.3 0.8 2.6 0.3
  4.|-- 172.18.25.70 0.0% 10 1.6 1.5 1.0 2.1 0.0
  5.|-- 80.76.236.145 0.0% 10 11.4 3.4 1.7 11.4 2.9
  6.|-- 193.106.112.3 0.0% 10 3.3 5.1 2.6 23.1 6.3
  7.|-- 193.106.115.38 10.0% 10 43.4 41.5 39.2 44.5 1.8
  8.|-- 80.81.193.70 0.0% 10 48.2 47.8 47.5 49.0 0.3
  9.|-- 72.52.48.157 0.0% 10 47.4 47.7 47.4 48.2 0.0
 10.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0

[Igor Belikov (ibelikov)]

From status.github.com:
"10:00 UTCWe continue to respond to an ongoing DDoS attack. Some users may experience intermittent connectivity with git operations as we mitigate the problem."

We changed github.com to git.openstack.org in our jobs (https://review.fuel-infra.org/#/c/5029/)