Illegal instruction at Travis CI

[certik]

As reported here:

https://groups.google.com/d/topic/travis-ci/26n1N8Jiyb4/discussion

Below are all builds 80-117 (both failing and working). And all failing builds 1-79 (the builds that worked are not listed).

Before

Builds that fail:

https://travis-ci.org/#!/certik/hfsolver/jobs/2685436 ppp1.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/jobs/2685336 ppp1.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/jobs/2648071 ppp1.worker.travis-ci.org:php-2
https://travis-ci.org/#!/certik/hfsolver/jobs/2684505 ppp1.worker.travis-ci.org:php-2
https://travis-ci.org/#!/certik/hfsolver/jobs/2672574 ppp1.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2648071 ppp1.worker.travis-ci.org:php-2

https://travis-ci.org/#!/certik/hfsolver/jobs/2440462 ppp1.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/jobs/2532876 ppp1.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2533937 ppp1.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/jobs/2542619 ppp1.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2552088 ppp1.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/jobs/2632309 ppp1.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/jobs/2632693 ppp1.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/jobs/2632798 ppp1.worker.travis-ci.org:php-2
https://travis-ci.org/#!/certik/hfsolver/jobs/2645498 ppp1.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2647667 ppp1.worker.travis-ci.org:php-5

Builds that worked:

https://travis-ci.org/#!/certik/hfsolver/jobs/2685312 ppp2.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2684638 ppp2.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2671106 ppp3.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2685299 ppp4.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2685451 ppp2.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/jobs/2684484 ppp3.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2683882 ppp3.worker.travis-ci.org:php-2
https://travis-ci.org/#!/certik/hfsolver/jobs/2683363 ppp4.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2673000 ppp3.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/jobs/2654465 ppp4.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2653859 ppp4.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/jobs/2653549 ppp4.worker.travis-ci.org:php-2

After instrumentation:

Builds that fail:

https://travis-ci.org/#!/certik/hfsolver/builds/2699327 ppp1.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/builds/2699331 ppp1.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/builds/2699344 ppp1.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/builds/2699346 ppp1.worker.travis-ci.org:php-3

Builds that work:

https://travis-ci.org/#!/certik/hfsolver/builds/2698791 ppp3.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/jobs/2698841 ppp4.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/builds/2698767 ppp2.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/jobs/2698669 ppp4.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/jobs/2699069 ppp2.worker.travis-ci.org:php-4
https://travis-ci.org/#!/certik/hfsolver/builds/2699096 ppp4.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/builds/2699281 ppp2.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/builds/2699283 ppp4.worker.travis-ci.org:php-3
https://travis-ci.org/#!/certik/hfsolver/builds/2699329 ppp4.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/builds/2699340 ppp2.worker.travis-ci.org:php-1
https://travis-ci.org/#!/certik/hfsolver/builds/2699342 ppp2.worker.travis-ci.org:php-5
https://travis-ci.org/#!/certik/hfsolver/builds/2699353 ppp4.worker.travis-ci.org:php-4

Hardware

ppp1: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
ppp2: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz
ppp3: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
ppp4: Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz

[certik]

The issue is that openmp+release mode sometimes fails on one of the compute nodes. So we simply turn openmp off for release mode and things work. Keeping this open if somebody wants to investigate more. Detailed analysis of this problem is given here:

https://groups.google.com/d/msg/travis-ci/26n1N8Jiyb4/E-jzN7TS620J

[jeffhammond]

@certik Or you could replace -march=native with -mtune=generic (or whatever -mtune corresponds to the least common denominator ISA for Travis CI).