1. 程式人生 > >Porting Software To IBM POWER/OpenPOWER is easy!

Porting Software To IBM POWER/OpenPOWER is easy!

The Center for Genome Research and Biocomputing (CGRB) at Oregon State works closely with its research groups to embrace new technologies. Our researchers look to the CGRB to lower the activation energy using these new technologies while increasing the scope of work and removing bias associated to computational pathways. In the last two years, our groups have been moving to machines with higher thread count and lower latency to interact with research data in new ways. Because of this move, the CGRB started looking at the IBM POWER and OpenPOWER hardware to fill this role as the hardware had recently moved to a little endian byte order format. Our groups were also looking into new methods for processing that included the use of new GPU technologies and the new POWER machines seem to be out in front on this end as well.

Compiling Tools:

To ensure that our researchers can take full advantage of the computational resources within the CGRB, our computational staff help compile and manage software packages and libraries. This process allows our researchers to focus their time and energy on the research questions and not trying to make tools and software work on computing hardware. As we moved onto the POWER architecture, we were impressed with how easy it was to compile and work with tools that were originally developed on x86 based hardware. This of course was because of the major change to little endian and this seem to change the way we were able to use the new hardware in front of us. The main trick we did to ensure software would easily compile was to go back in time and use the Autoconf tool the way it was originally designed. This was to run the command “autoconf” first which help determine the architecture and build the “configure” file based on that architecture. This was of course what we did back in the 1990’s when we had many different flavors of Unix and needed a way to compile the same tool on different architectures. Once we realized how easy it was we decided to have an undergraduate student just work on compiling tools we had on our x86 machines onto the POWER hardware. This of course worked very well and this student was able to compile over 2000 programs within a short time and my groups were quickly and easily able to start using the POWER hardware. All ported tools now have build scripts on github located at

http://github.com/ppc64le/build-scripts.

So Easy Students Can Do It:

After my student was able to get so many tools ported, we quickly compiled the binaries needed to interact with our computational cluster and made environment settings to dynamically detect the architecture and allow our users to take advantage of this hardware without even knowing they are using it. Unfortunately many tools finished faster on the new POWER hardware and users quickly figured out how to schedule directly at the POWER hardware. This of course led the CGRB research groups to start purchasing new POWER machines to do some of the big work we have, taking advantage of things like increased threading, CAPI cards (GZIP and NVMe) and NVIDIA GPGPU directly on the motherboard.

Processing Data:

Since our groups have had access to these machines, many of the limits we found doing deep-learning and AI processing disappeared and changed the scope of work we could process. For example, we have groups that are processing 100TB of data through CPU and GPU after one week at sea, mining plankton information to determine ocean health. More examples include a project that generates 250TB of data every 3 weeks of sampling to identify and quantify owl sounds in the forest. These research projects both use the CPU threading capabilities of the POWER machines and the new NVIDIA GPGPU. The new GPGPU hardware interactions on the POWER machines have changed the way we work with real data and GPU hardware.

Pitfalls and Future Direction:

There are of course a few tools that will not compile and we found that these was generally associated to the SSE, SSE2 and SSE3 libraries used by some groups to use Intel specific memory libraries. There are now new tools from IBM development group that can help developers change out these libraries for POWER based hardware and make the code work on both architectures. If the developers of tools want to get access to POWER based hardware for development or porting the CGRB has worked with the OSUOSL (https://osuosl.org) to provide free access to these new machines with GPGPU and NVMe technologies (see link below). My student was offered an internship with IBM and worked over a summer to create build scripts for these tools and provided them on the Github site.  In the end, moving onto the POWER hardware revolutionized our forward computational pathway and changed the way we approach our research questions by removing limits and extending our reach. I recently gave a talk on this process at the OpenPOWER Summit and you can find a recording of the talk in the links below.

Free Access to Development Environment:

The CGRB has worked with IBM and OpenPOWER to provide free access to POWER8/9 machines with GPU access. These machines will allow developers to gain access and work on porting tools to these incredible architectures. To get free access to these resources, simply click on the link below.

OpenPOWER GPU Free Development Access:

Github Site for PPC64LE build scripts:

OpenPOWER Summit 2018 Keynote Talk:

IBM Edge 2016 Conference Interview:

CGRB Test the CAPI Gzip Card:

 
Christopher M. Sullivan
Assistant Director for Biocomputing
Center for Genome Research and Biocomputing
Oregon State University

相關推薦

Porting Software To IBM POWER/OpenPOWER is easy!

The Center for Genome Research and Biocomputing (CGRB) at Oregon State works closely with its research groups to embrace new technologies. Our researche

Porting x86 Linux applications to IBM POWER

SUSE and IBM are helping all-sized organizations deploy and maintain mission-critical systems. SUSE provides reliable, interoperab

Porting x86 Linux applications to IBM power technical resources

Additional resources Review these resources for more information about developing on and porting to Linux on Power.

Cloud resources to try PowerAI and PowerAI vision deep learning frameworks on IBM POWER with GPUs

IBM PowerAI Vision as a Service IBM PowerAI Vision provides tools and interfaces for business analysts, subject matter experts,

CF 1005C Summarize to the Power of Two 【hash/STL-map】

eric bre rom delete there set while == [] A sequence a1,a2,…,an is called good if, for each element ai, there exists an element aj (i≠j)

Summarize to the Power of Two(map+思維)

fin bsp you -i 出現次數 出現 exists rst init A sequence a1,a2,…,ana1,a2,…,an is called good if, for each element aiai,

xcode7在真機除錯的時候出現"The identity used to sign the executable is no longer valid"

出現這個錯誤的原因是描述檔案過期. 如圖(借的圖): 大家都知道,在Xcode7中真機除錯不在需要配置開發者證書和描述檔案. 那出現這個問題的原因是Xcode自己配置的描述檔案過期. 解決辦法: 1.Xcode --

WEBGL_draw_buffers RENDER WARNING: texture bound to texture unit 0 is not..錯誤解決方案

今天在調整渲染系統中的一個MRT機制,結果不小心改錯了邏輯,執行報錯資訊:[.WebGL-00000000051B4190]RENDER WARNING: texture bound to texture unit 0 is not renderable. It maybe non-power-of

Missing parentheses in call to ‘print&’raw_input’ is not defined

括號 int nth 基於 article 3.6 parent 新版本 pytho 對於 出現Missing parentheses in call to ‘print’和’raw_input’ is not defined問題的解決 在學習Python的過程中,我安裝的

The identity used to sign the executable is no longer valid

測試環境:Xcode 7.1 , OS X 10.11 有時候回家繼續做公司專案時,真機除錯經常會碰到如下圖所示的問題 解決方法: 1.開啟鑰匙串訪問,會發現證書已被撤銷的紅色警告,選中該證書,右鍵刪除 2.接著執行專案,出

docker報錯:Cannot connect to the Docker daemon. Is the docker daemon running on this host?

docker這種報錯一般情況都是docker未啟動對於這種情況只用重啟docker就行了: service docker restart   還要一種情況則是docker配置檔案出錯按照提示檢視報錯,並找到相應位置進行更改: systemctl status do

Selenium: either the element is no longer attached to the DOM, it is not in the curren

either the element is no longer attached to the DOM, it is not in the curren 元素不再附加到DOM 解決方法 每次都重新尋找xpath,並且加上延時 while n < 30 :

[ERROR] The goal you specified requires a project to execute but there is no POM in this directory

手動新增maven構件報錯  [ERROR] The goal you specified requires a project to execute but there is no POM in this directory (C:\Windows\System32). Ple

1005C  Summarize to the Power of Two (貪心 + 煞筆的我寫了一發離散化)

Summarize to the Power of Two 題意:給定一個數組,問陣列中每一個元素 a[i] ,  是否存在另一個元素 a[j], 使 a[i] + a[j] 是 2 的次冪, i != j 思路:貪心,先打出足夠的

Implement pow(x, n), which calculates x raised to the power n (xn).

Implement pow(x, n), which calculates x raised to the power n (xn). thoughts: 求一個數的power 數目, 虛擬碼如下: 如果n=0 ,返回1.否則返回1,返回的2, n=-1,返回-

Given two strings s and t, write a function to determine if t is an anagram of s.

Given two strings s and t, write a function to determine if t is an anagram of s. For example, s = "anagram", t = "nagaram", return tru

三星7nm EUV拿下大訂單 將代工IBM Power處理器

在UMC(聯電)和GF(AMD合作伙伴)放棄後向10nm及以下製程下探之後,只剩下臺積電、三星和Intel三家有實力做到10nm及更小的製程工藝。 臺積電由於在第一代選擇DUV光刻技術,所以7nm製程最先量產,目前已經拿到了蘋果、AMD、高通、華為等大客戶的訂單。三星則步伐稍慢,因為其第一代7nm用的是EU

AI CEO: The Best Way To Avoid Killer Robots Is To Ignore Them

The best way to avoid the harm that killer robotics and artificial intelligence can cause is to just ignore it or focus on the good this technology could d

Apple patents software to warn users when calls come from a fake spam number

Gogole boasts its AI will allow the Pixel 3 to answer calls for you. 'First, starting out in English in the U.S., Pixel 3's on-device AI helps you screen p

GITEX to showcase power of Artificial Intelligence

Dubai: Artificial Intelligence-powered services, such as customer call management system and drone-based statistician, will be showcased at Smart Dubai's p