[OPAE] hello_fpga hangs forever for xeon with integrated fpga

Jin Mingjian <jin.phd at gmail.com> Thu, 14 Feb 2019 17:58:08 +0800
Newsgroups dev.linux.lists.opae
Message-ID <CAHrJpRrQH1pXd4Hhp2yUbKhfNDAfZBDPdXiuYsE5500ijnNn=w@mail.gmail.com>
--===============1014976485178244341==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Hello,

accidentally, I got a skylake-sp with integrated fpga.

After some investigations, I find I could not drive it for anything. I am a
little surprising and not sure if your guys can give some lights?

1. default shipped stuff does not work although basic cmds works:

under centos 7.4:
---------- fpgainfo fme ----------
Board Management Controller, microcontroller FW version unavailable
Last Power Down Cause: unavailable
Last Reset Cause: unavailable (can't open)
//****** FME ******//
Object Id                     : 0xEF00000
PCIe s:b:d:f                  : 0000:7E:00:0
Device Id                     : 0xBCC0
Socket Id                     : 0x00
Ports Num                     : 01
Bitstream Id                  : 0x6400002FC614BB9
Bitstream Version             : 0x558900000406
Pr Interface Id               : 1a422218-6dba-448e-b302-425cbcde1406

---------- fpgainfo bmc ----------
Board Management Controller, microcontroller FW version unavailable
Last Power Down Cause: unavailable
Last Reset Cause: unavailable (can't open)
//****** BMC SENSORS ******//
Object Id                     : 0xEF00000
PCIe s:b:d:f                  : 0000:7E:00:0
Device Id                     : 0xBCC0
Socket Id                     : 0x00
Ports Num                     : 01
Bitstream Id                  : 0x6400002FC614BB9
Bitstream Version             : 0x560000000406
Pr Interface Id               : 1a422218-6dba-448e-b302-425cbcde1406

---------- fpgainfo port ----------
//****** PORT ******//
Object Id                     : 0xEC00000
PCIe s:b:d:f                  : 0000:7E:00:0
Device Id                     : 0xBCC0
Socket Id                     : 0x00
Ports Num                     : 01
Bitstream Id                  : 0x6400002FC614BB9
Bitstream Version             : 6.4.0
Pr Interface Id               : 1a422218-6dba-448e-b302-425cbcde1406
Accelerator Id                : d8424dc4-a4a3-c413-f89e-433683f9040b
Accelerator GUID              : d8424dc4-a4a3-c413-f89e-433683f9040b

hello_fpga hangs forever:
...
run on bus 0x7e
(hangs forever here)

And nlb0 output like this:
[2860][ERROR][nlb0] test timeout at 1 cachelines.


under kernel 4.20.x with upstreaming DFL driver:
the output is same like below (except that the Socket Id is show as 0xFF,
in fact there seems no "Socket Id" exposed under DFL driver).


now my question is: how to further debug for this case?(assumed the cpu
should work)


2. the downloadable acceleration-stack[1] is just for PAC, not
for intg_xeon.
So I can not use this tool to re-generate/re-config a new gbs in that the
bbs for intg_xeon does not exist. And so the naming of "Intel=C2=AE Acceler=
ation
Stack for Intel Xeon=C2=AE CPU with FPGAs" is a little deceptive. Or (hopef=
ully)
am I wrong about this tool?



best regards,
Jin Mingjian

[1]
https://www.intel.com/content/www/us/en/programmable/solutions/acceleration=
-hub/acceleration-stack.html

--===============1014976485178244341==
Content-Type: text/html
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="attachment.html"

PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0
ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9
Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBk
aXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRp
dj5IZWxsbyw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2IGRpcj0ibHRyIj5hY2NpZGVudGFsbHks
IEkgZ290IGEgc2t5bGFrZS1zcCB3aXRoIGludGVncmF0ZWQgZnBnYS7CoDwvZGl2PjxkaXYgZGly
PSJsdHIiPjxicj48L2Rpdj48ZGl2IGRpcj0ibHRyIj5BZnRlciBzb21lIGludmVzdGlnYXRpb25z
LCBJIGZpbmQgSSBjb3VsZCBub3QgZHJpdmUgaXQgZm9yIGFueXRoaW5nLiBJIGFtIGEgbGl0dGxl
IHN1cnByaXNpbmcgYW5kIG5vdCBzdXJlIGlmIHlvdXIgZ3V5cyBjYW4gZ2l2ZSBzb21lIGxpZ2h0
cz88L2Rpdj48ZGl2IGRpcj0ibHRyIj48ZGl2Pjxicj48L2Rpdj48ZGl2PjEuIGRlZmF1bHQgc2hp
cHBlZCBzdHVmZiBkb2VzIG5vdCB3b3JrIGFsdGhvdWdoIGJhc2ljIGNtZHMgd29ya3M6PC9kaXY+
PGRpdj48YnI+PC9kaXY+PGRpdj51bmRlciBjZW50b3MgNy40OjwvZGl2PjxkaXY+LS0tLS0tLS0t
LSBmcGdhaW5mbyBmbWUgLS0tLS0tLS0tLcKgIMKgIMKgIMKgwqA8YnI+PC9kaXY+PGRpdj48ZGl2
PkJvYXJkIE1hbmFnZW1lbnQgQ29udHJvbGxlciwgbWljcm9jb250cm9sbGVyIEZXIHZlcnNpb24g
dW5hdmFpbGFibGU8L2Rpdj48ZGl2Pkxhc3QgUG93ZXIgRG93biBDYXVzZTogdW5hdmFpbGFibGU8
L2Rpdj48ZGl2Pkxhc3QgUmVzZXQgQ2F1c2U6IHVuYXZhaWxhYmxlIChjYW4mIzM5O3Qgb3Blbik8
L2Rpdj48ZGl2Pi8vKioqKioqIEZNRSAqKioqKiovLzwvZGl2PjxkaXY+T2JqZWN0IElkwqAgwqAg
wqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA6IDB4RUYwMDAwMDwvZGl2PjxkaXY+UENJZSBzOmI6
ZDpmwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgOiAwMDAwOjdFOjAwOjA8L2Rpdj48ZGl2PkRl
dmljZSBJZMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgOiAweEJDQzA8L2Rpdj48ZGl2
PlNvY2tldCBJZMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgOiAweDAwPC9kaXY+PGRp
dj5Qb3J0cyBOdW3CoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDogMDE8L2Rpdj48ZGl2
PkJpdHN0cmVhbSBJZMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDogMHg2NDAwMDAyRkM2MTRC
Qjk8L2Rpdj48ZGl2PkJpdHN0cmVhbSBWZXJzaW9uwqAgwqAgwqAgwqAgwqAgwqAgwqA6IDB4NTU4
OTAwMDAwNDA2PC9kaXY+PGRpdj5QciBJbnRlcmZhY2UgSWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDC
oDogMWE0MjIyMTgtNmRiYS00NDhlLWIzMDItNDI1Y2JjZGUxNDA2PC9kaXY+PC9kaXY+PGRpdj48
YnI+PC9kaXY+PGRpdj4tLS0tLS0tLS0tIGZwZ2FpbmZvIGJtYyAtLS0tLS0tLS0twqAgwqAgwqAg
wqDCoDxicj48L2Rpdj48ZGl2PjxkaXY+Qm9hcmQgTWFuYWdlbWVudCBDb250cm9sbGVyLCBtaWNy
b2NvbnRyb2xsZXIgRlcgdmVyc2lvbiB1bmF2YWlsYWJsZTwvZGl2PjxkaXY+TGFzdCBQb3dlciBE
b3duIENhdXNlOiB1bmF2YWlsYWJsZTwvZGl2PjxkaXY+TGFzdCBSZXNldCBDYXVzZTogdW5hdmFp
bGFibGUgKGNhbiYjMzk7dCBvcGVuKTwvZGl2PjxkaXY+Ly8qKioqKiogQk1DIFNFTlNPUlMgKioq
KioqLy88L2Rpdj48ZGl2Pk9iamVjdCBJZMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
OiAweEVGMDAwMDA8L2Rpdj48ZGl2PlBDSWUgczpiOmQ6ZsKgIMKgIMKgIMKgIMKgIMKgIMKgIMKg
IMKgIDogMDAwMDo3RTowMDowPC9kaXY+PGRpdj5EZXZpY2UgSWTCoCDCoCDCoCDCoCDCoCDCoCDC
oCDCoCDCoCDCoCDCoDogMHhCQ0MwPC9kaXY+PGRpdj5Tb2NrZXQgSWTCoCDCoCDCoCDCoCDCoCDC
oCDCoCDCoCDCoCDCoCDCoDogMHgwMDwvZGl2PjxkaXY+UG9ydHMgTnVtwqAgwqAgwqAgwqAgwqAg
wqAgwqAgwqAgwqAgwqAgwqA6IDAxPC9kaXY+PGRpdj5CaXRzdHJlYW0gSWTCoCDCoCDCoCDCoCDC
oCDCoCDCoCDCoCDCoCA6IDB4NjQwMDAwMkZDNjE0QkI5PC9kaXY+PGRpdj5CaXRzdHJlYW0gVmVy
c2lvbsKgIMKgIMKgIMKgIMKgIMKgIMKgOiAweDU2MDAwMDAwMDQwNjwvZGl2PjxkaXY+UHIgSW50
ZXJmYWNlIElkwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA6IDFhNDIyMjE4LTZkYmEtNDQ4ZS1iMzAy
LTQyNWNiY2RlMTQwNjwvZGl2PjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+PGRpdj4tLS0tLS0t
LS0tIGZwZ2FpbmZvIHBvcnQgLS0tLS0tLS0tLcKgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAg
wqAgwqDCoDxicj48L2Rpdj48ZGl2Pi8vKioqKioqIFBPUlQgKioqKioqLy88L2Rpdj48ZGl2Pk9i
amVjdCBJZMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgOiAweEVDMDAwMDA8L2Rpdj48
ZGl2PlBDSWUgczpiOmQ6ZsKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIMKgIDogMDAwMDo3RTowMDow
PC9kaXY+PGRpdj5EZXZpY2UgSWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDogMHhC
Q0MwPC9kaXY+PGRpdj5Tb2NrZXQgSWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoDog
MHgwMDwvZGl2PjxkaXY+UG9ydHMgTnVtwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqAgwqA6
IDAxPC9kaXY+PGRpdj5CaXRzdHJlYW0gSWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCA6IDB4
NjQwMDAwMkZDNjE0QkI5PC9kaXY+PGRpdj5CaXRzdHJlYW0gVmVyc2lvbsKgIMKgIMKgIMKgIMKg
IMKgIMKgOiA2LjQuMDwvZGl2PjxkaXY+UHIgSW50ZXJmYWNlIElkwqAgwqAgwqAgwqAgwqAgwqAg
wqAgwqA6IDFhNDIyMjE4LTZkYmEtNDQ4ZS1iMzAyLTQyNWNiY2RlMTQwNjwvZGl2PjxkaXY+QWNj
ZWxlcmF0b3IgSWTCoCDCoCDCoCDCoCDCoCDCoCDCoCDCoCA6IGQ4NDI0ZGM0LWE0YTMtYzQxMy1m
ODllLTQzMzY4M2Y5MDQwYjwvZGl2PjxkaXY+QWNjZWxlcmF0b3IgR1VJRMKgIMKgIMKgIMKgIMKg
IMKgIMKgIDogZDg0MjRkYzQtYTRhMy1jNDEzLWY4OWUtNDMzNjgzZjkwNDBiPC9kaXY+PGRpdj48
YnI+PC9kaXY+PGRpdj5oZWxsb19mcGdhIGhhbmdzIGZvcmV2ZXI6PC9kaXY+PGRpdj4uLi48L2Rp
dj48ZGl2PnJ1biBvbiBidXMgMHg3ZTwvZGl2PjxkaXY+KGhhbmdzIGZvcmV2ZXIgaGVyZSk8L2Rp
dj48ZGl2Pjxicj48L2Rpdj48ZGl2PkFuZCBubGIwIG91dHB1dCBsaWtlIHRoaXM6wqA8L2Rpdj48
ZGl2PlsyODYwXVtFUlJPUl1bbmxiMF0gdGVzdCB0aW1lb3V0IGF0IDEgY2FjaGVsaW5lcy48YnI+
PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj51bmRlciBrZXJuZWwgNC4y
MC54IHdpdGggdXBzdHJlYW1pbmcgREZMIGRyaXZlcjo8L2Rpdj48ZGl2PnRoZSBvdXRwdXQgaXMg
c2FtZSBsaWtlIGJlbG93IChleGNlcHQgdGhhdCB0aGUgU29ja2V0IElkIGlzIHNob3cgYXMgMHhG
RiwgaW4gZmFjdCB0aGVyZSBzZWVtcyBubyAmcXVvdDtTb2NrZXQgSWQmcXVvdDsgZXhwb3NlZCB1
bmRlciBERkwgZHJpdmVyKS48L2Rpdj48ZGl2PsKgPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5u
b3cgbXkgcXVlc3Rpb24gaXM6IGhvdyB0byBmdXJ0aGVyIGRlYnVnIGZvciB0aGlzIGNhc2U/KGFz
c3VtZWQgdGhlIGNwdSBzaG91bGQgd29yayk8L2Rpdj48ZGl2Pjxicj48L2Rpdj48L2Rpdj48ZGl2
Pjxicj48L2Rpdj48ZGl2PjIuIHRoZSBkb3dubG9hZGFibGUgYWNjZWxlcmF0aW9uLXN0YWNrWzFd
IGlzIGp1c3QgZm9yIFBBQywgbm90IGZvcsKgaW50Z194ZW9uLsKgPC9kaXY+PGRpdj5TbyBJIGNh
biBub3QgdXNlIHRoaXMgdG9vbCB0byByZS1nZW5lcmF0ZS9yZS1jb25maWcgYSBuZXcgZ2JzIGlu
IHRoYXQgdGhlIGJicyBmb3IgaW50Z194ZW9uwqBkb2VzIG5vdCBleGlzdC4gQW5kIHNvIHRoZSBu
YW1pbmcgb2YgJnF1b3Q7SW50ZWzCriBBY2NlbGVyYXRpb24gU3RhY2sgZm9yIEludGVsIFhlb27C
riBDUFUgd2l0aCBGUEdBcyZxdW90OyBpcyBhIGxpdHRsZcKgZGVjZXB0aXZlLiBPciAoaG9wZWZ1
bGx5KSBhbSBJIHdyb25nIGFib3V0IHRoaXMgdG9vbD88L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2
Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PmJlc3QgcmVnYXJkcyw8YnI+PC9kaXY+PGRp
dj5KaW4gTWluZ2ppYW48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlsxXSA8YSBocmVmPSJodHRw
czovL3d3dy5pbnRlbC5jb20vY29udGVudC93d3cvdXMvZW4vcHJvZ3JhbW1hYmxlL3NvbHV0aW9u
cy9hY2NlbGVyYXRpb24taHViL2FjY2VsZXJhdGlvbi1zdGFjay5odG1sIiB0YXJnZXQ9Il9ibGFu
ayI+aHR0cHM6Ly93d3cuaW50ZWwuY29tL2NvbnRlbnQvd3d3L3VzL2VuL3Byb2dyYW1tYWJsZS9z
b2x1dGlvbnMvYWNjZWxlcmF0aW9uLWh1Yi9hY2NlbGVyYXRpb24tc3RhY2suaHRtbDwvYT48L2Rp
dj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48
L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4K

--===============1014976485178244341==--