[lkb] dummy qeq relations lead to big memory consumption during generation

This is a multi-part message in MIME format.
--------------090806060106020406050403
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Hello,

I woke up in the morning and found the LOGON/LKB generator hung on one 
MRS generation and ate up to 14 GB of memory. The reason turned out to 
be that I forgot to clean up the HCONS list in a modified MRS.

For instance, the original sentence is:

Corn, rice, fruit, cotton, hay, tobacco, and sugar are some of the crops 
that are grown near old rivers.

My program replaced the coordination phrase with "what" to produce a 
"what" question:

What are some of the crops that are grown near old rivers?

But it didn't remove all the qeq relations introduced by "Corn, rice, 
fruit, cotton, hay, tobacco, and sugar". Then the generation time seemed 
to take forever...

I'd be very interested to know why this happened: if a qeq relation "h1 
qeq h2" doesn't exist in an MRS, how can it cause a huge memory 
footprint? I thought they should be discarded automatically by LKB -- 
though it's my fault not to do it from my codes.;-)

The sample MRX file is attached in case someone's interested. Generation 
can be invoked by:

(lkb::generate-from-mrs (mrs::read-single-mrs-xml-file "/tmp/t.xml"))

Xuchen

--------------090806060106020406050403
Content-Type: text/xml;
 name="t.xml"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
 filename="t.xml"

<mrs><label vid=3D"1"/><var vid=3D"2"/><ep cfrom=3D"55" cto=3D"58"><pred>=
_BE_V_ID_REL</pred><label vid=3D"68"/><fvpair><rargname>ARG0</rargname><v=
ar vid=3D"2" sort=3D"e"><extrapair><path>SF</path><value>QUES</value></ex=
trapair><extrapair><path>TENSE</path><value>PRES</value></extrapair><extr=
apair><path>MOOD</path><value>INDICATIVE</value></extrapair><extrapair><p=
ath>PROG</path><value>-</value></extrapair><extrapair><path>PERF</path><v=
alue>-</value></extrapair></var></fvpair><fvpair><rargname>ARG1</rargname=
><var vid=3D"6" sort=3D"x"><extrapair><path>PERS</path><value>3</value></=
extrapair><extrapair><path>NUM</path><value>PL</value></extrapair></var><=
/fvpair><fvpair><rargname>ARG2</rargname><var vid=3D"69" sort=3D"x"><extr=
apair><path>PERS</path><value>3</value></extrapair><extrapair><path>NUM</=
path><value>PL</value></extrapair></var></fvpair></ep><ep cfrom=3D"59" ct=
o=3D"63"><pred>_SOME_Q_REL</pred><label vid=3D"70"/><fvpair><rargname>ARG=
0</rargname><var vid=3D"69" sort=3D"x"><extrapair><path>PERS</path><value=
>3</value></extrapair><extrapair><path>NUM</path><value>PL</value></extra=
pair></var></fvpair><fvpair><rargname>RSTR</rargname><var vid=3D"71" sort=
=3D"h"/></fvpair><fvpair><rargname>BODY</rargname><var vid=3D"72" sort=3D=
"h"/></fvpair></ep><ep cfrom=3D"59" cto=3D"63"><pred>PART_OF_REL</pred><l=
abel vid=3D"73"/><fvpair><rargname>ARG0</rargname><var vid=3D"69" sort=3D=
"x"><extrapair><path>PERS</path><value>3</value></extrapair><extrapair><p=
ath>NUM</path><value>PL</value></extrapair></var></fvpair><fvpair><rargna=
me>ARG1</rargname><var vid=3D"74" sort=3D"x"><extrapair><path>PERS</path>=
<value>3</value></extrapair><extrapair><path>NUM</path><value>PL</value><=
/extrapair><extrapair><path>IND</path><value>+</value></extrapair></var><=
/fvpair></ep><ep cfrom=3D"67" cto=3D"70"><pred>_THE_Q_REL</pred><label vi=
d=3D"75"/><fvpair><rargname>ARG0</rargname><var vid=3D"74" sort=3D"x"><ex=
trapair><path>PERS</path><value>3</value></extrapair><extrapair><path>NUM=
</path><value>PL</value></extrapair><extrapair><path>IND</path><value>+</=
value></extrapair></var></fvpair><fvpair><rargname>RSTR</rargname><var vi=
d=3D"77" sort=3D"h"/></fvpair><fvpair><rargname>BODY</rargname><var vid=3D=
"76" sort=3D"h"/></fvpair></ep><ep cfrom=3D"71" cto=3D"76"><spred>_crop_n=
_1_rel</spred><label vid=3D"78"/><fvpair><rargname>ARG0</rargname><var vi=
d=3D"74" sort=3D"x"><extrapair><path>PERS</path><value>3</value></extrapa=
ir><extrapair><path>NUM</path><value>PL</value></extrapair><extrapair><pa=
th>IND</path><value>+</value></extrapair></var></fvpair></ep><ep cfrom=3D=
"86" cto=3D"91"><spred>_grow_v_cause_rel</spred><label vid=3D"78"/><fvpai=
r><rargname>ARG0</rargname><var vid=3D"79" sort=3D"e"><extrapair><path>SF=
</path><value>PROP</value></extrapair><extrapair><path>TENSE</path><value=
>PRES</value></extrapair><extrapair><path>MOOD</path><value>INDICATIVE</v=
alue></extrapair><extrapair><path>PROG</path><value>-</value></extrapair>=
<extrapair><path>PERF</path><value>-</value></extrapair></var></fvpair><f=
vpair><rargname>ARG1</rargname><var vid=3D"80" sort=3D"p"/></fvpair><fvpa=
ir><rargname>ARG2</rargname><var vid=3D"74" sort=3D"x"><extrapair><path>P=
ERS</path><value>3</value></extrapair><extrapair><path>NUM</path><value>P=
L</value></extrapair><extrapair><path>IND</path><value>+</value></extrapa=
ir></var></fvpair></ep><ep cfrom=3D"86" cto=3D"91"><pred>PARG_D_REL</pred=
><label vid=3D"78"/><fvpair><rargname>ARG0</rargname><var vid=3D"81" sort=
=3D"e"><extrapair><path>SF</path><value>PROP</value></extrapair></var></f=
vpair><fvpair><rargname>ARG1</rargname><var vid=3D"79" sort=3D"e"><extrap=
air><path>SF</path><value>PROP</value></extrapair><extrapair><path>TENSE<=
/path><value>PRES</value></extrapair><extrapair><path>MOOD</path><value>I=
NDICATIVE</value></extrapair><extrapair><path>PROG</path><value>-</value>=
</extrapair><extrapair><path>PERF</path><value>-</value></extrapair></var=
></fvpair><fvpair><rargname>ARG2</rargname><var vid=3D"74" sort=3D"x"><ex=
trapair><path>PERS</path><value>3</value></extrapair><extrapair><path>NUM=
</path><value>PL</value></extrapair><extrapair><path>IND</path><value>+</=
value></extrapair></var></fvpair></ep><ep cfrom=3D"92" cto=3D"96"><pred>_=
NEAR_P_REL</pred><label vid=3D"78"/><fvpair><rargname>ARG0</rargname><var=
 vid=3D"82" sort=3D"e"><extrapair><path>SF</path><value>PROP</value></ext=
rapair><extrapair><path>TENSE</path><value>UNTENSED</value></extrapair><e=
xtrapair><path>MOOD</path><value>INDICATIVE</value></extrapair></var></fv=
pair><fvpair><rargname>ARG1</rargname><var vid=3D"79" sort=3D"e"><extrapa=
ir><path>SF</path><value>PROP</value></extrapair><extrapair><path>TENSE</=
path><value>PRES</value></extrapair><extrapair><path>MOOD</path><value>IN=
DICATIVE</value></extrapair><extrapair><path>PROG</path><value>-</value><=
/extrapair><extrapair><path>PERF</path><value>-</value></extrapair></var>=
</fvpair><fvpair><rargname>ARG2</rargname><var vid=3D"83" sort=3D"x"><ext=
rapair><path>PERS</path><value>3</value></extrapair><extrapair><path>NUM<=
/path><value>PL</value></extrapair><extrapair><path>IND</path><value>+</v=
alue></extrapair></var></fvpair></ep><ep cfrom=3D"97" cto=3D"109"><pred>U=
DEF_Q_REL</pred><label vid=3D"84"/><fvpair><rargname>ARG0</rargname><var =
vid=3D"83" sort=3D"x"><extrapair><path>PERS</path><value>3</value></extra=
pair><extrapair><path>NUM</path><value>PL</value></extrapair><extrapair><=
path>IND</path><value>+</value></extrapair></var></fvpair><fvpair><rargna=
me>RSTR</rargname><var vid=3D"86" sort=3D"h"/></fvpair><fvpair><rargname>=
BODY</rargname><var vid=3D"85" sort=3D"h"/></fvpair></ep><ep cfrom=3D"97"=
 cto=3D"100"><spred>_old_a_1_rel</spred><label vid=3D"87"/><fvpair><rargn=
ame>ARG0</rargname><var vid=3D"88" sort=3D"e"><extrapair><path>SF</path><=
value>PROP</value></extrapair><extrapair><path>TENSE</path><value>UNTENSE=
D</value></extrapair><extrapair><path>MOOD</path><value>INDICATIVE</value=
></extrapair></var></fvpair><fvpair><rargname>ARG1</rargname><var vid=3D"=
83" sort=3D"x"><extrapair><path>PERS</path><value>3</value></extrapair><e=
xtrapair><path>NUM</path><value>PL</value></extrapair><extrapair><path>IN=
D</path><value>+</value></extrapair></var></fvpair></ep><ep cfrom=3D"101"=
 cto=3D"109"><spred>_river_n_of_rel</spred><label vid=3D"87"/><fvpair><ra=
rgname>ARG0</rargname><var vid=3D"83" sort=3D"x"><extrapair><path>PERS</p=
ath><value>3</value></extrapair><extrapair><path>NUM</path><value>PL</val=
ue></extrapair><extrapair><path>IND</path><value>+</value></extrapair></v=
ar></fvpair><fvpair><rargname>ARG1</rargname><var vid=3D"89" sort=3D"i"/>=
</fvpair></ep><ep cfrom=3D"0" cto=3D"0"><pred>WHICH_Q_REL</pred><label vi=
d=3D"90"/><fvpair><rargname>ARG0</rargname><var vid=3D"6" sort=3D"x"><ext=
rapair><path>PERS</path><value>3</value></extrapair><extrapair><path>NUM<=
/path><value>PL</value></extrapair></var></fvpair><fvpair><rargname>RSTR<=
/rargname><var vid=3D"92" sort=3D"h"/></fvpair><fvpair><rargname>BODY</ra=
rgname><var vid=3D"93" sort=3D"h"/></fvpair></ep><ep cfrom=3D"0" cto=3D"0=
"><pred>THING_REL</pred><label vid=3D"91"/><fvpair><rargname>ARG0</rargna=
me><var vid=3D"6" sort=3D"x"><extrapair><path>PERS</path><value>3</value>=
</extrapair><extrapair><path>NUM</path><value>PL</value></extrapair></var=
></fvpair></ep><hcons hreln=3D"qeq"><hi><var vid=3D"5" sort=3D"h"/></hi><=
lo><var vid=3D"16" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><var=
 vid=3D"9" sort=3D"h"/></hi><lo><var vid=3D"11" sort=3D"h"/></lo></hcons>=
<hcons hreln=3D"qeq"><hi><var vid=3D"13" sort=3D"h"/></hi><lo><var vid=3D=
"26" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"19" so=
rt=3D"h"/></hi><lo><var vid=3D"21" sort=3D"h"/></lo></hcons><hcons hreln=3D=
"qeq"><hi><var vid=3D"23" sort=3D"h"/></hi><lo><var vid=3D"36" sort=3D"h"=
/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"29" sort=3D"h"/></hi>=
<lo><var vid=3D"31" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><va=
r vid=3D"33" sort=3D"h"/></hi><lo><var vid=3D"46" sort=3D"h"/></lo></hcon=
s><hcons hreln=3D"qeq"><hi><var vid=3D"39" sort=3D"h"/></hi><lo><var vid=3D=
"41" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"43" so=
rt=3D"h"/></hi><lo><var vid=3D"56" sort=3D"h"/></lo></hcons><hcons hreln=3D=
"qeq"><hi><var vid=3D"49" sort=3D"h"/></hi><lo><var vid=3D"51" sort=3D"h"=
/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"55" sort=3D"h"/></hi>=
<lo><var vid=3D"62" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><va=
r vid=3D"59" sort=3D"h"/></hi><lo><var vid=3D"61" sort=3D"h"/></lo></hcon=
s><hcons hreln=3D"qeq"><hi><var vid=3D"65" sort=3D"h"/></hi><lo><var vid=3D=
"67" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"71" so=
rt=3D"h"/></hi><lo><var vid=3D"73" sort=3D"h"/></lo></hcons><hcons hreln=3D=
"qeq"><hi><var vid=3D"77" sort=3D"h"/></hi><lo><var vid=3D"78" sort=3D"h"=
/></lo></hcons><hcons hreln=3D"qeq"><hi><var vid=3D"86" sort=3D"h"/></hi>=
<lo><var vid=3D"87" sort=3D"h"/></lo></hcons><hcons hreln=3D"qeq"><hi><va=
r vid=3D"92" sort=3D"h"/></hi><lo><var vid=3D"91" sort=3D"h"/></lo></hcon=
s></mrs>



--------------090806060106020406050403
Content-Type: text/plain;
 name="t.mrs"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="t.mrs"

U2VudFR5cGU6IFdIQVQKRGVjb21wb3NlcjogW10KTFRPUDogaDEKSU5ERVg6IGUyClJFTFM6
IDwKWyBfQkVfVl9JRF9SRUw8NTU6NTg+CiAgTEJMOiBoNjgKICBBUkcwOiBlMiBbIGUgU0Y6
IFFVRVMgVEVOU0U6IFBSRVMgTU9PRDogSU5ESUNBVElWRSBQUk9HOiAtIFBFUkY6IC0gXQog
IEFSRzE6IHg2IFsgeCBQRVJTOiAzIE5VTTogUEwgXQogIEFSRzI6IHg2OSBbIHggUEVSUzog
MyBOVU06IFBMIF0KXQoJRE1SUzogWyAtLUFSRzEvTkVRLT4gV0hJQ0hfUV9SRUwsICAtLUFS
RzIvTkVRLT4gX1NPTUVfUV9SRUxdClsgX1NPTUVfUV9SRUw8NTk6NjM+CiAgTEJMOiBoNzAK
ICBBUkcwOiB4NjkgWyB4IFBFUlM6IDMgTlVNOiBQTCBdCiAgUlNUUjogaDcxCiAgQk9EWTog
aDcyCl0KCURNUlM6IFsgLS1SU1RSL0gtPiBQQVJUX09GX1JFTCwgIDwtQVJHMi9ORVEtLSBf
QkVfVl9JRF9SRUxdClsgUEFSVF9PRl9SRUw8NTk6NjM+CiAgTEJMOiBoNzMKICBBUkcwOiB4
NjkgWyB4IFBFUlM6IDMgTlVNOiBQTCBdCiAgQVJHMTogeDc0IFsgeCBQRVJTOiAzIE5VTTog
UEwgSU5EOiArIF0KXQoJRE1SUzogWyA8LVJTVFIvSC0tIF9TT01FX1FfUkVMLCAgLS1BUkcx
L05FUS0+IF9USEVfUV9SRUxdClsgX1RIRV9RX1JFTDw2Nzo3MD4KICBMQkw6IGg3NQogIEFS
RzA6IHg3NCBbIHggUEVSUzogMyBOVU06IFBMIElORDogKyBdCiAgUlNUUjogaDc3CiAgQk9E
WTogaDc2Cl0KCURNUlM6IFsgPC1BUkcyL05FUS0tIF9ncm93X3ZfY2F1c2VfcmVsLCAgLS1S
U1RSL0gtPiBfY3JvcF9uXzFfcmVsLCAgPC1BUkcyL05FUS0tIFBBUkdfRF9SRUwsICA8LUFS
RzEvTkVRLS0gUEFSVF9PRl9SRUxdClsgX2Nyb3Bfbl8xX3JlbDw3MTo3Nj4KICBMQkw6IGg3
OAogIEFSRzA6IHg3NCBbIHggUEVSUzogMyBOVU06IFBMIElORDogKyBdCl0KCURNUlM6IFsg
PC1SU1RSL0gtLSBfVEhFX1FfUkVMXQpbIF9ncm93X3ZfY2F1c2VfcmVsPDg2OjkxPgogIExC
TDogaDc4CiAgQVJHMDogZTc5IFsgZSBTRjogUFJPUCBURU5TRTogUFJFUyBNT09EOiBJTkRJ
Q0FUSVZFIFBST0c6IC0gUEVSRjogLSBdCiAgQVJHMTogcDgwCiAgQVJHMjogeDc0IFsgeCBQ
RVJTOiAzIE5VTTogUEwgSU5EOiArIF0KXQoJRE1SUzogWyAtLUFSRzEvTlVMTC0tIG51bGws
ICA8LUFSRzEvRVEtLSBQQVJHX0RfUkVMLCAgPC1BUkcxL0VRLS0gX05FQVJfUF9SRUwsICAt
LUFSRzIvTkVRLT4gX1RIRV9RX1JFTF0KWyBQQVJHX0RfUkVMPDg2OjkxPgogIExCTDogaDc4
CiAgQVJHMDogZTgxIFsgZSBTRjogUFJPUCBdCiAgQVJHMTogZTc5IFsgZSBTRjogUFJPUCBU
RU5TRTogUFJFUyBNT09EOiBJTkRJQ0FUSVZFIFBST0c6IC0gUEVSRjogLSBdCiAgQVJHMjog
eDc0IFsgeCBQRVJTOiAzIE5VTTogUEwgSU5EOiArIF0KXQoJRE1SUzogWyAtLUFSRzEvRVEt
PiBfZ3Jvd192X2NhdXNlX3JlbCwgIC0tQVJHMi9ORVEtPiBfVEhFX1FfUkVMXQpbIF9ORUFS
X1BfUkVMPDkyOjk2PgogIExCTDogaDc4CiAgQVJHMDogZTgyIFsgZSBTRjogUFJPUCBURU5T
RTogVU5URU5TRUQgTU9PRDogSU5ESUNBVElWRSBdCiAgQVJHMTogZTc5IFsgZSBTRjogUFJP
UCBURU5TRTogUFJFUyBNT09EOiBJTkRJQ0FUSVZFIFBST0c6IC0gUEVSRjogLSBdCiAgQVJH
MjogeDgzIFsgeCBQRVJTOiAzIE5VTTogUEwgSU5EOiArIF0KXQoJRE1SUzogWyAtLUFSRzIv
TkVRLT4gVURFRl9RX1JFTCwgIC0tQVJHMS9FUS0+IF9ncm93X3ZfY2F1c2VfcmVsXQpbIFVE
RUZfUV9SRUw8OTc6MTA5PgogIExCTDogaDg0CiAgQVJHMDogeDgzIFsgeCBQRVJTOiAzIE5V
TTogUEwgSU5EOiArIF0KICBSU1RSOiBoODYKICBCT0RZOiBoODUKXQoJRE1SUzogWyA8LUFS
RzIvTkVRLS0gX05FQVJfUF9SRUwsICAtLVJTVFIvSC0+IF9yaXZlcl9uX29mX3JlbCwgIDwt
QVJHMS9ORVEtLSBfb2xkX2FfMV9yZWxdClsgX29sZF9hXzFfcmVsPDk3OjEwMD4KICBMQkw6
IGg4NwogIEFSRzA6IGU4OCBbIGUgU0Y6IFBST1AgVEVOU0U6IFVOVEVOU0VEIE1PT0Q6IElO
RElDQVRJVkUgXQogIEFSRzE6IHg4MyBbIHggUEVSUzogMyBOVU06IFBMIElORDogKyBdCl0K
CURNUlM6IFsgLS1BUkcxL05FUS0+IFVERUZfUV9SRUxdClsgX3JpdmVyX25fb2ZfcmVsPDEw
MToxMDk+CiAgTEJMOiBoODcKICBBUkcwOiB4ODMgWyB4IFBFUlM6IDMgTlVNOiBQTCBJTkQ6
ICsgXQogIEFSRzE6IGk4OQpdCglETVJTOiBbIC0tQVJHMS9OVUxMLS0gbnVsbCwgIDwtUlNU
Ui9ILS0gVURFRl9RX1JFTF0KWyBXSElDSF9RX1JFTDwwOjA+CiAgTEJMOiBoOTAKICBBUkcw
OiB4NiBbIHggUEVSUzogMyBOVU06IFBMIF0KICBSU1RSOiBoOTIKICBCT0RZOiBoOTMKXQoJ
RE1SUzogWyAtLVJTVFIvSC0+IFRISU5HX1JFTCwgIDwtQVJHMS9ORVEtLSBfQkVfVl9JRF9S
RUxdClsgVEhJTkdfUkVMPDA6MD4KICBMQkw6IGg5MQogIEFSRzA6IHg2IFsgeCBQRVJTOiAz
IE5VTTogUEwgXQpdCglETVJTOiBbIDwtUlNUUi9ILS0gV0hJQ0hfUV9SRUxdCj4KSENPTlM6
IDwgaDUgcWVxIGgxNiBoOSBxZXEgaDExIGgxMyBxZXEgaDI2IGgxOSBxZXEgaDIxIGgyMyBx
ZXEgaDM2IGgyOSBxZXEgaDMxIGgzMyBxZXEgaDQ2IGgzOSBxZXEgaDQxIGg0MyBxZXEgaDU2
IGg0OSBxZXEgaDUxIGg1NSBxZXEgaDYyIGg1OSBxZXEgaDYxIGg2NSBxZXEgaDY3IGg3MSBx
ZXEgaDczIGg3NyBxZXEgaDc4IGg4NiBxZXEgaDg3IGg5MiBxZXEgaDkxID4KCgo=
--------------090806060106020406050403--