Re: Heterogenous database usage, anyone?

Shlomi Fish <shlomif-ik1l9ssToec+JF/[email protected]> Sun, 31 Jul 2011 19:44:24 +0300
Newsgroups	gmane.culture.hackers.israel
Organization	IGLU
Message-ID	<[email protected]>
--5vjdk8zjvVnuL-E6AYMYxwsF02lWOmOOM0mS-Em
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Omer,

On Sat, 30 Jul 2011 18:05:00 +0300
Omer Zak <w1-W6cp89mEpD1mR6Xm/[email protected]> wrote:

> Is there anyone with experience with using an heterogenous database
> setup?
> There is some data, which is natural for RDBMS storage.
> There is data which needs to be ACID-compliant (such as accounting
> information).
> There is data which does not benefit from the rigid structure of RDBMS
> (such as documents and images).
>=20
> Different kinds of data also differ in their
> storage/retrieval/availability/searchability needs.
>=20
> So it is reasonable to use a different DBMS technology to store each
> kind of table.
>=20
> However, sometimes it is needed to link together those different
> technologies.  For example, if one wants to run a query on a multi-table
> join where the tables (or their equivalents in technologies which have
> no concept of a table) reside in different DBMS.
>

During my first year at the Technion (1997ish), I briefly worked for a comp=
any
called ISG (=3D =E2=80=9CInternational Software Group=E2=80=9D IIRC) that d=
eveloped a product
called =E2=80=9CISG Navigator=E2=80=9D. It may have been discontinued becau=
se the best I could
find about it on Google is:

http://h18000.www1.hp.com/products/quickspecs/10562_na/10562_na.HTML

which is from 2001 and mentions a lot of out-of-date technologies (and does=
 not
mention many more recently popular ones).

In any case, what this ISG Navigator did was allow one to access data
(CRUD/etc.) from multiple different databases of different SQL and non-SQL
database servers, using the same unified interface, including crossing data
from multiple different sources. Some Perl mongers I talked with about that=
,
said that they'd rather not use something like that, because there would be=
 a
problem of maintaining data consistency and integrity across different serv=
ers.
Maybe ISG Navigator had a way to overcome this.

Since then I have not really thought about this problem, and it's possible
there was too little demand for something like ISG Navigator to provide for
continued research into this issue.

Regards,

	Shlomi Fish

--=20
-----------------------------------------------------------------
Shlomi Fish       http://www.shlomifish.org/
"Humanity" - Parody of Modern Life - http://shlom.in/humanity

If you have the same ideas as everybody else, but have them one week earlie=
r
than everyone else =E2=80=94 then you will be hailed as a visionary. But if=
 you have
them five years earlier, you will be named a lunatic. ( Barry Jones )

Please reply to list if it's a mailing list post - http://shlom.in/reply .

--5vjdk8zjvVnuL-E6AYMYxwsF02lWOmOOM0mS-Em
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable




<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/htm=
l4/strict.dtd">
<html>
<head>
</head>







<body style=3D"background-color: #fff;">
<span style=3D"display:none">&nbsp;</span>

<!--~-|**|PrettyHtmlStartT|**|-~-->
<div id=3D"ygrp-mlmsg" style=3D"position:relative;">
  <div id=3D"ygrp-msg" style=3D"z-index: 1;">
<!--~-|**|PrettyHtmlEndT|**|-~-->

    <div id=3D"ygrp-text" >
=20=20=20=20=20=20
=20=20=20=20=20=20
      <p>Hi Omer,<br>
<br>
On Sat, 30 Jul 2011 18:05:00 &#43;0300<br>
Omer Zak &lt;<a href=3D"mailto:w1%40zak.co.il">w1-W6cp89mEpD1mR6Xm/[email protected]</a>&gt; wrote:<=
br>
<br>
&gt; Is there anyone with experience with using an heterogenous database<br=
>
&gt; setup?<br>
&gt; There is some data, which is natural for RDBMS storage.<br>
&gt; There is data which needs to be ACID-compliant (such as accounting<br>
&gt; information).<br>
&gt; There is data which does not benefit from the rigid structure of RDBMS=
<br>
&gt; (such as documents and images).<br>
&gt; <br>
&gt; Different kinds of data also differ in their<br>
&gt; storage/retrieval/availability/searchability needs.<br>
&gt; <br>
&gt; So it is reasonable to use a different DBMS technology to store each<b=
r>
&gt; kind of table.<br>
&gt; <br>
&gt; However, sometimes it is needed to link together those different<br>
&gt; technologies.  For example, if one wants to run a query on a multi-tab=
le<br>
&gt; join where the tables (or their equivalents in technologies which have=
<br>
&gt; no concept of a table) reside in different DBMS.<br>
&gt;<br>
<br>
During my first year at the Technion (1997ish), I briefly worked for a comp=
any<br>
called ISG (=3D =E2=80=9CInternational Software Group=E2=80=9D IIRC) that d=
eveloped a product<br>
called =E2=80=9CISG Navigator=E2=80=9D. It may have been discontinued becau=
se the best I could<br>
find about it on Google is:<br>
<br>
<a href=3D"http://h18000.www1.hp.com/products/quickspecs/10562_na/10562_na.=
HTML">http://h18000.www1.hp.com/products/quickspecs/10562_na/10562_na.HTML<=
/a><br>
<br>
which is from 2001 and mentions a lot of out-of-date technologies (and does=
 not<br>
mention many more recently popular ones).<br>
<br>
In any case, what this ISG Navigator did was allow one to access data<br>
(CRUD/etc.) from multiple different databases of different SQL and non-SQL<=
br>
database servers, using the same unified interface, including crossing data=
<br>
from multiple different sources. Some Perl mongers I talked with about that=
,<br>
said that they'd rather not use something like that, because there would be=
 a<br>
problem of maintaining data consistency and integrity across different serv=
ers.<br>
Maybe ISG Navigator had a way to overcome this.<br>
<br>
Since then I have not really thought about this problem, and it's possible<=
br>
there was too little demand for something like ISG Navigator to provide for=
<br>
continued research into this issue.<br>
<br>
Regards,<br>
<br>
	Shlomi Fish<br>
<br>
-- <br>
----------------------------------------------------------<br>
Shlomi Fish       <a href=3D"http://www.shlomifish.org/">http://www.shlomif=
ish.org/</a><br>
&quot;Humanity&quot; - Parody of Modern Life - <a href=3D"http://shlom.in/h=
umanity">http://shlom.in/humanity</a><br>
<br>
If you have the same ideas as everybody else, but have them one week earlie=
r<br>
than everyone else =E2=80=94 then you will be hailed as a visionary. But if=
 you have<br>
them five years earlier, you will be named a lunatic. ( Barry Jones )<br>
<br>
Please reply to list if it's a mailing list post - <a href=3D"http://shlom.=
in/reply">http://shlom.in/reply</a> .<br>
</p>

    </div>
=20=20=20=20=20

    <!--~-|**|PrettyHtmlStart|**|-~-->
    <div style=3D"color: #fff; height: 0;">__._,_.___</div>

=20=20=20=20=20=20=20=20
=20=20
=20=20=20
    <div id=3D"ygrp-actbar" style=3D"clear: both; margin-bottom: 10px; whit=
e-space: nowrap; color: #666; padding-top: 15px;">
      <div>
        <a href=3D"mailto:shlomif-ik1l9ssToec+JF/[email protected]?subject=3DRe%3A%20%5Bhackers-=
il%5D%20Heterogenous%20database%20usage%2C%20anyone%3F" style=3D"margin-rig=
ht: 0; padding-right: 0;">
	  Reply to <span style=3D"font-weight: 700;">sender</span></a> |
        <a href=3D"mailto:[email protected]?subject=3DRe%3A%20%5Bh=
ackers-il%5D%20Heterogenous%20database%20usage%2C%20anyone%3F">
	  Reply to <span style=3D"font-weight: 700;">group</span></a> |
        	  <a href=3D"http://groups.yahoo.com/group/hackers-il/post;_ylc=3D=
X3oDMTJwNmlnM29yBF9TAzk3MzU5NzE0BGdycElkAzE4NTczMzIEZ3Jwc3BJZAMxNzA1MDA2NzY=
0BG1zZ0lkAzUxNjUEc2VjA2Z0cgRzbGsDcnBseQRzdGltZQMxMzEyMTMwNjc1?act=3Dreply&m=
essageNum=3D5165">Reply <span style=3D"font-weight: 700;">via web post</spa=
n></a> |
            	<a href=3D"http://groups.yahoo.com/group/hackers-il/post;_ylc=
=3DX3oDMTJldTNybGZkBF9TAzk3MzU5NzE0BGdycElkAzE4NTczMzIEZ3Jwc3BJZAMxNzA1MDA2=
NzY0BHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTMxMjEzMDY3NQ--" style=3D"font-weight:=
 700;">Start a New Topic</a>
      </div>

                <a href=3D"http://groups.yahoo.com/group/hackers-il/message=
/5164;_ylc=3DX3oDMTM0aGRsZ2gxBF9TAzk3MzU5NzE0BGdycElkAzE4NTczMzIEZ3Jwc3BJZA=
MxNzA1MDA2NzY0BG1zZ0lkAzUxNjUEc2VjA2Z0cgRzbGsDdnRwYwRzdGltZQMxMzEyMTMwNjc1B=
HRwY0lkAzUxNjQ-">Messages in this topic</a>
          (<span style=3D"font-weight: 700;">2</span>)
          </div>=20
<!------- Start Nav Bar ------>

<!-- |**|begin egp html banner|**| -->
<div id=3D"ygrp-vital" style=3D"background-color: #e0ecee; font-family: Ver=
dana; font-size: 10px; margin-bottom: 10px; padding: 10px;">
      <span id=3D"vithd" style=3D"font-weight: bold; color: #333; text-tran=
sform: uppercase; ">Recent Activity:</span>

    <ul style=3D"list-style-type: none; margin: 0; padding: 0; display: inl=
ine;">
                                                    </ul>
=20=20=20=20
  <div style=3D"clear: both; padding-top: 2px; color: #1e66ae;">
    <a href=3D"http://groups.yahoo.com/group/hackers-il;_ylc=3DX3oDMTJlajRj=
NXE3BF9TAzk3MzU5NzE0BGdycElkAzE4NTczMzIEZ3Jwc3BJZAMxNzA1MDA2NzY0BHNlYwN2dGw=
Ec2xrA3ZnaHAEc3RpbWUDMTMxMjEzMDY3NQ--" style=3D"text-decoration: none;">Vis=
it Your Group</a>
  </div>
</div>

=20=20
<div id=3D"ft" style=3D"font-family: Arial; font-size: 11px; margin-top: 5p=
x; padding: 0 2px 0 0; clear: both;">
  <a href=3D"http://groups.yahoo.com/;_ylc=3DX3oDMTJkMGNta3Z2BF9TAzk3MzU5Nz=
E0BGdycElkAzE4NTczMzIEZ3Jwc3BJZAMxNzA1MDA2NzY0BHNlYwNmdHIEc2xrA2dmcARzdGltZ=
QMxMzEyMTMwNjc1" style=3D"float: left;"><img src=3D"http://l.yimg.com/a/i/u=
s/yg/logo/us.gif" height=3D"15" width=3D"137" alt=3D"Yahoo! Groups" style=
=3D"border: 0;"/></a>
  <div style=3D"color: #747575; float: right;">Switch to: <a href=3D"mailto=
:[email protected]?subject=3DChange Delivery Format: T=
raditional" style=3D"text-decoration: none;">Text-Only</a>, <a href=3D"mail=
to:[email protected]?subject=3DEmail Delivery: Digest" clas=
s=3D"margin-rt" style=3D"text-decoration: none;">Daily Digest</a> &bull; <a=
 href=3D"mailto:[email protected]?subject=3DUnsubscrib=
e" style=3D"text-decoration: none;">Unsubscribe</a> &bull; <a href=3D"http:=
//docs.yahoo.com/info/terms/" style=3D"text-decoration: none;">Terms of Use=
</a></div>
</div>

<!-- |**|end egp html banner|**| -->

  </div> <!-- ygrp-msg -->

  <!-- Sponsor -->
  <!-- |**|begin egp html banner|**| -->
  <div id=3D"ygrp-sponsor" style=3D"width:160px; float:right; clear:none; m=
argin:0 0 25px 0; background: #fff;">

<!-- Start Recommendations -->
<div id=3D"ygrp-reco">
     </div>
<!-- End Recommendations -->



  </div>   <!-- |**|end egp html banner|**| -->

  <div style=3D"clear:both; color: #FFF; font-size:1px;">.</div>
</div>

  <img src=3D"http://geo.yahoo.com/serv?s=3D97359714/grpId=3D1857332/grpspI=
d=3D1705006764/msgId=3D5165/stime=3D1312130675/nc1=3D1/nc2=3D2/nc3=3D3" wid=
th=3D"1" height=3D"1"> <br>

<div style=3D"color: #fff; height: 0;">__,_._,___</div>
<!--~-|**|PrettyHtmlEnd|**|-~-->

</body>

<!--~-|**|PrettyHtmlStart|**|-~-->
<head>
  <style type=3D"text/css">
  <!--
  #ygrp-mkp {
  border: 1px solid #d8d8d8;
  font-family: Arial;
  margin: 10px 0;
  padding: 0 10px;
}

#ygrp-mkp hr {
  border: 1px solid #d8d8d8;
}

#ygrp-mkp #hd {
  color: #628c2a;
  font-size: 85%;
  font-weight: 700;
  line-height: 122%;
  margin: 10px 0;
}

#ygrp-mkp #ads {
  margin-bottom: 10px;
}

#ygrp-mkp .ad {
  padding: 0 0;
}

#ygrp-mkp .ad p {
  margin: 0;
}

#ygrp-mkp .ad a {
  color: #0000ff;
  text-decoration: none;
}
  #ygrp-sponsor #ygrp-lc {
  font-family: Arial;
}

#ygrp-sponsor #ygrp-lc #hd {
  margin: 10px 0px;
  font-weight: 700;
  font-size: 78%;
  line-height: 122%;
}

#ygrp-sponsor #ygrp-lc .ad {
  margin-bottom: 10px;
  padding: 0 0;
}

  a {
    color: #1e66ae;
  }

  #actions {
    font-family: Verdana;
    font-size: 11px;
    padding: 10px 0;
  }

  #activity {
    background-color: #e0ecee;
    float: left;
    font-family: Verdana;
    font-size: 10px;
    padding: 10px;
  }

  #activity span {
    font-weight: 700;
  }

  #activity span:first-child {
    text-transform: uppercase;
  }

  #activity span a {
    color: #5085b6;
    text-decoration: none;
  }

  #activity span span {
    color: #ff7900;
  }

  #activity span .underline {
    text-decoration: underline;
  }

  .attach {
    clear: both;
    display: table;
    font-family: Arial;
    font-size: 12px;
    padding: 10px 0;
    width: 400px;
  }

  .attach div a {
    text-decoration: none;
  }

  .attach img {
    border: none;
    padding-right: 5px;
  }

  .attach label {
    display: block;
    margin-bottom: 5px;
  }

  .attach label a {
    text-decoration: none;
  }
=20=20
  blockquote {
    margin: 0 0 0 4px;
  }

  .bold {
    font-family: Arial;
    font-size: 13px;
    font-weight: 700;
  }

  .bold a {
    text-decoration: none;
  }

  dd.last p a {
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span {
    margin-right: 10px;
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span.yshortcuts {
    margin-right: 0;
  }

  div.attach-table div div a {
    text-decoration: none;
  }

  div.attach-table {
    width: 400px;
  }

  div.file-title a, div.file-title a:active, div.file-title a:hover, div.fi=
le-title a:visited {
    text-decoration: none;
  }

  div.photo-title a, div.photo-title a:active, div.photo-title a:hover, div=
.photo-title a:visited {
    text-decoration: none;
  }

  div#ygrp-mlmsg #ygrp-msg p a span.yshortcuts {
    font-family: Verdana;
    font-size: 10px;
    font-weight: normal;
  }

  .green {
    color: #628c2a;
  }

  .MsoNormal {
    margin: 0 0 0 0;
  }

  o {
    font-size: 0;
  }

  #photos div {
    float: left;
    width: 72px;
  }

  #photos div div {
    border: 1px solid #666666;
    height: 62px;
    overflow: hidden;
    width: 62px;
  }

  #photos div label {
    color: #666666;
    font-size: 10px;
    overflow: hidden;
    text-align: center;
    white-space: nowrap;
    width: 64px;
  }

  #reco-category {
    font-size: 77%;
  }

  #reco-desc {
    font-size: 77%;
  }

  .replbq {
    margin: 4px;
  }

  #ygrp-actbar div a:first-child {
   /* border-right: 0px solid #000;*/
    margin-right: 2px;
    padding-right: 5px;
  }

  #ygrp-mlmsg {
    font-size: 13px;
    font-family: Arial, helvetica,clean, sans-serif;
    *font-size: small;
    *font: x-small;
  }

  #ygrp-mlmsg table {
    font-size: inherit;
    font: 100%;
  }

  #ygrp-mlmsg select, input, textarea {
    font: 99% Arial, Helvetica, clean, sans-serif;
  }

  #ygrp-mlmsg pre, code {
    font:115% monospace;
    *font-size:100%;
  }

  #ygrp-mlmsg * {
    line-height: 1.22em;
  }

  #ygrp-mlmsg #logo {
    padding-bottom: 10px;
  }

  #ygrp-mlmsg a {
    color: #1E66AE;
  }

  #ygrp-msg p a {
    font-family: Verdana;
  }

  #ygrp-msg p#attach-count span {
    color: #1E66AE;
    font-weight: 700;
  }

  #ygrp-reco #reco-head {
    color: #ff7900;
    font-weight: 700;
  }

  #ygrp-reco {
    margin-bottom: 20px;
    padding: 0px;
  }

  #ygrp-sponsor #ov li a {
    font-size: 130%;
    text-decoration: none;
  }

  #ygrp-sponsor #ov li {
    font-size: 77%;
    list-style-type: square;
    padding: 6px 0;
  }=20

  #ygrp-sponsor #ov ul {
    margin: 0;
    padding: 0 0 0 8px;
  }

  #ygrp-text {
    font-family: Georgia;
  }

  #ygrp-text p {
    margin: 0 0 1em 0;
  }

  #ygrp-text tt {
    font-size: 120%;
  }

  #ygrp-vital ul li:last-child {
    border-right: none !important;=20
  }=20
  -->
  </style>
</head>

<!--~-|**|PrettyHtmlEnd|**|-~-->
</html>
<!-- end group email -->


--5vjdk8zjvVnuL-E6AYMYxwsF02lWOmOOM0mS-Em--