RE: Supporting Partial Replication
"John McMeeking" <[email protected]>
| Newsgroups | gmane.ietf.ldup |
|---|---|
| Message-ID | <[email protected]> |
See responses marked <JAM>
John McMeeking
"Steven Legg"
<steven.legg@adac To: John McMeeking/Rochester/IBM@IBMUS
el.com.au> cc: <[email protected]>
Subject: RE: Supporting Partial Replication
12/17/2001 10:59
PM
Please respond to
steven.legg
John,
John McMeeking wrote:
> I agree with Ryan on the first part of the note (I haven't gotten through
> the flurry of LDUP notes).
See my reply to Ryan for corrections and clarifications.
> But, we may have a problem with update vectors
> under partial/fractional replication.
Yes.
> Update vectors are defined per replica and per replication context
(actually,
> defined per replica, where a replica is a replicated instance of a
> replication context).
>
> If R2 is a subtree of R1, separate update vectors are maintained for both
> R2 and R1, and the problem Steven describes doesn't occur.
Yes (doh!).
> For either S1
> or S2 to replicate U1 to S3, replication context R1 must be added to S3,
> and the replication context properly initialized on S3 -- either via a
full
> update replication session, or via some other means (i.e. LDIF). At that
> point, U1 (and the rest of the entries in R1) are present on S3 and
> replication continues normally. Replication of R1 is independent of R2.
You're alluding to the flip side of what I'm saying. If the current
architecture can't support a replication topology where the servers
in a cycle hold different replication areas in the same replication
context then the choices are to not replicate, or to force all the
servers in the cycle to have the same replication area(s). Too bad
if I don't want S3 to see stuff in R1.
<JAM>
Are you talking about setting up something like this?
Server S1 hold R1 and R2
Server S2 holds R2
Server S3 holds R1 and R2
Set up replication agreements such that S1 supplies S2, S2 supplies S3 and
S3 supplies S1.
As defined (and I think we agree this is the current behavior), LDUP allows
this to be done only for R2. As S2 does not hold R1, you can not set up
replication for R1 to/from S2. As I understand it, the agreements for R1
and R2 are completely independent. For example, if I add R2 to S2, and
then set up the cycle described above, there would be at least 6
replication agreements S1->S2(R1), S1->S2(R2), S2->S3(R1), ... Going back
to the scenario described above, under LDUP you would set up two
independent cycles: S1->S2->S1 (for R1) and S1->S2->S3->S1 (for R2).
I don't see a problem.
</JAM>
> If R2 is a sparse/fractional replica of R1, R2 would not be considered a
> separate replication context. In this case, sparse/fractional replication
> is an attribute of the replicaSubentry for S3. If U1 falls within the
> attributes and/or entries specified for S3, it will be replicated under
> the replication agreements targeting S3 under R1, and the UV for S3
updated
> accordingly.
>
> What happens when S3 is a fractional replica, and U1 does not contain any
> attributes replicated to S3? draft-ietf-ldup-model-06, section 8.2,
> specifies "When fully populating or incrementally bringing up to date a
> Fractional Replica each of the Replication Updates must only
> contain updates to the attributes in the Fractional Entry Specification."
> This implies that S3 will never see U1, and thus not fully update its
> update vector until such time as it receives an update originating at the
> same server.
Do you agree that S1 will also never see U1 ?
This breaks eventual convergence.
<JAM>
Okay, now I think I understand... Let me restate this scenario:
S1 holds full replica of R1
S2 hold full replica of R1
S3 holds fractional replica of R1
Replication agreements are defined such that S1 supplies S3, S3 supplies
S2, and S2 supplies S1.
Under such an configuration, U1 is not seen by S3, as S1 doesn't replicate
it to S2. Before proceeding, let me restate that there is a difference
between holding a subtree of an area of replication and holding a
fractional replica. As I understand it, holding a subtree implies the
existance of another area of replication corresponding to that subtree --
as opposed to a sparse replica (not supported by the ldup model) which
holds some entries in an area of replication.
I see three solutions to the problem you describe:
1. Replace the restriction in ldup-model-06 8.2 such that all updates are
sent to fractional replicas. When acting as a supplier, a fractional
replica replicates all replication updates, even those that are not within
the set of attributes held by the fractional replica. Also, the fractional
replica is responsible for applying only those update primitives that are
within the fractional replica specification.
I think this would cause major problems for state-based implementations.
It seems reasonable for log-based implementations.
2. Add a resriction to the model & info model to effect that a fractional
replica cannot act as a supplier in LDUP.
In your scenario that implies S3 cannot be a supplier to S1. Thus S2 must
be a supplier to S2 and U1 and U2 are both replicated from S2 to S1. I'm
not sure how this would be done -- either the configuration is rejected
(preferred), or a fractional replica simply ignores requests to act as a
supplier. I prefer rejecting the configuration -- why let someone set up a
replication path that will never be used?
3. Add a restriction that a fractional replica can act as a supplier only
to another fractional replica, where the consumers fractional specification
is a subset of the suppliers fractional specification (i.e. the supplier
replica holds all entries/attributes held by the consumer, and may hold
more).
For your scenario, this would preclude S3 acting as a supplier to S2 (S2 -
a full replica - does not hold a subset of the attributes held be S3). I'm
not sure where/when this restriction would be enforced. It seems that
either the configuration has to be rejected outright -- topic for
management draft -- or that a supplier would have to evaluate the
fractional specifications (if any) for itself and the consumer and
determine whether it should, in fact use the agreement at all.
Assuming state-based replication remains in the standards, I think (2)
would be a much cleaner solution, and most easily implemented.
</JAM>
> Steven's example described U1 and U2 as successive updates
> originating at S2. Suppose U1 originated at S1 and U2 originated at S2:
>
> Initially, the update vector for S3 (UV3) looks like
> < Tx#1#0#0, Ty#2#0#0, null > (latest CSNs from S1 and S2, no updates
> originating at S3)
BTW, you have the second and third components of the CSNs transposed.
> At time T15, on server 1, client performs update U1: CSN = T15#1#0#0.
>
> This is replicated to S2, and eventually S2 replicates to S3. But since
> no attributes in U1 are present in S3's fractional entry specification,
> no replication occurs.
>
> Update vector for S3 remains < Tx#1#0#0, Ty#2#0#0, null >
There are some subtleties in the way that the update vector is maintained
that are not explicitly called out by the architecture draft. The update
U1 at S1 causes the update vector for S1 to be revised, but since the
CSN < T15#1#0#0 > in the update vector for S1 is an attribute value it is
tagged with a CSN! Common sense suggests this CSN should also be <
T15#1#0#0
>.
Changes to the update vector are always replicated (as add-attribute-value
primitives), so S3 will receive the change to S1's update vector because
of U1, even though it doesn't receive U1. On receiving the
add-attribute-value primitive for S1's update vector, S3 will change its
copy of S1's update vector. It will also change the CSN for S1 in it's own
update vector to < T15#1#0#0 >, the CSN on the add-attribute-value
primitive.
The update vector for S3 actually becomes < T15#1#0#0, Ty#2#0#0, null >.
The purge point advances in due course.
Regards,
Steven