org.alfresco.repo.search.impl.lucene

Class AbstractLuceneIndexerImpl<T>

java.lang.Object

org.alfresco.repo.search.impl.lucene.AbstractLuceneBase

org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerImpl<T>

Type Parameters:

T - - the type used to generate the key in the index file

All Implemented Interfaces:

Indexer

Direct Known Subclasses:

ADMLuceneIndexerImpl

public abstract class AbstractLuceneIndexerImpl<T>
extends AbstractLuceneBase
implements Indexer

Common support for indexing across implementations

Author:

andyh

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	AbstractLuceneIndexerImpl.Action Enum for indexing actions against a node
protected static class	AbstractLuceneIndexerImpl.Command<S>
protected static class	AbstractLuceneIndexerImpl.FTSStatus
protected static class	AbstractLuceneIndexerImpl.IndexUpdateStatus

Field Summary

Fields

Modifier and Type	Field and Description
protected NodeBulkLoader	bulkLoader
protected List<AbstractLuceneIndexerImpl.Command<T>>	commandList List of pending indexing commands.
protected Set<String>	containerDeletions A list of cascading container deletions we have made - at merge these deletions need to be made against the main index.
protected Set<String>	deletions A list of all deletions we have made - at merge these deletions need to be made against the main index.
protected long	docs
protected AbstractLuceneIndexerImpl.IndexUpdateStatus	indexUpdateStatus Flag to indicte if we are doing an in transactional delta or a batch update to the index.
protected long	maxAtomicTransformationTime the maximum transformation time to allow atomically, defaulting to 20ms
static String	NOT_INDEXED_CONTENT_MISSING No content
static String	NOT_INDEXED_NO_TRANSFORMATION No transform available
static String	NOT_INDEXED_NO_TYPE_CONVERSION No type conversion
static String	NOT_INDEXED_TRANSFORMATION_FAILED Tranfrom failed
protected TransactionService	transactionService

Fields inherited from class org.alfresco.repo.search.impl.lucene.AbstractLuceneBase

deltaId, store

Constructor Summary

Constructors

Constructor and Description
AbstractLuceneIndexerImpl()

Method Summary

Modifier and Type	Method and Description
protected void	checkAbleToDoWork(AbstractLuceneIndexerImpl.IndexUpdateStatus indexUpdateStatus) Utility method to check we are in the correct state to do work Also keeps track of the dirty flag.
void	commit() Commit this index
protected void	delete(T ref)
protected static Set<String>	deleteContainerAndBelow(String nodeRef, org.apache.lucene.index.IndexReader reader, boolean delete, boolean cascade)
protected static Set<String>	deletePrimary(Collection<String> nodeRefs, org.apache.lucene.index.IndexReader reader, boolean delete)
protected static Set<String>	deleteReference(Collection<String> nodeRefs, org.apache.lucene.index.IndexReader reader, boolean delete)
protected abstract void	doCommit()
protected <T2> T2	doInReadthroughTransaction(RetryingTransactionHelper.RetryingTransactionCallback<T2> callback)
protected abstract void	doPrepare()
protected abstract void	doRollBack()
protected abstract void	doSetRollbackOnly()
Set<String>	getContainerDeletions() Get the container deletions
Set<String>	getDeletions() Get the deletions
protected void	index(T ref)
boolean	isModified() Has this index been modified?
protected boolean	locateContainer(String nodeRef, org.apache.lucene.index.IndexReader reader)
int	prepare() Prepare to commit At the moment this makes sure we have all the locks TODO: This is not doing proper serialisation against the index as would a data base transaction.
protected void	reindex(T ref, boolean cascadeReindexDirectories)
void	rollback() Roll back the index changes (this just means they are never added)
void	setBulkLoader(NodeBulkLoader bulkLoader)
void	setMaxAtomicTransformationTime(long maxAtomicTransformationTime) Set the max time allowed to transform content atomically
void	setReadThrough(boolean isReadThrough) Activates 'read through' behaviour for this indexer.
void	setRollbackOnly() Mark this index for roll back only.
void	setTransactionService(TransactionService transactionService)

Methods inherited from class org.alfresco.repo.search.impl.lucene.AbstractLuceneBase

closeDeltaReader, closeDeltaWriter, deleteIndex, doReadOnly, getDeltaId, getDeltaReader, getDeltaWriter, getDictionaryService, getLuceneConfig, getReader, getSearcher, getSearcher, getStatus, initialise, saveDelta, setDictionaryService, setInfo, setLuceneConfig, setStatus

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.alfresco.repo.search.Indexer

createChildRelationship, createNode, deleteChildRelationship, deleteIndex, deleteNode, detectNodeChanges, flushPending, updateChildRelationship, updateNode

Field Detail

docs

protected long docs

transactionService

protected TransactionService transactionService

bulkLoader

protected NodeBulkLoader bulkLoader

NOT_INDEXED_NO_TRANSFORMATION

public static final String NOT_INDEXED_NO_TRANSFORMATION

No transform available

See Also:

Constant Field Values

NOT_INDEXED_TRANSFORMATION_FAILED

public static final String NOT_INDEXED_TRANSFORMATION_FAILED

Tranfrom failed

See Also:

Constant Field Values

NOT_INDEXED_CONTENT_MISSING

public static final String NOT_INDEXED_CONTENT_MISSING

No content

See Also:

Constant Field Values

NOT_INDEXED_NO_TYPE_CONVERSION

public static final String NOT_INDEXED_NO_TYPE_CONVERSION

No type conversion

See Also:

Constant Field Values

maxAtomicTransformationTime

protected long maxAtomicTransformationTime

the maximum transformation time to allow atomically, defaulting to 20ms

deletions

protected Set<String> deletions

A list of all deletions we have made - at merge these deletions need to be made against the main index. TODO: Consider if this information needs to be persisted for recovery

containerDeletions

protected Set<String> containerDeletions

A list of cascading container deletions we have made - at merge these deletions need to be made against the main index.

commandList

protected List<AbstractLuceneIndexerImpl.Command<T>> commandList

List of pending indexing commands.

indexUpdateStatus

protected AbstractLuceneIndexerImpl.IndexUpdateStatus indexUpdateStatus

Flag to indicte if we are doing an in transactional delta or a batch update to the index. If true, we are just fixing up non atomically indexed things from one or more other updates.

Constructor Detail

AbstractLuceneIndexerImpl

public AbstractLuceneIndexerImpl()

Method Detail

setReadThrough

public void setReadThrough(boolean isReadThrough)

Description copied from interface: Indexer

Activates 'read through' behaviour for this indexer. Rather than accessing the database through the current (potentially old) transaction, it will use a discrete read only transaction for each node it indexes. This avoids 'stale' nodes building up in the caches during long reindex runs.

Specified by:

setReadThrough in interface Indexer

Parameters:

isReadThrough - boolean

setTransactionService

public void setTransactionService(TransactionService transactionService)

setBulkLoader

public void setBulkLoader(NodeBulkLoader bulkLoader)

Parameters:

bulkLoader - object to provide node loading options

deletePrimary

protected static Set<String> deletePrimary(Collection<String> nodeRefs,
                                           org.apache.lucene.index.IndexReader reader,
                                           boolean delete)
                                    throws LuceneIndexException

Throws:

LuceneIndexException

deleteReference

protected static Set<String> deleteReference(Collection<String> nodeRefs,
                                             org.apache.lucene.index.IndexReader reader,
                                             boolean delete)
                                      throws LuceneIndexException

Throws:

LuceneIndexException

deleteContainerAndBelow

protected static Set<String> deleteContainerAndBelow(String nodeRef,
                                                     org.apache.lucene.index.IndexReader reader,
                                                     boolean delete,
                                                     boolean cascade)
                                              throws LuceneIndexException

Throws:

LuceneIndexException

locateContainer

protected boolean locateContainer(String nodeRef,
                                  org.apache.lucene.index.IndexReader reader)

setMaxAtomicTransformationTime

public void setMaxAtomicTransformationTime(long maxAtomicTransformationTime)

Set the max time allowed to transform content atomically

Parameters:

maxAtomicTransformationTime - long

checkAbleToDoWork

protected void checkAbleToDoWork(AbstractLuceneIndexerImpl.IndexUpdateStatus indexUpdateStatus)

Utility method to check we are in the correct state to do work Also keeps track of the dirty flag.

Throws:

IndexerException

LuceneIndexException

commit

public void commit()
            throws LuceneIndexException

Commit this index

Throws:

LuceneIndexException

prepare

public int prepare()
            throws LuceneIndexException

Prepare to commit At the moment this makes sure we have all the locks TODO: This is not doing proper serialisation against the index as would a data base transaction.

Returns:

the tx state

Throws:

LuceneIndexException

isModified

public boolean isModified()

Has this index been modified?

Returns:

true if modified

rollback

public void rollback()
              throws LuceneIndexException

Roll back the index changes (this just means they are never added)

Throws:

LuceneIndexException

setRollbackOnly

public void setRollbackOnly()

Mark this index for roll back only. This action can not be reversed. It will reject all other work and only allow roll back.

doPrepare

protected abstract void doPrepare()
                           throws IOException

Throws:

IOException

doCommit

protected abstract void doCommit()
                          throws IOException

Throws:

IOException

doRollBack

protected abstract void doRollBack()
                            throws IOException

Throws:

IOException

doSetRollbackOnly

protected abstract void doSetRollbackOnly()
                                   throws IOException

Throws:

IOException

doInReadthroughTransaction

protected <T2> T2 doInReadthroughTransaction(RetryingTransactionHelper.RetryingTransactionCallback<T2> callback)

index

protected void index(T ref)
              throws LuceneIndexException

Throws:

LuceneIndexException

reindex

protected void reindex(T ref,
                       boolean cascadeReindexDirectories)
                throws LuceneIndexException

Throws:

LuceneIndexException

delete

protected void delete(T ref)
               throws LuceneIndexException

Throws:

LuceneIndexException

getDeletions

public Set<String> getDeletions()

Get the deletions

Returns:

- the ids to delete

getContainerDeletions

public Set<String> getContainerDeletions()

Get the container deletions

Returns:

- the ids to delete