Class ArtifactProducer
java.lang.Object
java.lang.Thread
org.apache.uima.collection.impl.cpm.engine.ArtifactProducer
- All Implemented Interfaces:
Runnable
Component responsible for continuously filling a work queue with bundles containing Cas'es. The
queue is shared with a Processing Pipeline that consumes bundles of Cas. As soon as the the
bundle is removed from the queue, this component fetches data from configured Collection Reader
and enques it onto the queue. This component facilitates asynchronous reading and processing of
CAS by seperate threads running in the CPE.
When end of processing is reached due to CPM shutdown or max number of entities are processed a
special token, called EOFToken is placed onto a queue. It marks end of processing for Processing
Units. No more data is expected to be placed on the work queue. The Processing Threads upon
seeing the EOFToken are expected to complete processing and do necessary cleanup.
-
Nested Class Summary
Nested classes/interfaces inherited from class java.lang.Thread
Thread.State, Thread.UncaughtExceptionHandler
-
Field Summary
FieldsModifier and TypeFieldDescriptionprivate ArrayList
private CAS[]
private CPECasPool
private BaseCollectionReader
private CPMEngine
private Map
private long
private ProcessTrace
private boolean
private String[]
private long
private int
int
private Hashtable
private UimaTimer
private long
private BoundedWorkQueue
Fields inherited from class java.lang.Thread
MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY
-
Constructor Summary
ConstructorsConstructorDescriptionArtifactProducer
(CPMEngine acpm) Instantiates and initializes this instance.ArtifactProducer
(CPMEngine acpm, CPECasPool aPool) Construct instance of this class with a reference to the cpe engine and a pool of cas'es. -
Method Summary
Modifier and TypeMethodDescriptionvoid
cleanup()
Null out fields of this object.private boolean
Determines if the CPM has processed configured number of entities.void
Fills the queue up to capacity.long
Returns total time spent when fetching entities from a CollectionReader.void
invalidate
(CAS[] aCasList) boolean
private void
notifyListeners
(CAS aCas, Exception anException) Notify registered callback listeners of a given exception.private void
Place terminating EOFToken into a Work Queue.private Object[]
readNext
(int fetchSize) Reads next set of entities from the CollectionReader.void
run()
Runs this thread until the CPM halts or the CollectionReader has no more entities.void
setCollectionReader
(BaseCollectionReader aCollectionReader) Assign CollectionReader to be used for readingvoid
setCPMStatTable
(Map aStatTable) Add table that will contain statistics gathered while reading entities from a Collection This table is used for non-uima reports.void
setNumEntitiesToProcess
(long aNumToProcess) Assign total number of entities to processvoid
setProcessTrace
(ProcessTrace aProcTrace) void
setUimaTimer
(UimaTimer aTimer) Plug in Custom Timer to time eventsvoid
setWorkQueue
(BoundedWorkQueue aQueue) Assigns a queue where the artifacts produced by this component will be depositedMethods inherited from class java.lang.Thread
activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield
-
Field Details
-
threadState
public int threadState -
casPool
-
workQueue
-
collectionReader
-
readerFetchSize
private int readerFetchSize -
casList
-
entityCount
private long entityCount -
maxToProcess
private long maxToProcess -
cpm
-
cpmStatTable
-
lastDocId
-
totalFetchTime
private long totalFetchTime -
timer
-
callbackListeners
-
timedoutDocs
-
isRunning
private boolean isRunning
-
-
Constructor Details
-
ArtifactProducer
Instantiates and initializes this instance.- Parameters:
acpm
-
-
ArtifactProducer
Construct instance of this class with a reference to the cpe engine and a pool of cas'es.- Parameters:
acpm
- - reference to the cpeaPool
- - pool of cases
-
-
Method Details
-
isRunning
public boolean isRunning() -
setUimaTimer
Plug in Custom Timer to time events- Parameters:
aTimer
- - custom timer
-
setProcessTrace
-
getCollectionReaderTotalFetchTime
public long getCollectionReaderTotalFetchTime()Returns total time spent when fetching entities from a CollectionReader. This provides a way of gauging throughput of a particular CR.- Returns:
- total time spent when fetching entities. -1 when the fetch time is unknown.
-
cleanup
public void cleanup()Null out fields of this object. Call this only when this object is no longer needed. -
setNumEntitiesToProcess
public void setNumEntitiesToProcess(long aNumToProcess) Assign total number of entities to process- Parameters:
aNumToProcess
- - number of entities to read from the Collection Reader
-
setCollectionReader
Assign CollectionReader to be used for reading- Parameters:
aCollectionReader
- - collection reader as source of data
-
setWorkQueue
Assigns a queue where the artifacts produced by this component will be deposited- Parameters:
aQueue
- - queue for the artifacts this class is producing
-
setCPMStatTable
Add table that will contain statistics gathered while reading entities from a Collection This table is used for non-uima reports.- Parameters:
aStatTable
-
-
endOfProcessingReached
private boolean endOfProcessingReached()Determines if the CPM has processed configured number of entities. Called after each fetch from the Collection Reader.- Returns:
- true - all configurted entities processed, false otherwise
-
fillQueue
Fills the queue up to capacity. This is called before activating ProcessingPipeline as means of optimizing processing. When pipelines start up there are already entities in the work queue to process.- Throws:
Exception
-
readNext
Reads next set of entities from the CollectionReader. This method may return more than one Cas at a time.- Returns:
- - The Object returned from the method depends on the type of the CollectionReader. Either CASData[] or CASObject[] initialized with document metadata and content is returned. If the CollectionReader has no more entities (EOF), null is returned.
- Throws:
IOException
- - error while reading corpusCollectionException
- -
-
run
public void run()Runs this thread until the CPM halts or the CollectionReader has no more entities. It continuously fills the work queue with entities returned by the CollectionReader. -
notifyListeners
Notify registered callback listeners of a given exception.- Parameters:
anException
- - exception to propagate to callback listeners
-
placeEOFToken
private void placeEOFToken()Place terminating EOFToken into a Work Queue. Any thread reading this token from the queue is responsible for terminating itself. -
getLastDocId
-
invalidate
-