io.parallec.core.task

Class ParallelTaskManager

java.lang.Object

io.parallec.core.task.ParallelTaskManager

public class ParallelTaskManager
extends java.lang.Object

The class to manage the current running tasks and wait queue. (Singleton) generateUpdateExecuteTask(io.parallec.core.ParallelTask) is the key function to execute a ParallelTask. It has access to the waiting task queue and the currently running map of ParallelTasks.

Author:

Yuanteng (Jeff) Pei, Teng Song

Field Summary

Fields

Modifier and Type	Field and Description
private java.util.concurrent.ConcurrentHashMap<java.lang.String,ParallelTask>	inprogressTaskMap The inprogress task map.
private static ParallelTaskManager	instance The Constant instance.
private static org.slf4j.Logger	logger The logger.
private java.util.concurrent.ScheduledExecutorService	scheduler The scheduler.
private java.util.Queue<ParallelTask>	waitQ The wait q.

Constructor Summary

Constructors

Modifier	Constructor and Description
private	ParallelTaskManager() Instantiates a new parallel task manager.

Method Summary

Modifier and Type	Method and Description
void	addTaskToInProgressMap(java.lang.String jobId, ParallelTask task) when create new job, always add this to the queue.
void	cleanInprogressJobMap() also clean the waitQ.
void	cleanWaitTaskQueue() Clean wait task queue.
ResponseFromManager	generateUpdateExecuteTask(ParallelTask task) key function to execute a parallel task.
java.util.Map<java.lang.String,ParallelTask>	getInprogressTaskMap() Gets the inprogress task map.
static ParallelTaskManager	getInstance() Gets the single instance of ParallelTaskManager.
int	getRemainingCapacity() Gets the remaining capacity.
ParallelTask	getTaskFromInProgressMap(java.lang.String jobId) Gets the task from in progress map.
int	getTotalUsedCapacity() get current total used capacity.
java.util.Queue<ParallelTask>	getWaitQ() Gets the wait q.
void	initTaskSchedulerIfNot() as it is daemon thread TODO when release external resources should shutdown the scheduler.
void	removeTaskFromInProgressMap(java.lang.String jobId) Removes the task from in progress map.
boolean	removeTaskFromWaitQ(ParallelTask taskTobeRemoved) Removes the task from wait q.
ResponseFromManager	sendTaskToExecutionManager(ParallelTask task) Send parallel task to execution manager.
void	shutdownTaskScheduler() Shutdown task scheduler.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

logger

private static org.slf4j.Logger logger

The logger.

instance

private static final ParallelTaskManager instance

The Constant instance.

scheduler

private java.util.concurrent.ScheduledExecutorService scheduler

The scheduler.

waitQ

private final java.util.Queue<ParallelTask> waitQ

The wait q.

inprogressTaskMap

private final java.util.concurrent.ConcurrentHashMap<java.lang.String,ParallelTask> inprogressTaskMap

The inprogress task map.

Constructor Detail

ParallelTaskManager

private ParallelTaskManager()

Instantiates a new parallel task manager.

Method Detail

getInstance

public static ParallelTaskManager getInstance()

Gets the single instance of ParallelTaskManager.

Returns:

single instance of ParallelTaskManager

initTaskSchedulerIfNot

public void initTaskSchedulerIfNot()

as it is daemon thread TODO when release external resources should shutdown the scheduler.

shutdownTaskScheduler

public void shutdownTaskScheduler()

Shutdown task scheduler.

getTaskFromInProgressMap

public ParallelTask getTaskFromInProgressMap(java.lang.String jobId)

Gets the task from in progress map.

Parameters:

jobId - the job id

Returns:

the task from in progress map

getTotalUsedCapacity

public int getTotalUsedCapacity()

get current total used capacity.

Returns:

the total used capacity

getRemainingCapacity

public int getRemainingCapacity()

Gets the remaining capacity.

Returns:

the remaining capacity

addTaskToInProgressMap

public void addTaskToInProgressMap(java.lang.String jobId,
                                   ParallelTask task)

when create new job, always add this to the queue.

Parameters:

jobId - the job id

task - the task

removeTaskFromInProgressMap

public void removeTaskFromInProgressMap(java.lang.String jobId)

Removes the task from in progress map.

Parameters:

jobId - the job id

cleanInprogressJobMap

public void cleanInprogressJobMap()

also clean the waitQ.

cleanWaitTaskQueue

public void cleanWaitTaskQueue()

Clean wait task queue.

removeTaskFromWaitQ

public boolean removeTaskFromWaitQ(ParallelTask taskTobeRemoved)

Removes the task from wait q.

Parameters:

taskTobeRemoved - the task tobe removed

Returns:

true, if successful

generateUpdateExecuteTask

public ResponseFromManager generateUpdateExecuteTask(ParallelTask task)

key function to execute a parallel task.

Parameters:

task - the parallel task

Returns:

the batch response from manager

getWaitQ

public java.util.Queue<ParallelTask> getWaitQ()

Gets the wait q.

Returns:

the wait q

getInprogressTaskMap

public java.util.Map<java.lang.String,ParallelTask> getInprogressTaskMap()

Gets the inprogress task map.

Returns:

the inprogress task map

sendTaskToExecutionManager

public ResponseFromManager sendTaskToExecutionManager(ParallelTask task)

Send parallel task to execution manager.

Parameters:

task - the parallel task

Returns:

the batch response from manager