ems-typed

<html>  <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" type="text/css" href="./docs.css"> <link rel="icon" href="favicon.ico" type="image/x-icon"> <link rel="shortcut icon" href="favicon.ico" type="image/x-icon"> <title>Extended Memory Semantics -- API Reference</title> </head> <body> <div style="font-family:Gotthard; font-size: 40px; vertical-align:middle; margin-left: 1%"> <a href="http://mogill.com"> <img src="./synsem_logo_black.svg" type="image/svg+xml" height="50px" style="vertical-align:middle;" /> <span style="vertical-align:middle;"> Extended Memory Semantics</span> </a> </div> <div style="padding-left:3%; font-size:1.7em;"> <a href="index.html"> Overview of EMS </a>   |   <a href="reference.html"> API Documentation </a>   |   <a href="https://www.npmjs.org/package/ems"> Node.js NPM </a>   |   <a href="https://github.com/mogill/ems"> Download at GitHub </a> </div> <h1> Extended Memory Semantics </h1> <p> EMS internally stores tags that are used for synchronization of user data, allowing synchronization to happen independently of the number or kind of processes accessing the data. The EMS primitives enforce atomic access using automatic state transitions, and higher level intrinsics like stacks, queues, and transactional memory are built on the EMS primitives. <center> <table width="90%" > <tr> <td> <center> <figure> <img src="./memLayoutLogical.svg" type="image/svg+xml" height="160px" /> <span class="figcaption"> <br>EMS memory is an array of JSON values accessed using atomic operators and/or transactional memory. Safe parallel access is managed by passing through multiple gates: First mapping a key to an index, then accessing user data protected by EMS tags, and completing the whole operation atomically. </span> </figure> </center> </td> <td width="50%"> <center> <figure> <img src="./fsmSimple.svg" type="image/svg+xml" height="200px" /> <span class="figcaption"> <br> EMS Data Tag Transitions & Atomic operations: F=Full, E=Empty, X=Don't Care, RW=Readers-Writer lock (# of current readers) CAS=Compare-and-Swap, FAA=Fetch-and-Add </figcaption> </span> </center> </td> </tr> </table> </center> </p> <h3> EMS Class & Array Methods </h3> <P> Operations which inspect or affect the global EMS state are performed using class methods of the EMS object returned by the <code>require</code> statement. Operations that modify the data and tags are performed using methods belonging to EMS array to be operated on. </P> <h5> Module Require </h5> <table class="apiBlock" > <tr class="apiFunc" > <td class="Label"> REQUIRE </td> <td colspan=3 class="Proto" style="padding-bottom: 20px;"> require('ems') ( nThreads [, threadAffinity [, parallelType [, contextName ] ] ] )</td> </tr> <tr class="apiSynopsis"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Initialize the EMS module, starting all the other threads. Thread identity and processor affinity is assigned when the thread is created. <BR><BR> </td> </tr> <tr class="apiArgs"> <td class="Label"> ARGUMENTS </td> <td class="argName"> nThreads</td> <td class="argType"> <Number></td> <td class="argDesc" > Total number of threads the job should use. </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName"> threadAffinity </td> <td class="argType"> <Boolean> </td> <td class="argDesc"> (Optional, Default = <code>false</code>, Affects only Linux.) Set the scheduling affinity of each thread to it's own core, assigning over-subscribed threads in a round-robin fashion. </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName"> parallelType </td> <td class="argType"> <String> </td> <td class="argDesc"> (Optional, Default=<code>bsp</code>) One of <code>bsp</code>, <code>fj</code>, or <code>user</code>. Execution model: <code>bsp</code> will use EMS' built-in Bulk Synchronous Parallel execution, <code>fj</code> uses EMS' built-in Fork-join execution <code>user</code> creates no parallelism </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName"> contextName </td> <td class="argType"> <String> </td> <td class="argDesc"> (Optional, Default=<code>anonymous</code>) Unique name of parallel context being initialized, required to distinguish between multiple EMS parallel programs running simultaneously on the same system. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" colspan="2" >ems = { nThreads : Number, // Number of threads executing myID : Number // This thread's ID 0..nThreads-1 }</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems = require('ems')(process.argv[2]) </td> <td class="Desc"> Use the first command line argument as the number of nodes: <br> <code>node foo.js 4</code> executes using 4 threads.</td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">ems = require('ems')()</td> <td class="Desc" > Run on one node </td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">ems = require('ems')(process.argv[2], false, true) </td> <td class="Desc" > Use first command line argument as number of nodes, do not set affinity of the threads to a specific CPU, execute using fork-join parallelism. </td> </tr> </table>   <h5> Create a new EMS Array </h5> <table class="apiBlock" > <tr class="apiFunc"> <td class="Label"> CLASS METHOD </td> <td colspan=3 class="Proto"> ems.new( [ nElements [, heapSize [, fileName] ] ] ) </td> </tr> <tr class="apiFunc"> <td class="Label" style="padding-bottom: 20px;">  </td> <td colspan=3 class="Proto"> ems.new( emsArrayDescriptor ) </td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Attach to an existing or create a new EMS array. Creation of new (do not use existing) EMS memory regions implies a barrier, whereas using an existing EMS file will block until the file exists. <BR><BR> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> nElements </td> <td class="argType"> <Number></td> <td class="argDesc" > (Optional, Default is 1) Maximum number of elements in the EMS array or map. </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> </td> <td class="argType"> <Array></td> <td class="argDesc" > An array of dimensions of a multi-dimensional array. A 100×30×50 cube is described by <code>[100, 30, 50]</code>. </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName"> heapSize </td> <td class="argType"> <Number> </td> <td class="argDesc"> (Optional, Default is 0) Maximum number of bytes reserved for strings, arrays, maps, and object elements in this array. The actual amount of memory allocated for use is rounded up to the nearest power of 2 <TODO>(until a better memory allocator is implemented)</TODO>. Additional memory is allocated for bookkeeping. Memory block size is defined in <code>ems_alloc.h: EMS_MEM_BLOCKSZ</code> <TODO>but should be configurable at create time</TODO>. </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName"> fileName </td> <td class="argType"> <String> </td> <td class="argDesc"> (Optional, Default is anonymous) Fully qualified file name of the file to use as a persistent backing store for the EMS array, tags, and bookkeeping information. </td> </tr> <tr class="apiArgs" > <td class="Label"> </td> <td class="argName">emsArrayDescriptor</td> <td class="argType"> <Object> </td> <td class="argDesc"> (Alternative to two scalar argument) A complete EMS Array descriptor may be passed as the only argument instead of scalar arguments.<code style="white-space: pre;"> emsArrayDescriptor = { dimensions : 100, // Required: Max # elements in EMS array // Integer for 1-D, or array of dims [x, y, z] heapSize : 100000, // Optional, default=0: Space, in bytes, for // strings, maps, and objects. Rounded up to nearest power of two mlock : 0, // Optional, default=0%: % of EMS memory to lock into RAM useMap : true, // Optional, default=false: Map keys to indexes useExisting : true, // Optional, default=false: // Preserve data if an file already exists persist : true, // Optional, default=true: // Preserve the file after threads exit doDataFill : false, // Optional, default=false: Initialize memory dataFill : undefined, // Optional, If this property is defined, // the EMS memory is filled with this value setFEtags : 'full', // Optional, If defined, set 'full' or 'empty' filename : '/path/to/file' // Optional, default=anonymous: // Path to the persistent file of this array }</code> </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" colspan="2" ><EMS Array></td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">var foo = ems.new(nItems) </td> <td class="Desc"> Create a new non-persistent shared memory EMS array with no heap space. Scalar data (Number, Boolean, Undefined) may be stored in this array, but not strings, arrays, or objects. </td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">var foo = ems.new(nItems, size, '/tmp/EMS_foo') </td> <td class="Desc" > Create a file-backed EMS shared memory space with the filename <code>/tmp/EMS_foo</code>. In addition to the scalar storage, space for strings totaling <code>size</code> bytes is also reserved for strings, arrays, objects, and maps.</td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">var x = ems.new(nItems, size) </td> <td class="Desc" > Create a new non-persistent shared memory EMS array that has space for strings totaling <code>size</code> bytes </td> </tr> </table>  <h5> Parallel Region (Fork-Join execution only) </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px; vertical-align:text-top;"> CLASS METHOD </td> <td colspan=3 class="Proto"> ems.parallel( [args, ...] func ) </td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> When using fork-join execution, the master thread enters a parallel region by executing <code>func</code> once from each process. The master process first starts all the other processes running the function asynchronously, then executes the function itself synchronously. All processes join (perform a <code>barrier</code>) after completion of the work function. The results of the function are discarded. Global variables on each node are persistent between parallel regions. </td> </tr> <tr class="apiArgs"> <td class="Label"> ARGUMENTS </td> <td class="argName"> args </td> <td class="argType"> <Any></td> <td class="argDesc"> Zero or more arguments to be passed to the function. </td> </tr> <tr class="apiArgs"> <td class="Label"> </td> <td class="argName"> func </td> <td class="argType"> <Function></td> <td class="argDesc" > Function to be executed once on every thread. The optional arguments are used when calling the function. Return value is ignored. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.parallel( doWork )</td> <td class="Desc"> The function <code>doWork</code> is executed by every thread. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">ems.parallel( foo, "Smith", 123, doWork )</td> <td class="Desc"> The function call <code>doWork(foo, "Smith", 123)</code> is performed once by each process.</td> </tr> </table>  <h5> Parallel Loops </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto"> ems.parForEach( first, last, function [, scheduling [, minChunk] ] ) </td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Parallel loop execution, distributing the iterations among all the threads. The function is invoked with one argument, the current iteration number. Iterations are divided among the threads according to the <code>scheduling</code> method specified. Parallel for loops <em>must not</em> be nested. <TODO>The system should check for this and fall back on serial execution.</todo> A barrier is implied at the end. <BR><BR> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> first </td> <td class="argType"> <Number></td> <td class="argDesc" > Index to start iterating </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> last </td> <td class="argType"> <Number></td> <td class="argDesc" > Index to stop iterating (non-inclusive).</td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> func </td> <td class="argType"> <Function></td> <td class="argDesc" > Loop body, only input argument is current loop index: <br><code>function foo(idx) {...}</code></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> scheduling </td> <td class="argType"> <String></td> <td class="argDesc" > <code>guided [minChunk]</code>: Decreasing amounts of work are assigned to each task until <code>minChunk</code> iterations per thread is reached. Load balancing occurs when new chunks are assigned to threads.<br> <code>static</code>: Equal number of iterations are given to each thread, no dynamic load balancing is performed.<br> <code>dynamic</code>: All threads share one index which is atomically incremented by 1 after each iteration. Provides ideal load balancing at the cost of high per-iteration overhead.<br> </td> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> minChunk </td> <td class="argType"> <Number></td> <td class="argDesc" >(Optional, only used when <code>scheduling='guided'</code>, default=<code>1</code>) Minimum number of iterations assigned to a single thread. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.parForEach(0, nItems-1, func)</td> <td class="Desc">Execute the <code>func</code> function <code>nItems-1</code> times with indexes <code>0..nItems-1</code>, inclusive. </td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">ems.parForEach(10000, 20000, func, 'guided', 200)</td> <td class="Desc" > Distribute iterations numbered 10,000-20,000 (inclusive) using the <code>guided</code> method with a minimum chunk size of 200 iterations </td> </tr> <tr class="Examples"> <td class="Label"> </td> <td class="Example">ems.parForEach(0, 999, func, 'static')</td> <td class="Desc" > Execute <code>func()</code> 1,000 times with indexes 0..999 inclusive. Distribute the iterations evenly across threads in contiguous blocks. </td> </tr> </table>  <h5> Barrier Synchronization </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px; vertical-align:text-top;"> CLASS METHOD </td> <td colspan=3 class="Proto"> ems.barrier() </td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> All the threads must reach the same barrier before proceeding. Failure to call a barrier from every process will result in deadlock. If called outside a parallel region, a barrier has no effect. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.barrier()</td> <td class="Desc"> All threads reach the barrier before proceeding. </td> </tr>  </table>  <h5> Critical Region </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">ems.critical( func )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Perform function <code>func()</code> mutually exclusive of other threads. Serializes execution through all critical regions. <TODO> Named regions would be more like OpenMP </todo> <br><br></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> func</td> <td class="argType"> <Function></td> <td class="argDesc" > Function to perform sequentially. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.critical( function() { // Use a shared resources } )</td> <td class="Desc"> A shared resource is accessed sequentially, but in no particular order.</td> </tr> </table>  <h5> Execute on Master Thread Only </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">ems.master( func )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Perform function <code>func()</code> only on thread 0, implies a barrier. <br><br> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> func</td> <td class="argType"> <Function></td> <td class="argDesc" > Function to perform only by task 0. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.master( function() { console.log("Only task 0") } )</td> <td class="Desc">Console logging performed only by task 0</td> </tr> </table>  <h5> Execute once on any thread </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">ems.single( func )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Perform function <code>func()</code> only once by the first thread to reach the statement. Implies a barrier. <br><br> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> func</td> <td class="argType"> <Function></td> <td class="argDesc" > Function to be performed once. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.single( function() { console.log("Only first task") } )</td> <td class="Desc">Console logging is performed only once.</td> </tr> </table>  <h5> Print Diagnostic Message </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">ems.diag( message )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Print a diagnostic message to the console with a prefix indicating the task ID. <br><br> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">message</td> <td class="argType"> <String></td> <td class="argDesc" > Text of message to print to the console </td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">ems.diag( "Hello, world!" ) </td> <td class="Desc"><code>EMS 3: Hello, world!</code> appears on console</td> </tr> </table>      <h3> EMS Array Methods </h3> <h5> Intrinsic Atomic Operations (AMOs) </h5> <h6> Read EMS Memory </h6> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> ARRAY METHOD </td> <td colspan=3 class="Proto">emsArray.read( index )</td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.readFE( index )</td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.readFF( index ) <BR></td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.readRW( index ), emsArray.releaseRW( index ) <BR><BR></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> The <code>read</code> family of EMS memory operations return the data stored in an EMS array element. The value may be any JSON type. <br> <dl> <dt> <code>read</code> </dt> <dd> Immediately and unconditionally returns the stored value, ignoring the tag state. <TODO> Reading uninitialized mapped indexes will return <code>undefined</code> regardless of the default value that would be returned with <code>read__, cas, faa</code>. </TODO> </dd> <dt> <code>readFE</code> </dt> <dd> Blocks until the data element is full, then atomically reads the value and marks it empty. </dd> <dt> <code>readFF</code> </dt> <dd> Blocks until the data element is full, then atomically reads leaving it full. This allows safe read access of data which may be updated simultaneously. <code>readFF</code> ensures mutual exclusion, and will block if the data is already under a Readers-Writer lock. </dd> <dt> <code>readRW, releaseRW</code> </dt> <dd> Blocks until the data element is full or already under a Readers-Writer lock, then increments the Readers-Writer reference count. The function <code>emsArray.releaseRW()</code> decrements the reference count, restoring the state to <code>Full</code> if no readers remain. </dd> </dl> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">index</td> <td class="argType"> <Number | String></td> <td class="argDesc" > Index in the EMS array of data to read</td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" colspan="2" > read__ : < Number | Boolean | String | Undefined | Array | Object ></td> </tr> <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> </td> <td class="Type" > releaseRW : <Number></td> <td class="Desc"> Number of pending readers sharing the lock.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">var n = histogram.read(3) </td> <td class="Desc">Read the value in bin 3 of the histogram.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">var word = dictionary.read(idx) </td> <td class="Desc">Read dictionary word at index/key <code>idx</code> in the dictionary array.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">var x = arr.readFE(idx) </td> <td class="Desc">Block until the element at index <code>i</code> is full, atomically read the value and mark it empty. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">var x = arr.readFF(idx) </td> <td class="Desc"> Block until the element at index <code>i</code> is full, atomically read the value and leave it full.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">var x = arr.readRW(idx) </td> <td class="Desc"> Acquire a shared-exclusive readers-writer lock.</td> </tr> </table>  <h5> Write EMS Memory </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> ARRAY METHOD </td> <td colspan=3 class="Proto">emsArray.write( index, value ) </td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.writeXE( index, value )</td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.writeXF( index, value )</td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.writeEF( index, value ) <BR><br></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Write a value to an element of an EMS array. <br> <dl> <dt> <code>write</code> </dt> <dd> Immediately and unconditionally writes the value to memory. This operation does not honor or modify the full/empty tag status. </dd> <dt> <code>writeXE</code> </dt> <dd> Unconditionally and atomically writes the value to the data element and marks the element empty.</dd> <dt> <code>writeXF</code> </dt> <dd> Unconditionally and atomically writes the value to the data element and marks the element full.</dd> <dt> <code>writeEF</code> </dt> <dd> Blocks until the element is empty, and then atomically writes the value and marks the element full.</dd> </dl> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">index</td> <td class="argType"> <Number | String></td> <td class="argDesc" > Index in the EMS array of data to read</td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName">value</td> <td class="argType"> <Any></td> <td class="argDesc" > Primitive value to store in the array at element numbered index.</td> </tr> </table> <br> <table class="apiBlock" > <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">histogram.write(idx, 0) </td> <td class="Desc" >Initialize the value of <code>histogram[idx]</code> to 0.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">dictionary.write(idx, "Hello") </td> <td class="Desc">Add the string <code>"Hello"</code> to the EMS array <code>dictionary</code> at index <code>idx</code>.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">arr.writeXE(i, undefined) </td> <td class="Desc">Purge the memory at index <code>i</code> of the EMS array <code>arr</code>.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">arr.writeXF(j, 'Mr. Jones') </td> <td class="Desc">Unconditionally write the string <code>'Mr. Jones'</code>to the EMS array <code>arr</code> at index <code>j</code> and atomically mark the element full.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">arr.writeEF(2, v) </td> <td class="Desc">Block until the element at index 2 of <code>arr</code> is empty, atomically write the value <code>v</code> and mark the memory full.</td> </tr> </table>  <h5> Atomic Fetch and Add </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> ARRAY METHOD </td> <td colspan=3 class="Proto">emsArray.faa( index, value )<BR><BR></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Atomically read the array's JSON primitive element (scalar or string, not array or object), add the value, and write the new value back to memory. Return the original contents of the memory. <BR><BR></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">index</td> <td class="argType"> <Integer | String></td> <td class="argDesc" >Index of the element in the EMS array <code>emsArray</code> to atomically add to.</td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName">value</td> <td class="argType"> < Number | Boolean | String | Undefined ></td> <td class="argDesc" >Value to add to the EMS memory.</td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" >< Number | Boolean | String |<br> Undefined ></td> <td class="Desc"> The results are the same type as if <code>a + b</code> were performed. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">oldVal = statistics.faa( timerIdx, elapsed ) </td> <td class="Desc">Return the value in memory before the add operation.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">currentSum = arr.faa( index, value ) + value </td> <td class="Desc">Return the current value after the atomic operation has occurred.</td> </tr> </table>  <h5> Atomic Compare and Swap </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> ARRAY METHOD </td> <td colspan=3 class="Proto">emsArray.cas( index, oldValue, newValue )<BR><BR></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Atomically read the JSON primitive element (scalar or string, not object or array) stored at the array's index, compare the original value to <code>oldValue</code>, and if they are equivalent store the new value. The CAS operation succeeded if the value returned is equivalent to <code>oldValue</code>. CAS will block until the EMS memory is marked full. CAS is the equivalent of atomically performing:<br> <code>if( arr[idx] == oldValue ) then arr[idx] = newValue</code> <BR><BR></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> index </td> <td class="argType"> <Integer | String></td> <td class="argDesc" > Index into the EMS array to update. </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> oldValue </td> <td class="argType"> <Number | Boolean | String | Undefined></td> <td class="argDesc" > Value to compare to the value stored in memory. </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> newValue </td> <td class="argType"> <Any ></td> <td class="argDesc" > Value to store if the value in memory is <code>oldValue</code> </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type">< Number | Boolean | String | Undefined ></td> <td class="Desc"> The value in memory when the compare was performed. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">acquiredLock = arr.cas(index, UNLOCKED, LOCKED) == UNLOCKED </td> <td class="Desc">Evaluates as <code>true</code> if the lock stored at <code>arr[index]</code> was acquired. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">oldWord = users.cas(1234, 'Cooking', 'Eating')</td> <td class="Desc">Attempt to atomically update user 1234's record from the string <code>'Cooking'</code> to the string <code>'Eating'</code></td> </tr> </table>    <h3> Composed Array Operations </h3> <P> Composed operations use EMS intrinsics to perform deadlock free atomic operations involving multiple EMS elements. The composed operations use the tags and require data to be full or empty as appropriate for the semantics of the operation. </P> <h5> Transactional Processing of Multiple Elements </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> CLASS METHOD </td> <td colspan=3 class="Proto">ems.tmStart( tmElements )</td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">ems.tmEnd( tmHandle, doCommit )<BR><BR></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Lock (by transitioning tags from Full to Empty) one or more EMS elements in a deadlock free way. When multiple locks must be acquired, this function guarantees at least one thread will always make progress. The optional third element indicates the element is read-only and will not be modified by the task while the lock is held. Read-only data is locked using a Readers-Writer lock, permitting additional concurrency. <BR> Performing transactions within transactions can result in deadlock if the thread tries to recursively lock an element. <BR><BR></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName"> tmElements </td> <td class="argType"> <Array></td> <td class="argDesc" > Array identifying which EMS array elements should be locked. Each array element is itself an array naming the EMS array and index/key of the data and an optional Read-Only hint: <code>[ emsArray, index <em>(, isReadOnly)</em> ]</code> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> tmHandle </td> <td class="argType"> <Object></td> <td class="argDesc" > Returned from <code>tmStart()</code>, contains state information needed to abort or commit the transaction. </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="argName"> doCommit </td> <td class="argType"> <Boolean></td> <td class="argDesc" > Commits the transaction if <code>true</code>, or aborts and rolls back the transaction if <code>false</code> or <code>undefined</code>. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" >ems.tmStart() : < tmHandle ></td> <td class="Desc">Transaction Handle used later to commit or abort.</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">tm = ems.tmStart( [ [users, 293, true], [comments, 8922] ] ) </td> <td class="Desc">Lock element 293 in the <code>users</code> EMS array with a read-only intent, and also lock record 8922 in the <code>comments</code> EMS array. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">tm = ems.tmStart( [ [arrA, idxA0], [arrA, idxA1] ] ) </td> <td class="Desc">Lock indexes <code>idxA0</code> and <code>idxA1</code> in array <code>arrA</code> for update to both values. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">tm = ems.tmStart([ [arrA, idxA0], [arrA, idxA1, true], [arrB, idxB0, true] ]) </td> <td class="Desc">Acquire and free locks on the elements in <code>lockList</code>. Element <code>arrA[idxA0]</code> may be modified, but elements <code>arrA[idxA1]</code> and <code>arrB[idxB0]</code> are read-only. </td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">ems.tmEnd( tm, true ) </td> <td class="Desc">Commit the transaction </td> </tr> </table>  <h5> Stacks & Queues </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> ARRAY METHOD </td> <td colspan=3 class="Proto">emsArray.push( value )<BR></td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.pop( )<BR></td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.enqueue( value )<BR></td> </tr> <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label"> </td> <td colspan=3 class="Proto">emsArray.dequeue( )<BR><BR></td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Append or remove data from a LIFO or FIFO. If the queue or stack is empty, the <code>pop</code> or <code>dequeue</code> operation returns <code>Undefined</code>, which is indistinguishable from an <code>Undefined</code> that was explicitly pushed onto the stack. <BR><BR></td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">value</td> <td class="argType"> <Any></td> <td class="argDesc" > Value to add to the queue or stack. </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type" colspan=2>emsArray.pop(), emsArray.dequeue() : < Any ></td> </tr> <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> </td> <td class="Type">emsArray.push() : < Number > emsArray.enqueue() : < Number ></td> <td class="Desc">The number of elements presently on the stack or queue</td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> EXAMPLES </td> <td class="Example">comments.push( "Hello, world" ) </td> <td class="Desc">Append the string to the EMS array <code>comments</code></td> </tr> <tr class="Examples" style="vertical-align:text-top;"> <td class="Label"> </td> <td class="Example">mostRecent = comments.pop() </td> <td class="Desc">Atomically return the value at the top of the stack.</td> </tr> </table>  <h5> Look up a key used to map a value </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">emsArray.index2key( index )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Convert an index into an EMS array to the key used to map a value to that hashed index. This function can be used to iterate over all the elements of a mapped array. <br><br> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">index</td> <td class="argType"> <Number></td> <td class="argDesc" > Index of the element in the EMS array to get the key for </td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURNS </td> <td class="Type">< Any ></td> <td class="Desc">The key used to map the value which hashed to this index.</td> </tr> </table>  <h5> Freeing EMS Arrays </h5> <table class="apiBlock" > <tr class="apiFunc" style="vertical-align:text-top;"> <td class="Label" style="padding-bottom: 20px;"> CLASS METHOD </td> <td colspan=3 class="Proto">emsArray.destroy( remove_file )</td> </tr> <tr class="apiSynopsis" style="vertical-align:text-top;"> <td class="Label"> SYNOPSIS </td> <td class="Desc" colspan=3> Release the persistent and non-persistent resources associated with an EMS array, alternatively persisting the data if <code>remove_file</code> is <code>false</code>. Implies a barrier. <br><br> </td> </tr> <tr class="apiArgs" style="vertical-align:text-top;"> <td class="Label"> ARGUMENTS </td> <td class="argName">remove_file</td> <td class="argType"> <Boolean></td> <td class="argDesc" > If true, remove the file, else allow the EMS file to persist.</td> </tr> </table> <br> <table class="apiBlock" > <tr class="apiRetVal" style="vertical-align:text-top;"> <td class="Label" style="vertical-align:text-top"> RETURN