alasql/TODO.md

AlaSQL.js - JavaScript SQL database library for relational and graph data manipulation with support of localStorage, IndexedDB, and Excel

# TO DO

This file contanis unstructured ideas for future development of AlaSQL.

## Ideas

Meteor Package
GEFX






Constraints:
IS NULL / IS NOT NULL 
CHECK

----------

Realize OBJECT_ID

IF OBJECT_ID('dbo.Employees') IS NOT NULL
  DROP TABLE dbo.Employees;
  
IF OBJECT_ID('dbo.VSortedOrders', 'V') IS NOT NULL
  DROP VIEW dbo.VSortedOrders;
GO




2-chars

Q: How UNION works? - disstinct or only new? - solved
Check UnionDeep and arrayDistinct


SEARCH @p name;
SEARCH UNION(/a,/b) FROM @p;
SEARCH / "Name";
SEARCH name;
SEARCH / name;
SEARCH ;
SEARCH DISTINCT(name);


AlaLISP
AlaPROLOG / RDF

age 35.
name X :- age X.
:- age X.

EDGE
VERTEX
CLUSTER
FACT
RULE

PROLOGUE
=========
:- papa loves apples;
RULE :- ;
SEARCH papa loves @p, WHERE(@p IN ['Apples'])

FACT [John] buys [Apples],[John] buys [Nuts];
SEARCH [John] buys @x
[{x:'Apples'},x:'Nuts'];








search / ORDER BY(name DESC)

if next selector is order, then 

(/ ORDER BY (no))+

SEARCH c @c sel(a b) ORDER BY(_) @b @[(@c),(@b)]

SEARCH c sel(/ ORDER BY(age))+ @b {name:@c,age:@b}


search :person @p where(age > 2) > :loves > where(sex="F") @@p;
ok = where;


Read: Neo.js
http://neo4j.com/docs/stable/query-unwind.html


create graph #Andrey, #Bonapart, #Andrey >> #Bonapart, #Olga {age:26};

alasql('create graph from gedf("my.gedf"');
alasql('search edge set(color="black"');
alasql('search #Andrey path(#Bonapart) set(color="red")');
d3.force()
.nodes(alasql('search vertex d3()'))
.links(alasql('search edge d3()'));


alasql('search #Andrey path(#Olga) set(color="red")');
alasql('search #Andrey paths((>>)+ OK(sex="F")) / set(color="red")');


1.Change XML mode from '/' to simple tag
2. Add HTML parser (?)


#SUM(_,/b)

alasql('=1+1'); // = operator
alasql('=#Andrey');

alasql('=#SUM(@1,)');
alasql('=(SEARCH SUM(VERTEX))');

alasql('=(SEARCH SUM(a) FROM _)');
alasql('=(SEARCH _ SUM(a))');
alasql('=#SUM(_,a)');
alasql('=#SUM(VERTEX)');

alasql('=(SEARCH SUM(VERTEX))');
alasql('=(SEARCH SUM(EDGE))');
alasql('=(SEARCH SUM(VERTEX),SUM(EDGE))');
alasql('=(SEARCH ALL(SUM(VERTEX),SUM(EDGE))');
alasql('=(SEARCH ANY(SUM(VERTEX),SUM(EDGE))');


alasql('SELECT #SUM(/a) FROM one')

SEARCH a EX( COUNT(b) + COUNT(c d))



(SEARCH SUM(c d) FROM _) 


Add ! operator;



#LITERAL a!length(10)
#NUMBER
`
n->length
n!length

city:country:name 

#Andrey!city!country!name
#Andrey:city:country:name

#Andrey->city!country!name

search #Andrey :Person ok(city!country!name = "Italy")
search #Andrey !Person ok(city:country:name = "Italy")
search class(Person) #Andrey ok(city:country:name = "Italy")

! ->

#100!name

#NUMBER
!LITERAL

!expression -> objects['expression']


city!country!name
city->country->name

database.table
table.column

"object"!"property"
@a!name


alasql('SEARCH #Andrey PATH(#Napoleon) SET(color="red")');


alasql('create graph Andrey, Napoleon, Josephine,Louis, Andrey >> Josephine, Louis>>Josephine, Jpsephine >> Napoleopn');
alasql('search edge set(color="black")');
alasql('search !Andrey path(!Napoleon) set(color="red")');

search attr() / Books  from xml("my.xml")


alasql('create graph from gml("my.gml")');


var force = d3.layout.force()
    .charge(-120)
    .linkDistance(30)
    .size([width, height]);
    .nodes(alasql('search vertex into d3()'))
    .links(alasql('search edge into d3()'))
    .start();



.forEach(function(edge){
	edge.color = 'red';
});

d3 graphs and AlaSQL

d3
node : index
edges:
source: index
target: index


;
SEATCH EDGE INTO D3LINKS()

alasql('CREATE GRAPH FROM TXT("mynet.txt")');

Andrey,
{name:"yes"},
Andrey>loves>Masha {name:"Masha"}

var force = d3.layout.force()
    .charge(-120)
    .linkDistance(30)
    .size([width, height]);
    .nodes(alasql('SEARCH !Napoleon >> D3NODE()'))
    .links(alasql('SEARCH !Napoleon >  D3LINK()'))
    .start();

alasql('search  >>? d3node()')



>> >k>

2. SEARCH JSON
3. CREATE GRAPH

### XLSXML
Simplify with https://technet.microsoft.com/en-us/magazine/2006.01.blogtales.aspx

### Graph

SEARCH FROM {a:1};
{a:1}
SEARCH a FROM {a:1};
[1]
SEARCH FROM [1,2];
[1,2]
SEARCH {a:_} FROM [1,2];
[{a:1},{a:2}]
SEARCH AS @x (IDX() < 10) @x FROM [1,2];
[1,2]



SEARCH {a:1} a;
[1]
SEARCH a FROM {a:1};
[1]
SEARCH a FROM {a:{b:1}};
[{b:1}]
SEARCH a b FROM {a:{b:1}};
[1]
SEARCH > loves: > FROM @Alice;

SEARCH (a=1) AS @c {b:b,a:@c->a} FROM @[{a:1,b:10},{a:2,b:20}];

CREATE GRAPH @Alice, Bob, @Alice > loves: > @Bob;
SEARCH Alice > loves > IN Person;



### Graph Database

#### Edges & Vertices

SEARCH OUT(),OUTE(),OUTV() FROM ?
SEARCH OUT(Like,Love) FROM ?
SEARCH IN(),INE(),INV() FROM ?
SEARCH IN(Like,Love) FROM ?
SEARCH BOTH(),BOTHE(), BOTHV() FROM ?
SEARCH BOTH(Like,Love) FROM ?

???
SEARCH EXPAND(name) FROM Person; -- all people names
SEARCH FIRST(name) FROM Person; -- all people names
SEARCH LAST(name) FROM Person; -- all people names
SEARCH COUNT(name) FROM Person; -- count number of children



### Version "Sapsan" 0.0.40 (25.01.2015)

* MERGE
* Cordova Support
* Tests
* AUTOINCREMENT / IDENTITY
* SELECT INDEX, COLUMN, VALUE on column
* Bower.json
* Wikibooks SQL samples as tests

### Version "Pacific Rim" 0.0.42 (01.02.2015)

* If-then-else JISON problem
* UNION ORDER BY bug
* T-SQL compatibility and multiple SQL Tests
* Documentation
* API documentation with JsDoc
* WorkerJS for Node (primarily for test)

### Version "Sigirya" 0.0.45 (05.02.2015)

* package.json
* Datatypes + CONVERT
* Functions
* Constraint and Foreign Keys, indexes, Check, Default
* CONTINUE/BREAK/FOR/LOOP

### Version "Elbrus" 0.0.50 (10.02.2015)

* Transactions
* SET NOCOUNT 

### Version "Prague" 0.0.55 (20.02.2015)

* PIVOT/UNPIVOT

### Version "Manila" 0.0.60 (01.03.2015)
 
* OVER PARTITION

### Version "Vanilla" 0.0.63 (01.03.2015)
 
* GROUP BY HIERARCHY, TOTAL, DETAIL

### Version "Menlo Park" 0.0.65 (10.03.2015)

* CREATE FUNCTION, CREATE PROCEDURE, EXEC
* Bugs
* Documentation

### Version "Vorkuta" 0.0.70 (20.03.2015)

* Fluent interface improvement
* Bugs
* Documentation

### Version "San Diego" 0.0.75 (01.04.2015)

* NeDB, MongoDB, Redis, Cassandra NoSQL
* Bugs
* Documentation

### Version "Voronezh" 0.0.80 (10.04.2015)

* Compatibility

### Version "Rio de Janeiro" 0.0.85 (20.04.2015)
* Speed

### Version "Quito" 0.0.90 (01.05.2015)
* Memory 

### Version "First Pancake" 0.1.0 (10.05.2015)

* Bugs
* Speed, memory, and size optimization 
* Compatibility: browsers, mobiles, SQL databases



## Next Versions

1. SQLite plugin
2. Test list
PouchDB tests

@@res

1. Add alasql(true); <script type="text/x-sql"> run

<script src="alasql.min.js"></script>
<div id="res"></div>
<script id="sql1" src="text/x-sql">
  SELECT 100 INTO "aaa.json";
  SELECT 100 INTO "aaa.xlsx";
  SELECT 100 INTO "aaa.csv";
  SELECT 100 INTO ".res";
  SELECT 100 INTO "#res";
</script>
<script>
  alasql('#sql1');
  alasql('.sql1');
</script>

  alasql('#alasql');
  alasql($('#alasql'));
  alasql(document.querySelector('#alasql'));


1. Short syntax for variable
2. Date literal
DECLARE @one = #01.01.2014#;


1. Change prettifier according https://msdn.microsoft.com/en-us/library/ms173443.aspx
2. Add color module for Node.js for Errors and SQL

3. Add HTML tag by default (string -> HTML(string, {headers:true})) shortcut

SELECT * INTO "#res" FROM one;
var res = alasql('SELECT * FROM "#table"')

4.



1. This should work... See http://jsfiddle.net/n4de6433/1/

IF EXISTS (SELECT * FROM [Table] WHERE ID = rowID)
UPDATE [Table] SET propertyOne = propOne, property2 . . .
ELSE
INSERT INTO [Table] (propOne, propTwo . . .)

2. MERGE

3. Firefox 26 tests

1. DECLARE @a INT = 1;


1. New presentation about Alasql
1. Test with Ionic Framwork
2. CREATE FILESTORAGE DATABASE IF NOT EXISTS a("filename")
2. CREATE MEMORY DATABASE alias for CREATE DATABSE
3. CREATE FILE DATABASE / CREATE FILESTORAGE / CREATE PERSISTENT DATABASE
4. Add custom read-write parser to FILE: 
CREATE FILE DATABASE a("a.myjson", {from:"MYJSON", into:"MYJSON"})
5. Check IF FILE_EXISTS("a.json") BEGIN ... END function 
6. Fix WinPhone utils
7. Pass http://sqlite.org/sqllogictest/doc/trunk/about.wiki
8. Extended test FILE database with AUTOCOMMIT OFF mode

1. Create bower package
2. HTML5 SQL syntax
2. SQLite tests for Cordova
3. MERGE syntax (http://msdn.microsoft.com/en-us/library/ms177564.aspx)
4. Subqueries in DELETE and UPDATE
5. Constraints
6. Foreign Keys
7. Transactions
8. Over
9. Pivot

OUTPUT (http://msdn.microsoft.com/en-us/library/ms177564.aspx)
3. REPLACE (http://dev.mysql.com/doc/refman/5.0/en/replace.html)


Test Cordova with SET AUTOCOMMIT OFF;


COMMIT TRANSACTION;
DETACH DATABASE test1;

2. Windows Cordova readFile, saveFile if(cordova && cordova.org && ...)


2. Write a letter to major JS bloggers

http://jsfiddle.net/5nmopn3d/


4. Add TH and TD classifiers {textContent:'Name'} for HTML

SELECT * INTO HTML("#res",{headers:[],columns:[]);
SELECT col1 
  TH {width:"100px"} 
  TD {style:{color:col1>0?"green":"red"}} \
  INTO HTML("#res") 
  FROM ?


7. CSV/TAB export with headers:["header1","header2"] for arrays


SQL Examples -> http://en.wikibooks.org/wiki/SQL_Exercises

0. MS SQL compatibility
* ROW_NUMBER() aggregator
* DECLARE @var TABLE(coldefs)
* Database names starting with #
* INSERT INTO @aaa(cols) VALUES ()...
* DB_ID(databaseid)
* CREATE INDEX syntax
* SET IDENTITY_INSERT table ON;
* NUMERIC(a,b) data type and CONVERSION, MONEY, SMALLINT, BIGINT, NVARCHAR(MAX), DECIMAL(a,b)
* SYSDATETIME(), DATEADD(), DATEDIFF(), RIGHT(), LEFT(), CHAR(), ASCII(), ABS(), NEWID(), SUBSTRING()
* CONSTRAINT CHECK(expression)
* SET NOCOUNT OFF

BIG
* OVER
* PIVOT

2. Fluent interface 
3. Break Continue Loop
4. If Else Syntax bug


8. FOREIGN KEYS
9. Transactions
10. DEFAULT, IS NULL, IS NOT NULL in CREATE TABLE


11. SET NOCOUNT
13. OVER () 
14. PIVOT - ?
15. Hierarchy, TOTAL, DETAIL
16. VAR, STDDEV


OVER
===

SELECT orderid, customerid
FROM dbo.Orders
WHERE customerid IS NOT NULL
  AND orderid % 2 = 1
ORDER BY COUNT(*) OVER(PARTITION BY customerid) DESC;

SELECT COUNT(*) FROM Orders WHERE... GROUP BY customerid???



3. clean the code - remove comments and unnecessary functions


0. 
set nocount off
object_id(tableid)
default dbo scheme
not null
char)_

SELECT orderid, customerid FROM dbo.Orders ORDER BY 2, 1;


 CREATE VIEW dbo.VSortedOrders
         AS
         SELECT TOP 100 PERCENT orderid, customerid
         FROM dbo.Orders
         ORDER BY orderid
         GO

PIVOT
UNPIVOT


group by all
UPDATE dbo.T1 SET c1 = c1 + (SELECT MAX(c1) FROM dbo.T1);

1. BIT_AND (&), BIT_OR(|), BIT_XOR(^), STD, STDDEV_POP, STDDEV_SAMP, VAR_POP, VAR_SAMP, VAR
http://www.w3resource.com/mysql/aggregate-functions-and-grouping/aggregate-functions-and-grouping-in-mysql.php

1. STUFF - http://msdn.microsoft.com/en-us/library/ms188043.aspx
STUFF ( character_expression , start , length , replaceWith_expression )

SELECT 
STUFF((SELECT ',' + Col1
FROM cteSTUFF
FOR
XML PATH ('')
),1,1,'') AS 'RowtoColumns'

SUBQUERIES in Fucntions

1. alasql('SELECT * INTO SQL('mytable') FROM ?',[data]); 
generates 'INSERT INTO mytable () VALUES ();'

1. GROUP_CONCAT() - join fields for group
alasql.aggr.GROUP_CONCAT = function (acc, val) {
  return (acc||"")+val;
}

http://www.w3resource.com/mysql/aggregate-functions-and-grouping/aggregate-functions-and-grouping-group_concat.php
SELECT pub_id,GROUP_CONCAT(DISTINCT cate_id  
ORDER BY  cate_id ASC SEPARATOR ' ')  
FROM book_mast  
GROUP BY pub_id ;  

- See more at: http://www.w3resource.com/mysql/aggregate-functions-and-grouping/aggregate-functions-and-grouping-group_concat.php#sthash.e7pAitjF.dpuf

5. sql into

SELECT * INTO SQL() FROM ? - generates inserts
SHOW CREATE 

FROM HTML()
1. Social to alasql.org
2. Wiki
3. Check Blob.js
2. MENTION FILESAVER IN README

1. Functions on Aggregator like SUM(x)*2 AS s2
2. SELECT x,y,z, z*SUM(x) OVER (PARTITION BY y)
3. SELECT *, DELETE(a,b) FROM ?

1. ? IN ?

For the question:
http://stackoverflow.com/questions/15441670/intersection-of-arrays-of-objects-based-on-object-property-value/27657487#27657487

Calculate prime numbers with SQL


0.Clean the code. Remove modifier functions like queryValue()

ROW_NUMBER, RANK, DENSE_RANK, and NTILE

1. SELECT after GROUP BY

http://www.polyteknisk.dk/related_materials/9780735623132_chapter_01.pdf

SELECT and GROUP order:
==
FROM clause
WHERE clause
GROUP BY clause
HAVING clause
SELECT clause
ORDER BY clause

MySQL Extensions to GROUP BY
MySQL extends this behavior to permit the use of an alias in the HAVING clause for the aggregated column
http://stackoverflow.com/questions/18169055/confusion-about-the-execution-order-in-sql-query?lq=1

1. Insert selectfn into group function() before having();
Not a big change, but ... some.

SELECT order
======

FROM
ON
OUTER
WHERE
--> SELECT (now)
GROUP BY
CUBE | ROLLUP
HAVING
--> SELECT (should be)
DISTINCT
ORDER BY
TOP


Check Fluent interface for Linq and Select();
Where(r,p) p[0].price == r.price
GroupBy(r,p,g) p.prices.price * 100
Max(??????) -> return p.Max(); - scope as an object  
if(g is undefined) g = {max:0}
else g.max = g.max+g.max
(g.max = (g.max||0)+1);

GROUP BY ?, ORDER BY ?, HAVING ?, WHERE ? - how to group() and select()

2. CROSS APPLY (file:///C:/Users/%D0%90%D0%BD%D0%B4%D1%80%D0%B5%D0%B9/Dropbox/Projects/Knowbase2014/books/SQL_chapter_01.pdf)

3. PIVOT / UNPIVOT

4. FROM RANGE(1,10) check 
5. VALUE KEY WORD

var res = alasql('SELECT COUNT(*) as cnt, VALUE AGGR(cnt/$[0]*4) as pi FROM (SELECT random() as x, random() as y FROM RANGE(1,$[0])) WHERE x*x+y*y<1',
          [n]);

0. 'SELECT x, y, SUM(x) OVER (PARTITION y) FROM data'

0. Linq

* Having(g) + functions()
* Where(r,p)
* GroupBy(r,p,g)
* Join("tableid",function on(r1,r2){})
* Modifiers: Matrix(), Row(), Index("columnid"), Value("columnid"),  Column("columid"), Text("columnid"), 
* Distinct(), Top(), Limit(), Fetch()
* tableid.columnid
* databaseid.tableid
* -columnid (for Orders)

1. Alternative Excel Export (safari safe)

http://stackoverflow.com/questions/27511629/importing-and-exporting-excel-files-to-javascript-array/27616508#27616508

2. CONCAT Aggregator and REDUCE syntax

http://stackoverflow.com/questions/25677207/count-total-with-two-criterias-using-lodash/27634849#27634849
// User-defined aggregator to concat arrays
alasql.aggr.CONCAT = function(acc, val, v2,...) {
    return (acc||[]).concat(val);
};

SELECT SUM(a*b)

SELECT VALUE CONCAT(_) FROM ? WHERE LEN(_) = 2

SELECT * FROM ? WHERE a IN (SELECT * FROM _.b WHERE c > 0);
SELECT * FROM ? WHERE a IN b
http://jsfiddle.net/agershun/gaohxfjo/2/

Question: http://stackoverflow.com/questions/9923625/find-item-in-array-based-on-text?rq=1

var res = alasql('SELECT COLUMN id FROM ? WHERE ([desc] LIKE $[1]) OR (title like $[1]) OR EXISTS(SELECT * FROM _.tags WHERE _ like $[1])', [items,"%"+serach+"%"]);

SELECT KEYS(a) AS k FROM ? WHERE EXIST(SELECT * FROM _.k WHERE _ LIKE "Name%")

if(databaseid == '_') {...}



aaa.filter(function(obj){var k = Object.keys(obj); return (k.filter(function(d){return d.indexOf("Name")==0}).length)});

## Linq




#### Variant 1: like Underscope and Lo-Dash
alasql(data).orderBy("aaa","bbb","-ccc");
alasql(data).groupBy("aaa");

#### Variant 2
alasql.Select('*').From(data).Where('a>10').exec();

alasql.From().value();
alasql.From().exec();
alasql.From(data).OrderBy("aaa").Matrix().exec();
alasql.From(data).OrderBy("aaa").Matrix().compile();
alasql.From(data).OrderBy("aaa").Matrix().pretty();
alasql(data).OrderBy("aaa").Matrix().exec();

alasql(data) => new Alalinq();
Alalinq.from = new yy.Data(data);
Alalinq.exec = create yy.Statement({select:new yy.Select()});



Alalinq()
Linq
Linq = function(){};

extend(alasql,Alalinq);

Question - how to cache it?

Alasql Syntax:
Select
From
Where
alasql(data).Select("a","FIRST(b) AS c").GroupBy("a").OrderBy("c").exec();
GroupBy
Join
Top
Having
Value, Matrix, Row, Column, Text




http://stackoverflow.com/questions/25047463/group-by-and-sum-using-underscore-lodash/27634325#27634325
SELECT INDEX platformId, SUM(payout) AS payout, SUM(numOfPeople) AS numOfPeople FROM ? GROUP BY platformId;

alasql("SELECT RECORDSET * FROM XLSX(?)",[recordset]);
alasql("SELECT KEY a, ARRAY(_) FROM ?",[data]); == _.groupBy(data,"a"); like Lodash
alasql("SELECT KEY ? AS a, ARRAY(_) FROM ? GROUP BY a",[myFn, data]); 
alasql('SELECT *, REMOVE(hashKey) FROM ?',[a]);
a = #->a

SELECT * FROM MSSQL("select * from a",{database:"aas"})
extend(a._,b._) as ab

alasql.Select('*').compile(dbid);
alasql.Select('*').exec([a,b],cb);
alasql.From("").

/* http://en.wikipedia.org/wiki/Language_Integrated_Query */

Filters:
alasql("GROUP BY _ HAVING COUNT(*) > 2 WHERE _ < 100 ORDER BY _ DESC",[data]);

alasql('SELECT a FROM ? GROUP BY ?',[data, groupFn]);
var res = alasql('GROUP BY ?',[data,groupFn]);
var res = alasql('GROUP BY MID(a,1,1)',[data]);
var res = alasql('group by _ having count(*) > 10', [data]);



* * - how to resolve unambigous column names?
* Short syntax: alasql('order by a,b',[a]);

> cat a.txt | alacon 'order by mid(_,1,5)' | cat

* Short syntax: alasql('SELECT COLUMN _ FROM ? ORDER BY a',[a]);

For browser:
    SELECT COLUMN _ FROM ?
For Node.js
    SELECT COLUMN _ FROM TXT()

* Short syntax: alasql('SELECT * FROM ? ORDER BY a',[a]);
* 

<button alasql-click='SELECT * FROM ? WHERE a = ? | src_items, test | items'>
<div ng-repeat="item in items | alasql: ORDER BY a,b">

* Angular Light Filter 
http://jsfiddle.net/agershun/pTT5x/5/

// Easy filter
alight.filters.alasql = function(exp, scope) {
    return function(value) {
        return alasql(exp,[value,scope]);
    }
}

<i al-repeat="it in [1,2,3,4,5,6,7,8,9] | alasql:WHERE _ <= :size">({{it}})</i>
<a al-alasql="items | SELECT * FROM XLSX('mydata.xlsx')">aaaa</a>

alasql("SELECT * FROM XLSX('#file',{upload:true})",[],function(res){
	console.log(res);
});

        var iel = document.createElement('input');
        iel.setAttribute('type','file');
        iel.style.width = "500px";
        iel.addEventListener('change', deptImportFileSelect.bind(this), false);



	function deptImportFileSelect (event) {
		var self = this;
//		console.log('deptImportFileSelect');
	}




* SELECT SUM(_) FROM ?
* SELECT q1._, q2._ AS q2_ FROM ? q1 JOIN ? q2 USING a
* SELECT * FROM ? WHERE a IN ?
* SELECT * FROM ? WHERE ? IN a
* SELECT TEXT _ FROM TXT('aaa.txt') WHERE LEN(_) > 20 ORDER BY _
* alacon bin + alaserver bin

### Version 0.0.33 - "WebSQL + Pretty + Bug Fixes" (priorities 1-2)

* WebSQL support
* Prettify() bugs
* alasql.org/console bugs (SOURCE and other commands)
* alasql.org redesign (add twitter + stories)
* master branch + CDN + dist/
* alacon + alaserver bin commands (test with npm install alasql -g)

Fix bugs in pretty()
====
1. alasql.parse("CREATE TABLE cities (city string, population number);INSERT INTO cities VALUES ('Rome',2863223), ('Paris',2249975), ('Berlin',3517424), ('Madrid',3041579);SELECT * FROM cities WHERE population < 3500000 ORDER BY population DESC").toString()

SELECT TOP 10 *,*,*
  	FROM rrr
  	GROUP BY
  	ORDER BY;

 CREATE TABLE one (
 	one INT,
 	two STRING
 );

2. Prettify SQL output for Consolet;


## Other Functionality 

#### Version 0.0.33 - "OTHER FUNCTIONALITY"

* Syncing with server
* REGEXP_LIKE 
* IDENTITY (1,1) or AUTO_INCREMENT

Other databases support:
* NeDB
* LockiJS
* TaffyDB
* sessionStorage
* MongoDb and other key-value storages
* source as a function

#### Version 0.0.34 - Advanced "localStorage" support
* STORE SCHEMA
* STORE DATA

Answer on StackOverflow questions:
http://stackoverflow.com/questions/1878256/html5-localstorage-sql
http://stackoverflow.com/questions/14260127/is-there-a-free-lib-accessing-to-html5-database-sqlite


#### Version 0.0.33 - "Streamming"

* Select data from function on the stream (instreamfn())
* SELECT INTO the streamm function (outstreamfn()) - with group+order and without
* SELECT without stream

* SELECT FROM IndexedDB with Indexes
* IndexedDB INSERT/DELETE/UPDATE/SELECT INTO 
* SYNC SCHEMAS WITH INDEXEDDB
* PRIMARY/FOREIGN KEYS
* KEYS & IndexedDB


#### Version 0.0.35 - "CAST"

2. STANDARD DATATYPES WITH CAST FUNCTIONS
===
alasql.dbtypes = {};
alasql.dbtypes.INT = {
	jstyped: 'number',
	cast: function(value, dbtypeid) {}
};

alasql.dbtypes.DATE = {
	jstyped: 'object',
	jsclass: 'Date',
	cast: function(value, dbtypeid) {}
};


9. Compare function

if(!columns || columns.length == 0 || columns.dbtypeid == "JSON" ||
	columns.dbtypeid == "JSDATE"
) {
	s += 'if(typeof a=="object") a=a.valueOf();if(typeof b=="object") b=b.valueOf();';
}


10. Cast functions

CAST(a AS JSDATE)
CAST(a AS SQLDATE)

11. Date functions - realize only standard()!!!!
====

* NOW()	Returns the current date and time
* CURDATE()	Returns the current date
* CURTIME()	Returns the current time
* DATE()	Extracts the date part of a date or date/time expression
EXTRACT()	Returns a single part of a date/time
DATE_ADD()	Adds a specified time interval to a date
DATE_SUB()	Subtracts a specified time interval from a date
DATEDIFF()	Returns the number of days between two dates
DATE_FORMAT()	Displays date/time data in different formats

* GETDATE()	Returns the current date and time
DATEPART()	Returns a single part of a date/time
DATEADD()	Adds or subtracts a specified time interval from a date
DATEDIFF()	Returns the time between two dates
CONVERT()	Displays date/time data in different formats

ADDDATE()	Adds dates
ADDTIME()	Adds time
CONVERT_TZ()	Converts from one timezone to another
CURDATE()	Returns the current date
CURRENT_DATE(), CURRENT_DATE	Synonyms for CURDATE()
CURRENT_TIME(), CURRENT_TIME	Synonyms for CURTIME()
CURRENT_TIMESTAMP(), CURRENT_TIMESTAMP	Synonyms for NOW()
CURTIME()	Returns the current time
DATE_ADD()	Adds two dates
DATE_FORMAT()	Formats date as specified
DATE_SUB()	Subtracts two dates
* DATE()	Extracts the date part of a date or datetime expression
DATEDIFF()	Subtracts two dates
* DAY()	Synonym for DAYOFMONTH()
DAYNAME()	Returns the name of the weekday
* DAYOFMONTH()	Returns the day of the month (1-31)
* DAYOFWEEK()	Returns the weekday index of the argument
* DAYOFYEAR()	Returns the day of the year (1-366)
EXTRACT	Extracts part of a date
FROM_DAYS()	Converts a day number to a date
FROM_UNIXTIME()	Formats date as a UNIX timestamp
* HOUR()	Extracts the hour
LAST_DAY	Returns the last day of the month for the argument
LOCALTIME(), LOCALTIME	Synonym for NOW()
LOCALTIMESTAMP, LOCALTIMESTAMP()	Synonym for NOW()
MAKEDATE()	Creates a date from the year and day of year
MAKETIME	MAKETIME()
MICROSECOND()	Returns the microseconds from argument
* MINUTE()	Returns the minute from the argument
* MONTH()	Return the month from the date passed
MONTHNAME()	Returns the name of the month
* NOW()	Returns the current date and time
PERIOD_ADD()	Adds a period to a year-month
PERIOD_DIFF()	Returns the number of months between periods
* QUARTER()	Returns the quarter from a date argument
SEC_TO_TIME()	Converts seconds to 'HH:MM:SS' format
* SECOND()	Returns the second (0-59)
STR_TO_DATE()	Converts a string to a date
SUBDATE()	When invoked with three arguments a synonym for DATE_SUB()
SUBTIME()	Subtracts times
SYSDATE()	Returns the time at which the function executes
TIME_FORMAT()	Formats as time
TIME_TO_SEC()	Returns the argument converted to seconds
* TIME()	Extracts the time portion of the expression passed
TIMEDIFF()	Subtracts time
TIMESTAMP()	With a single argument, this function returns the date or datetime expression. With two arguments, the sum of the arguments
TIMESTAMPADD()	Adds an interval to a datetime expression
TIMESTAMPDIFF()	Subtracts an interval from a datetime expression
TO_DAYS()	Returns the date argument converted to days
UNIX_TIMESTAMP()	Returns a UNIX timestamp
UTC_DATE()	Returns the current UTC date
UTC_TIME()	Returns the current UTC time
UTC_TIMESTAMP()	Returns the current UTC date and time
* WEEK()	Returns the week number
* WEEKDAY()	Returns the weekday index
* WEEKOFYEAR()	Returns the calendar week of the date (1-53)
* YEAR()	Returns the year
* YEARWEEK()	Returns the year and week

5. Data types

JavaScript
===
string
number
boolean
object

JavaScript Subtype
==
Date
Array

Other
==
INT, etc.


jstypeid
==


15. PERSISTENCE
====

Adapters
Memory


Node
==
Redis, Memcached, Key-Values


Persistence
* Save data
* Save Schema
* Restore Schema
* Restore data
* Rebuild indexes
* Transactions

* work over WebSQL select * into websql('two') from websql('one');
* Lawnchair interface... let's start with it!

* Primary Key
* Create Index

* @ deepCopy
* CREATE TABLE one;
* INSERT INTO one VALUES @{a:2}, ?
* SELECT @a FROM @[{a:[1,2]}]
* @a->2 - deepCopy

GROUP BY TOTAL(a, b)

options.result = RECORDSET, MATRIX
SELECT RECORDSET a
SELECT GROUP(a/b), SUM(a) FROM 


#### Version 0.0.26 - "Alasql and AlanosQL - like MongoDB"


* SELECT {a:2} AS alpha FROM one FIND {b:[2,3]}
* SELECT (a = 2) AS alpha FROM one WHERE b IN (2,3)
* one.find({b:[2,3]});

* one.insert({a:1});

* UPDATE one SET {a:2} WHERE {a:3}
* UPDATE one SET a=2 WHERE a=3
* one.update({a:2}, {a:3});

* DELETE FROM one FIND {a:2}
* DELETE FROM one WHERE a=2
* remove({a:2})

* JSON - pseudo-function and from-function

### LINQ Syntax

#### Version 0.0.26 - "CAST and CONVERT"

* CAST with more type conversions (dates)

* xcolumns to ixcolumns for compatibility with Alfina
* Bugs

#### Version 0.0.27 - "CAST and CONVERT"

* more CAST functions

#### Version 0.0.28 - "ISO and JS Dates"

* Replace magic character '`' to CharCode(0) or something else similar Unicode?
* ISODATE and JSDATE for DATE and DATETIME
* Multiple line comments like /* comment newline comment */

#### Version 0.0.30 - "NoSQL interface"

* inventory.find('inventory',{type:'food',$or:[{qty:{$gt:100}},{price:{$lt:9.95}}]}); 
* inventory.insert()
* inventory.update()
* inventory.remove()

#### Version 0.0.31 - "Linq interface"

* select().into().from().groupby().orderby().where()

#### Version 0.0.32 - "Promised version"

Alternative
* alasql('SELECT * FROM ? WHERE {qty:[1,2]}', [data]);
alasql.compile('SELECT * FROM ? WHERE {qty:[1,?]}'); - ParamValue


#### Version 0.0.35 - "Primary Keys and Unique Indices"

* PRIMARY KEY
* CREATE UNIQUE INDEX
* DROP INDEX
* SHOW INDEX
* SHOW CREATE TABLE with INDEX
* INSERT with unique
* DELETE with unique
* UPDATE with unique
* NULL, IS NULL
* DEFAULT

#### Version 0.0.36 - "FOREIGN KEYS"

* FOREIGN KEY
* INSERT
* DELETE
* UPDATE

#### Version 0.0.40 - "CREATE INDEX"

* CREATE INDEX
* INSERT
* DELETE
* UPDATE

#### Version 0.0.45 - "CREATE VIEW"

* CREATE VIEW
* DROP VIEW
* SELECT with VIEW

#### Version 0.0.50 - "Tables, Views, Subqueries, ParamValues the same"

* Single parent class for tables, views, subqueries, paramvalues with data 
* Use parameter arrays and subqueries in JOIN clause

#### Version 0.0.55 - "Types"

* Type resolutions
* Third UNION order issue
* Change xcolumns to ixcolumns for compatibility with Alfina (?)
* Analyze results of SELECT with statement.query.columns...
* LOAD JSON url TO table (json)
* More test databases

#### Version 0.0.65 - "Errors"

* SQL-errors handling

#### Version 0.0.70 - "Battle for SQL-92"

* Many-many SQL-92 Tests 
* Complience with [SQL-92 specifications](http://savage.net.au/SQL/sql-92.bnf.html) where it is possible 
* Chrome/FireFox/Safari/IE/Chromium/Opera/Node.Js/Rhino/iOS/Android/Win8 compatibilty tests
* Development environment (clean gulp code)

#### Version 0.0.75 - "Pivot"

* PIVOT like [T-SQL](http://technet.microsoft.com/en-us/library/ms177410(v=sql.105).aspx)

#### Version 0.0.80 - "Transactions"

* Transactions

#### Version 0.0.85 - "Battle for Performance"

* Remove forEach loops
* Optmization parameters


#### Version 0.0.90 - "Explain Why"
* EXPLAIN


#### Version 0.0.95 - "Persistence"
* Persistence

#### Version 0.0.100 - "Less bugs"
* More tests less bugs

#### Version 0.0.105 - "Battle for Memory"

* Memory leaks

#### Version 0.0.110 - "Battle for Memory"
* Minification

#### Version 0.0.115 - "JavaScript API"

* JavaScript API clarification


#### Version 0.0.120 - "JQuery plugin"

* $.alasql(sql, params) plugin

#### Version 0.0.121 - "Angular plugin"

* AngularJS plugin 

#### Version 0.0.123 - "Sync WebSQL"

* WebSQL compatibility

#### Version 0.0.124 - "WinJS"

* WinJS plugin

#### Version 0.0.125 - "Alasql over IndexedDB and other key-valye"

* IndexedDB
* MongoDB
* localStorage

#### Version 0.0.126 - "SQL parser, prettifier, and generator, SQL query builder"

* SQL prettify
* SQL query builder
* SQL parser

#### Version 0.0.127 - "SQL parser, prettifier, and generator, SQL query builder"

* Pass-thru SQL to server or custom driver


#### Version 0.0.128 - "MongoDB like queries"

* Pass-thru SQL to server or custom driver

#### Version 0.0.128 - "LINQ like queries"

* Pass-thru SQL to server or custom driver


#### Version 0.0.132 - AlaChartSQL

* Demo with charts and SQL (compare to https://github.com/paulasmuth/fnordmetric)

#### Version 0.0.133 - AlaTextSQL

* Utility for OS command line query and text processing

#### Version 0.0.135 - MDX SELECT

* Merge with Alamdx 
* mdx select Measures.qty on rows from sales

#### Version 0.0.136 - Hierarchy Group By

* GROUP BY HIERARCHY(deptid)

#### Version 0.0.137 - Aggregator Functions

* SELECT SUM(amt) AS amt, SUM(qty) AS qty, AGGR(amt/qty) AS average FROM one GROUP BY deptid 

#### Version 0.0.138 - Total on top/bottom and group with details

* SELECT WITH TOTAL GROUP BY deptid, DETAILS()

#### Version 0.0.138 - "Battle with Bugs 1"

* Bug fixing release (alpha for 0.1)
* More tests

#### Version 0.0.140 - "Battle with Bugs 2"

* Bug fixing release (beta for 0.1)
* More tests

#### Version 0.0.145 - "Battle with Bugs 3"

* Bug fixing release (gamma for 0.1)
* More tests

#### Version 0.0.150 - "Battle with Bugs 3"

* Bug fixing release (delta for 0.1)
* More tests

#### Version 0.1.0 - "First Pancake!"

## URGENT

* Fix *, table1.*, table2.* with common columns issue
* Tests!

Option:
* alasql.yy.options.braliteral = true; [column]
* {}, [] - alasql.yy.options.braliteral

* Add sessionStorage support
* Add async streamming


* Create cache
attach server database mssql; 
attach indexeddb database cache;
insert into cache.synctables values ('one','select * from mssql.one');

* Sync cache
attach server database mssql; 
attach indexeddb database cache;
insert into versions select * from mssql.versions;
sync cache.synctables on versions;

* IF THEN ELSE
if exists(cache.table) then 
	sss
elsif sss then
	aaaa
else
	sss
end if;

set @info = select *;
set @a = select *;
open cursor;
...

* CASE

* LOOP sss EXIT WHEN llll END LOOP;

* WHILE LOOP
while loop

end loop;

* WHILE BEGIN END;
* SET var = expression;
* variables @var  (@literal)
* DECLARE @aaaa INT

* Check GROUP BY compatibility
http://blog.jooq.org/2014/12/04/do-you-really-understand-sqls-group-by-and-having-clauses/

* ALTER TABLE ADD COLUMN
* ALTER TABLE MODIFY COLUMN
* World City Database - big data
* FETCH FIRST NumValue ROWS ONLY

* Order by random
SELECT column, RAND() as IDX 
FROM table 
ORDER BY IDX FETCH FIRST 1 ROWS ONLY
* RAND, RANDOM, NEWID
* TABLESAMPLE

* Column resolutions

* Primary key, Foreign Key, Constraints, Unique Indexe
* Join source Table, Subquery, ParamValue, View
* Transactions
* ORDER BY RAND(), RANDOM(), NEWID()
* TRUNCATE TABLE
* ALTER TABLE table DROP INDEX index
* WITH table AS Select SELECT
* Check IS NULL/IS NOT NULL
* DELETE JOIN / UPDATE JOIN 
* Fix tests
* STORE / RESTORE TABLE
* FOREIGN KEY
* CREATE INDEX
* DROP INDEX
* DROP CONSTRAINT

* Add check for CROSS JOIN (that there is no USING or ON clause)

* console
* table.pk.pkrightfns, table.pk.pkrightfn, hh
* table.fks[].fkleftfns, table.fks[].fkleftfn, table.fks[].tableid, fks[].fkrightfns, table.fks[].fkrightfn
* INSERT, DELETE, UPDATE with primary and foreign keys

* CREATE TRIGGER  and triggers
* JOIN (subquery)
* Group by formula
* WITH clause
* documentation
* SELECT FROM nevenending stream (for Node.js), including INNER, LEFT, SEMI JOIN
* CURSORS
* Sandbox for SQL - like SQLFiddle, alasqlfiddle.
* db.indexAll(table)
* Precompiled insert for tables: 
* "SELECT aaa.* FROM :aaa" without AS clause
* compile flags for query (arrayofobjects, value, array, arrayofarrays)
* Aggregation formula GROUPFN()

## FEATURES TO BE IMPLEMENTED SOON
## MOBILE APPLICATIONS SUPPORT

* WinJS
* Apache Cordova
* PhoneGap

## BUSINESS INTELLIGENCE

* d3
* OLAP

## FRAMEWORKS

* jQuery
* AngularJS

## JAVASCRIPT

* WebWorker

## Applications

* Command-line utility for text files

* BEGIN COMMIT ROLLBACK
* INSERT INTO test SELECT 'a' UNION ALL SELECT '10'
* AVG aggregator (http://www.w3schools.com/sql/sql_func_avg.asp)
* SELECT INTO table IN database FROM query [like this](http://www.w3schools.com/sql/sql_select_into.asp)
* Change grammar for LogicValues
* GO* Separate branch on github.com for development

Optimization

* WHERE multiple optimization
* Performance Tests based on SQLite [tests](http://www.sqlite.org/speed.html)
* Pass [SQL Logic Test](http://www.sqlite.org/sqllogictest/doc/trunk/about.wiki)
* Optimization for EXISTS subqueries (check if column is from outer select)
* Replace join recursion with loop (may be faster) [like here](http://architects.dzone.com/articles/sql-execution-plans-javascript)
* Optimizations for joins and subqueries
* SELECT * FROM f JOIN g ON f1 = g2 AND F1(f) = G1(g) AND F2(not g) = G2(not f) 
* FOREIGN KEY JOINS
* WHERE a OR b optimization
* ORDER BY WITH index
* Optimization of WHERE and JOINS with indices 
* Indices with hash
* Dirty data and indices update
* Code refactoring
* Performance tests and optimization
* Minimize size
* Indices with insert/delete/update procedure
* EXPLAIN QUERY PLAN (like [SQLite does](https://www.sqlite.org/eqp.html))
* Combine selectwhere and groupfn functions
* Semi-joins (for outer joins) 
* Expand outer join to N tables (not only two)
* INSERT INTO SELECT statement

SELECT AND OTHER SQL STATEMENTS

* Fast join of single value with indices (PRIMARY KEY)
* GROUP BY ALL
* Constrains, Foreign Keys, Primary key, cascade delete and update
* Types, NULL, NOT NULL
* Database.schema.table.field
* Constrains
* Keys
* Null not null
* Primary key
* Rowversion, rowversion on insert, delete
* JavaScript functions
* Identity 1,1, unique fields
* FETCH 
* Views (?)
* Cursors
* SQLite compatibility: functions
* SQL-standards - check [this](https://www.sequelsphere.com/dbdocs/supported-sql/)
* SQL-functions - check [this](https://www.sequelsphere.com/docs/latest/doc/Supported%20SQL%20Functions.html)

BUGS

* Aggregators without groups
* 'SELECT wrongfield FROM table' gives something wrong 
* Change order of groupfn() and selectfn(), and check havingfn vs selectfn

PERSISTENCE

* WebSQL
* localStorage / sessionStorage
* IndexedDB
* lawnchair.js
* Serer synchronization JavaScript plugin (like [WebSqlSync](https://github.com/orbitaloop/WebSqlSync))

DEVELOPMENT

* Minifiication

REALIZATION

* WebWorkers
* Redis, levelDB, IndexDB, localStorage for persistence 
* Persistence
* Split parsing, compilation, and execution functions
* JSon sql definition
* Compile to asm.js
* Executor
* Compiled procedures
* Compiled statements
* alasql2js compiler
* Better parser and SQL-formatter

ANYDATABASE

* Any database
* Node.js server
* Pass-thru database

COMPATIBILITY

* Compatibility
* Realize SQLite functions (from [documentation](http://kripken.github.io/sql.js/documentation/))
* Test with ie and Firefox browsers
* Tests for different browsers (IE!!!)
* Crossfilter, lodash and underscore speed comparision
* Cover WebSQL and Sql.js with own functions (for simple migrating)
* Be compatible with [w3school](http://www.w3schools.com/sql/default.asp)
* [Oracle syntax](http://docs.oracle.com/javadb/10.6.2.1/ref/rrefclauses.html)
* Check [SQL BNF](http://www.contrib.andrew.cmu.edu/~shadow/sql/sql2bnf.aug92.txt)

OTHER NEEDED FUNCTIONALITY (MORE THAN SQL)

* OLAP
* Pivot operator
* Totals (this is non-SQL functionality, but required)
* Running totals 
* Hierarchy totals
* Totals with insert/delete/update procedure

MDX
* MDX parser
* MDX processor

SAMPLES

* Check for compatibility with [W3C SQL demo database](http://www.w3schools.com/w3Database.js)
* Console [like](http://www.moxleystratton.com/files/sqittle.html) 
* One more [sample](http://yradtsevich.github.io/pure-js-websql/test/index.html)
* Create tutorial database on https://github.com/txje/js-sql-tutorial for best console

### Version 0.2 - NoSQL supports

* JavaScript search like MongoDB

### Version 0.3 - OLAP + MDX

* Mini MDX parser
* JavaScript in-memory OLAP functionality (additional library)


attach server database mssql; 
attach indexeddb database cache;
insert into cache.synctables values ('one','select * from mssql.one');

attach server database mssql; 
attach indexeddb database cache;
insert into versions select * from mssql.versions;
sync cache.synctables on versions;


if exists(cache.table) then 
	sss
elsif sss then
	aaaa
else
	sss
end if;

while

end;



OTHER

* Create site alasql.org
* Review [textql project](https://github.com/dinedal/textql), [q](https://github.com/harelba/q), 
* [presto](http://prestodb.io/), [h2](http://www.h2database.com/html/grammar.html)