Calling Qliksense Repository API from Apache Drill via sql

Abstract I’ll show how to connect to Qliksense Repository API via sql using Apache Drill. In this example Qliksense engine service runs at https://qlik.redaelli.org:4242/ Download Download and unzip Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "qliksense" : { "type" : "http", "cacheResults" : true, "connections" : { "p4242" : { "url" : "http://nginx.redaelli.org/qlik/", "method" : "GET", "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["filter"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } At the moment Apache drill cannot query external rest services with client certificates DRILL-8052 and so we need a reverse proxy like Nginx....

February 23, 2022 · 2 min · 271 words · Matteo Redaelli

Calling Talend Cloud Rest API from Apache Drill via sql

Abstract I’ll show how to connect to Talend Cloud API via sql using Apache Drill. Download Download Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "talendcloud" : { "type" : "http", "cacheResults" : true, "connections" : { "get" : { "url" : "https://api.eu.cloud.talend.com", "method" : "GET", "headers" : { "Authorization" : "Bearer MYSECRETKEY" }, "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["query"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } Start Drill Run drill with...

February 4, 2022 · 2 min · 292 words · Matteo Redaelli

Emacs package sql-sqlline and python package sqlu

Few days ago I published the following two opensource packages: sql-sqlline: an emacs package that extends sql package for quering less known databases (aws redshift, aws athena, ..) sqlu: a python package for extracting tables from sql select statements Comments: buy Andriol - Mar 2, 2020I don’t know if it’s just me or if perhaps everybody else experiencing issues with yor site. It appears as though some of the written text on your posts are running off the screen....

November 4, 2019 · 1 min · 115 words · Matteo Redaelli

Before SQL then NOSQL and BIGDATA: now BIGDATA and SQL again

The trend of these years has been switching from SQL (RDBMS) databases to NoSQL databases like Hadoop, MongoDB, Cassandra, Riak, … SQL is a old but easy and fast way to query data. And people STILL look at it for quering Hadoop and bigdata: Apache Drill (MapR) Apache Phoenix Apache Hive (see Stinger initiative) Apache Spark SQL Presto (Facebook) Apache Tajo (a datawarehouse) Impala (Cloudera) Read details from 10 ways to query hadoop with sql ....

March 2, 2015 · 1 min · 76 words · Matteo Redaelli