Calling Qliksense Repository API from Apache Drill via sql

Abstract I’ll show how to connect to Qliksense Repository API via sql using Apache Drill. In this example Qliksense engine service runs at https://qlik.redaelli.org:4242/ Download Download and unzip Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "qliksense" : { "type" : "http", "cacheResults" : true, "connections" : { "p4242" : { "url" : "http://nginx.redaelli.org/qlik/", "method" : "GET", "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["filter"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } At the moment Apache drill cannot query external rest services with client certificates DRILL-8052 and so we need a reverse proxy like Nginx....

February 23, 2022 · 2 min · 271 words · Matteo Redaelli

Calling Talend Cloud Rest API from Apache Drill via sql

Abstract I’ll show how to connect to Talend Cloud API via sql using Apache Drill. Download Download Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "talendcloud" : { "type" : "http", "cacheResults" : true, "connections" : { "get" : { "url" : "https://api.eu.cloud.talend.com", "method" : "GET", "headers" : { "Authorization" : "Bearer MYSECRETKEY" }, "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["query"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } Start Drill Run drill with...

February 4, 2022 · 2 min · 292 words · Matteo Redaelli

Before SQL then NOSQL and BIGDATA: now BIGDATA and SQL again

The trend of these years has been switching from SQL (RDBMS) databases to NoSQL databases like Hadoop, MongoDB, Cassandra, Riak, … SQL is a old but easy and fast way to query data. And people STILL look at it for quering Hadoop and bigdata: Apache Drill (MapR) Apache Phoenix Apache Hive (see Stinger initiative) Apache Spark SQL Presto (Facebook) Apache Tajo (a datawarehouse) Impala (Cloudera) Read details from 10 ways to query hadoop with sql ....

March 2, 2015 · 1 min · 76 words · Matteo Redaelli