apache

Abstract I’ll show how to connect to Qliksense Repository API via sql using Apache Drill. In this example Qliksense engine service runs at https://qlik.redaelli.org:4242/ Download Download and unzip Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "qliksense" : { "type" : "http", "cacheResults" : true, "connections" : { "p4242" : { "url" : "http://nginx.redaelli.org/qlik/", "method" : "GET", "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["filter"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } At the moment Apache drill cannot query external rest services with client certificates DRILL-8052 and so we need a reverse proxy like Nginx....

Abstract I’ll show how to connect to Talend Cloud API via sql using Apache Drill. Download Download Apache Drill from https://drill.apache.org/download/ Configure Create or edit the file conf/storage-plugins-override.conf "storage": { "talendcloud" : { "type" : "http", "cacheResults" : true, "connections" : { "get" : { "url" : "https://api.eu.cloud.talend.com", "method" : "GET", "headers" : { "Authorization" : "Bearer MYSECRETKEY" }, "authType" : "none", "userName" : null, "password" : null, "postBody" : null, "params" : ["query"], "dataPath" : null, "requireTail" : true, "inputType" : "json", "xmlDataLevel" : 1 } }, "proxyType" : "direct", "enabled" : true } } Start Drill Run drill with...

Apache Camel is an open source integration framework that empowers you to quickly and easily integrate various systems consuming or producing data. Apache Groovy is a Java-syntax-compatible object-orientedprogramming language for the Java platform. It is both a static and dynamic language with features similar to those of Python, Ruby, and Smalltalk. It can be used as both a programming language and a scripting language for the Java Platform, is compiled to Java virtual machine (JVM) bytecode, and interoperates seamlessly with other Java code and libraries....

Below the interested part of code using spring xml <bean id="ds-patriot-dw_ro" class="org.springframework.jdbc.datasource.DriverManagerDataSource"> <property name="driverClassName" value="oracle.jdbc.OracleDriver" /> <property name="url" value="jdbc:oracle:thin:@//patriot.redaelli.org:1111/RED"/> <property name="Username" value="user"/> <property name="Password" value="pwd"/> </bean> <camelContext id="MyCamel" streamCache="true" xmlns="http://camel.apache.org/schema/spring"> <route id="scheduler"> <from uri="timer:hello?repeatCount=1"/> <setHeader headerName="ndays"> <constant>0</constant> </setHeader> <to uri="direct:start"/> </route> <route> <from uri="direct:start"/> <setBody> <constant>table1,table2,table3</constant> </setBody> <split streaming="true"> <tokenize token="," /> <setHeader headerName="tablename"> <simple>${body}</simple> </setHeader> <to uri="direct:jdbc2csv"/> </split> </route> <route> <from uri="direct:jdbc2csv"/> <to uri="direct:get-jdbc-data" pattern="InOut" /> <to uri="direct:export-csv" /> </route> <route> <from uri="direct:get-jdbc-data"/> <log message="quering table ${headers....

I’d like to have an alternative to Hadoop HDFS, a faster and not java filesystem: S3: S3 Support in Apache Hadoop if your servers are hosted at Amazon AWS chep: using hadoop with ceph glusterfs: managing hadoop compatible storage lustre: Running hadoop with lustre Openstack Swift: Hadoop OpenStack Support: Swift Object Store xstreamfs: there is an hadoop client Which is better? Any suggestions? References: [1] https://en.wikipedia.org/wiki/Comparison_of_distributed_file_systems