Data Lake Export Announcement

November 10, 2020

We developed a tool for running queries against the Data Lake and saving them in a PDF or Excel spreadsheet.

Data Lake Export is a small tool to allow the creation of files from the Infor© Data Lake SaaS product.

It uses the general SQL syntax supported by the Infor© Compass API to pull the information, and based on the command line options, generates a formatted Excel, PDF, or a CSV document. To connect to the Compass API requires an IONAPI© authorization file. This tool was specifically tested with Infor M3© in mind, but should work with any JSON data in the Data Lake.

Data Lake Export works by reading the query from a file, connecting to the Data Lake via ION API, and taking the result set and formatting it into the requested output document.

Quick Steps to Use

  1. Create an ION API Authorization file for Data Lake Export
  2. Prototype your query in the Compass Query tool in ION Desk
  3. Save the query in a file accessible by the application
  4. Run the command specifying the desired output type and filename

An ION API authorization file is to be created as a Backend Service for this application to use. Create the authorization file in the ION API application in IOS©, and save it to your local machine.

Write a sample query in Compass in ION Desk. For M3 data, a simple test would be to select something from the Item Master.

Select top 100 CONO, ITNO, FUDS from MITMAS order by CONO, ITNO

After testing the query, save it on the computer where the Data Lake Export application can access it. With the query saved, and the authorization file saved, you’re ready to build a file.

You can find the source and further instructions at github.com/BillyWilloughby/data-lake-export.