Skip to main content
Adaptive Insights
Knowledge and Support - Adaptive Insights

Adaptive Integration for Discovery Enterprise

Adaptive Integration is a program that acts as a secure bridge to import data from a wide variety of spreadsheets and data­bases into Adaptive Suite products. You can filter, clean, and map information being imported so you can eliminate poten­tial errors that can happen during a manual data import. In addition, you can schedule tasks and operations so data can be imported at specific times automatically. Adaptive Integration for Discovery Enterprise will allow customers to bring data from different data sources into Discovery Enterprise.

There are two types of Adaptive Integration users:

  • Data analysts run tasks and work with the imported information in the Adaptive Suite. Data analysts have access to the Tasks Overview and Tasks Detail screens and can view and run tasks shared with them and view the task history. Data analysts must have the Integration Operator role.

  • IT users are high-level users (frequently administrators) who can set up and edit data sources, loaders, and tasks. IT users must be familiar with the Adaptive Suite and have a substantial understanding of databases and connec­tivity. IT users must have the Data Designer role and one of Discovery's Standard or Administrator roles.

The IT users do the initial set up of Adaptive Integration and then work in a maintenance mode, responding to requests for new tasks or different data sources from the data analysts. IT users also grant permissions to other users to perform tasks.

Typical Workflow

The general process for importing data with Adaptive Integration is as follows:

  1. The IT user sets up a data source that extracts information from a spreadsheet, a JDBC-compliant database, Net­Suite, a table group (featuring SQL-joined tables), or an ETL scripted data source. If extracting from a JDBC-compli­ant database, the IT user must also use the Adaptive Data Agent Service Manager to set up a data agent for secure communication between the database and Adaptive Integration. SQL joins and expressions can be added to filter data.

  2. The IT user previews the extracted information, which is held in Adaptive Integration’s staging area.Columns or tables can be specified for use or to be ignored. SQL expressions can be added to filter data. The IT user can also change the data type of individual columns.

  3. The IT user sets up a loader, which takes the data from the staging area and loads it into Adaptive Discovery. The IT user selects a table source and assigns a date/time type to it. Columns are dragged and dropped into metrics and dimensions. The columns can be configured with the metrics and dimensions already configured in Adaptive Discov­ery, or the IT user can set up new metrics or dimensions as part of the loader creation process. Duplicate data rows can be eliminated and additional calculations or SQL operations specified. When the loader is ready, the IT user can test it by running the loader manually to load the information into Adaptive Discovery.

  4. The IT user creates a task, a predefined set of operations that combines loaders and sub-tasks, to extract, process, and load data that has been filtered and scrubbed appropriately into Adaptive Discovery. Tasks can be scheduled to run automatically at a specific minute, hour, day, or day of month. The IT user can optionally grant edit and launch permissions to data analysts and other users and roles for data sources, loaders, and tasks.

  5. The data analyst (or other permitted user) can run tasks manually on demand or use the scheduler to run tasks auto­matically. When you log on to Adaptive Integration, the default screen is the Task Overview screen. The Tasks Over­view screen displays the active tasks.

Click a task in the Tasks Overview to display detailed information about the task in the Tasks Detail screen. The Task Detail screen provides detailed information and options for the task you selected, as follows:

  • You can view information about pending and recent runs of a specific task. When you click a specific run, the status of the three phases of the run (the data import, the transformation, and the data load into Adaptive Suite) appear on the screen. You can use this information for troubleshooting errors.

  • To run a task manually from the Task Detail screen, enter the file to extract information from in the field, then click Run. Adaptive Integration runs the task and displays the status of the three phases.

  • Click Execution History at the bottom of the screen to display the task's execution history, which includes the run time/date, the task name, the run duration in seconds, and the status of the run. You can drill down by Clicking any entry in the execution history to display the log history for that instance.

Creating a Spreadsheet Data Source

To set up an Excel spreadsheet data source, follow these steps:

  1. Access the Data Designer by going to Admin > Data Designer.

  2. In the Data Source folder in the Component Library on the right side of the screen, click Create New Data Source.
    The Create New dialog box appears.

  3. Select Spreadsheet as your data source type and enter the name for the data source

  4. Click Create.

  5. Enter the data source’s information:

  • Skip failed uploads: Check this box to skip failed uploads from the spreadsheet. When this box is checked and you are importing multiple tables, if one of the tables fails on upload, the process continues to the next table instead of ending with an error because of the first failed table.

  • Log level: Select a log level from the drop-down list to specify the detail for the logging for this data source. Your options are:

  • Error: Only logs errors.

  • Info: Logs all basic information, such as when the data source was updated.

  • Verbose: Provides very detailed information about all phases and actions. (This level is used primarily for debugging or auditing, as it may produce more log information than is practical for typical use.)

When you have entered the basic configuration of the spreadsheet data source, you need to import the spread­sheet.

To import the spreadsheet, follow these steps:

  1. Click Import Spreadsheet on the Actions menu.

  2. Enter the name of the spreadsheet to open. You can click Browse to search for a file. When you select the spreadsheet, Adaptive Integration opens the spreadsheet and imports the information. Adaptive Integration also imports the spreadsheet structure (field names, order of fields). It assigns a default data type to each column but does not interpret any formatting rules associated with each spreadsheet column. The data structure appears in the Data Components menu on the left side of the screen, which is populated with the worksheets and contents of the imported spreadsheet.

  3. Click Close to close the Import Spreadsheet dialog box.

  4. Click Save on the Actions menu.

Creating a Metric Loader

You can create two types of loaders: metric loaders and scripted loaders.

To create a new metric loader, follow these steps:

  1. Access the Data Designer by going to Admin > Data Designer.

  2. In the Loaders folder in the Component Library on the right side of the screen, click Create New Loader.
    The Create New dialog box appears.

  3. Select Discovery Metric Loader as the loader type and enter a name for the loader.

  4. Click Create.
    The center area of the screen displays your new loader’s settings and other information

  5. Enter the metric loader’s information.

  1. In the Settings area, select the source table to point to the staging table which contains data to be brought into Discovery.

  2. If the staging table contains date/period information as a column, select the appropriate option for Period source and the Period column fields.

  3. Select the appropriate granularity for the Period type.

  4. Within the Data Component palette, select the staging table you have chosen. Identify the columns which you would to bring into Discovery as metrics and dimensions.

  5. Drag and drop staging columns into the Metrics or Dimensions area. While defining the metrics and dimensions, use the default values to get started quickly.
    (For information on the fields and properties, please see Metrics and Dimensions in the Adaptive Integration area)

  6. Save the definition of the loader.

  7. Optionally, if you would like to bring a subset of records from within your staging table, you can choose to enter a SQL filter. Click in the text box under Filter Settings. The Edit SQL Filter dialog box appears. Here, enter a SQL Filter expression. The help text in the editor provides examples and also a link to a detailed help document.

  8. Click Save on the Actions menu.

Creating a Task

Integration tasks let you build and refine the importing and filtering processes, then let users run the specific tasks they need to perform their jobs. You can run tasks manually on demand or schedule tasks to run automatically at a specific time or day. Tasks can be shared with other users (this is primarily how data analysts get access to tasks). Tasks can contain one or more loaders. They can also contain other tasks.

Most day-to-day use of Adaptive Integration involves tasks.

To create a new task, follow these steps:

  1. Access the Data Designer by going to Admin > Data Designer.

  2. In the Tasks folder in the Component Library on the right side of the screen, click Create New Task.
    The Create New dialog box appears.

  3. Select Integration Task and enter a name for the task.

  4. Click Create.
    The center area of the screen displays your new task’s settings and other information.

  5. Select a log level from the drop-down list to specify the detail for the logging for this data source.
    (For information on the log levels, see Creating a Task.)

  6. Click Save in the Actions menu.

When you have saved the basic configuration of the task, you need to add loader and task information. If you want to run the task at regular intervals, you will also need to add a schedule.

The final step in creating a task is to add loaders and tasks so that the task does something. Adding a loader lets you extract data, perform data manipulation, and load the information into Adaptive Discovery. Adding other tasks lets you optionally create smaller, subtasks as building blocks that you then can combine into larger custom tasks.

To add loaders and tasks to the task, follow these steps:

  1. Drag a loader or task from the Data Components menu to the Tasks and Loaders table. The loader or task appears in the table.

  2. Continue dragging loaders and tasks to the Tasks and Loaders table.
    Loaders and tasks are performed in the order they appear in the table.

  3. Click Save on the Actions menu.

To add schedule information for the task, follow these steps:

  1. Drag a scheduling option (hourly, daily, weekly, or monthly) from the Data Components menu to the Sched­ule Settings table.
    The Edit Schedule dialog box appears.

  2. Enter schedule information, including how often the task has to run and time at which it has to run. Be sure to set the task as active if you want it to go into effect. Do not mark it as active if you only want to store the schedule data, not have the schedule implemented.
    (For information on the individual fields, please see Using Tasks and Schedules)

  3. Click Save.

 

  • Was this article helpful?