Skip to main content
Adaptive Insights
Knowledge and Support - Adaptive Insights

Setting Up a Spreadsheet Data Source

You can use Adaptive Integration to extract data from an Excel spreadsheet.

To set up an Excel spreadsheet data source, follow these steps:

  1. Access the Data Designer by going to Integration > Data Designer.

  2. In the Data Source folder in the Component Library on the right side of the screen, click Create New Data Source.
    The Create New dialog box appears.

  3. Select Spreadsheet as your data source type and enter the name for the data source

  4. Click Create.
    The center area of the screen displays your new data source’s settings, as shown below.

 

5. Enter the data source’s information:

  • Skip failed uploads: Check this box to skip failed uploads from the spreadsheet. When this box is checked and you are importing multiple tables, if one of the tables fails on upload, the process continues to the next table instead of ending with an error because of the first failed table.
  • Log level: Select a log level from the drop-down list to specify the detail for the logging for this data source. Your options are:
    • Error: Only logs errors.
    • Info: Logs all basic information, such as when the data source was updated.
    • Verbose: Provides very detailed information about all phases and actions. (This level is used primarily for debugging or auditing, as it may produce more log information than is practical for typical use.)

When you have entered the basic configuration of the spreadsheet data source, you need to import the spreadsheet.

There is an import limit of 100 columns for each sheet used as a data source. Any columns beyond the 100th will not be imported.

To import the spreadsheet, follow these steps:

  1. Click Import Spreadsheet on the Actions menu.
    You see an import progress display, after which, the Import Spreadsheet dialog box appears, as shown below.

2. Enter the name of the spreadsheet to open. You can click Browse to search for a file. When you select the spreadsheet, Adaptive Integration opens the spreadsheet and imports the information. Adaptive Integration also imports the spreadsheet structure (field names, order of fields). It assigns a default data type to each column but does not interpret any formatting rules associated with each spreadsheet col­umn. The data structure appears in the Data Components menu on the left side of the screen, which is populated with the worksheets and contents of the imported spreadsheet.

3. Click Close to close the Import Spreadsheet dialog box.

4. Click Save on the Actions menu.

The data import modes affect the way in which the data is synchronized. The default import mode (all records replaced) for a spreadsheet data source is as follows:

  1. All rows in staging are cleared.

  2. The spreadsheet data is imported.

  3. Data from spreadsheet populates staging table.

You can also choose to append imported information, in which case imported data is appended to the existing staging table, or merge imported information, in which case existing rows in the spreadsheet are merged with the rows in the staging area.

Adding Tables to a Spreadsheet Data Source

After you have imported the spreadsheet’s structure, you are ready to specify the informa­tion you want to import from the spreadsheet. The Tables to Import section of the screen lets you configure the data imported from the spreadsheet.

To specify the tables to import from the spreadsheet, follow these steps:

  1. Expand the entry for the data source in the Data Components menu, as shown below.

    Each worksheet in the spreadsheet appears as a separate item. (Data components with a slash through their icon are not currently included for import.)

2. Drag and drop the tables you want to import to the Tables to Import section in the center of the screen. As you drag each table to the Tables to Import section, a tab appears for the table and information from the spreadsheet appears in the Tables to Import section letting you see the type of information you’ve added. (Several sam­ple tables appear below.) Each table’s tab also has a drop-down menu, which you can access by clicking the arrow next to its name.

Managing Columns

If a table you are working with has a large number of columns, you can use the Manage Columns to do quick edits for which columns to import. The Manage Columns dialog box displays the columns in a table so you can then check or uncheck columns for importing.

To manage columns for importing, follow these steps:

  1. Click the arrow on the tab to the right of the table name.
    A floating menu with several options appears.

  2. Click Manage Columns on the floating menu.
    The Manage Columns dialog box appears.

  1. Check the box next to a column to import it. When you check a column, the column also appears within the preview window after the popup contents are saved. Unchecking a column removes the column from the preview window.

    You cannot change the import status on system-generated fields such as isDe­leted. You can also change the import status on individual columns by selecting col­umn properties and setting the property or by dragging and dropping the columns onto the designer.

Customizing the Tables

For each table, you can customize the way in which data is imported.

To customize the table settings, follow these steps:

  1. Click the arrow on the tab to the right of the table name.
    A floating menu with several options appears.

  2. Click Table Settings on the floating menu.
    The Table Settings dialog box appears.

   3. Enter the table settings:

  • Data Import Mode: Select one of the options from the drop-down list.
    • All records replaced each time a data import is run
      This is the default. The data in the new version of the spreadsheet replaces the previous version in the staging area.
    • Merge (add, update) received rows using the key columns
      New data is merged with existing data by matching key columns. After select­ing this option, you can set the key columns in the Column Settings area.
    • All received rows are new and so should be added
      The data already imported is left as-is and all rows of the spreadsheet you are importing are added to the table.
  • Sheet Has Header Row: Check this box if this sheet has a header row. If your spreadsheet has a header row and you leave this box unchecked, all rows includ­ing the header rows are treated as data rows and the column letters (A, B, C, etc.) are used for headings.
  • First Header/Data Row: Enter the number of the first header row (if there is a header row) or the first data row.
  • Ignore Parsing Rows: Check this box to ignore any parsing errors when updat­ing the table. If you select to ignore parsing errors, any cells with errors, such as text appearing in a date column, are ignored and the cells with errors are imported as empty. If you do not select to ignore parsing errors and there are errors, the spreadsheet will not import successfully. (You can use the error log to help you identify parsing problems.)
  1. Click Apply to apply the settings.
  2. Repeat steps 1-3 for each table.
  3. Click Save to save the settings in the data source.

Setting Column Options

While using the Tables to Import section, you can see a preview of the data as it is in the data source or as it is in the staging area after it has been imported. Select Spreadsheet or Staging table from the drop-down to preview data.

You can change the options for each column by mousing over its heading and then click­ing the drop-down menu next to its name. These options are:

  • Sort Ascending: Sort the entire table based on this column in ascending order.
  • Sort Descending: Sort the entire table based on this column in descending order.
  • Column Settings: This dialog is used to change the properties of the column within the staging table.
    • Name: The name of the column, displayed in the header.
    • Column Type: The type of data used in the column.
    • Convert Column Type: Select the new type from this drop-down menu.
  • Exclude column from import: Select this to remove this column from the data being imported.
  • Delete custom column: Select this to delete the column. (Available for custom col­umns only.)

Downloading Data from a Staging Table

You can download data from a single staging table.

To download data from a single staging table, follow these steps:

  1. Click the down arrow in a table heading in the Tables to Import section.

  2. Select Download Data.

  3. At the prompt “This operation will send an email with a url to download the data,” click Send. Adaptive Integration sends an email containing a URL to the email account associated with the data designer.

  4. Open the email and click the URL. The data is downloaded in .csv format.

Using the Advanced Filter

Below the Source drop-down menu, you can click Advanced Filter to reveal options for fil­tering the data in the Tables to Import preview area. The Advanced Filter provides tools to view and browse a subset of the data within a staging table. By changing filter properties, you can change the view of the data shown within the preview window without changing the data in the staging area.

The preview area is specifically for previewing a small portion of the data in the staging area. You can explore the data that is available from the spreadsheet and verify that you are getting the data you expect by examining the staging area. (Filters set in the preview function do not affect the actual data in the staging area.) The Advanced Filter lets you experiment with the data in the preview to set up a data import filter.

The options for the Advanced Filter are:

  • Distinct Rows: Check this box to hide duplicate rows.
  • Max Rows: Limit the number of rows displayed in the preview area by entering a number in the text box.
  • Columns: Check or uncheck columns in this drop-down menu to show or hide the columns displayed.

Removing a column from this list does not remove the column from the import list.

  • SQL Filter: Click the large text box to display the Edit SQL Expression dialog box, shown below.

Enter a SQL expression in the field. This is a filter to restrict the rows being previewed. Click Apply to automatically check the SQL syntax of the filter. (If there are any errors, the error is indicated in the expression.) For detailed SQL syntax help, you can click Online Help in the Notes section. The expression you entered appears in the Advanced Filter section of the preview window.

Click Remove Filter (next to the Source drop-down menu) to clear all advanced filter set­tings.

As part of the table customization process, you can also create join tables and custom columns using SQL expressions.

Clearing the Staging Area

Information remains in the staging area until you clear it.

To clear data from the staging area, do the following:

  1. Click Clear staging tables in the Actions menu.
    The staging area for all the tables in the data source is cleared.

  • Was this article helpful?