Data Connectors

Panopticon Designer (Desktop) can connect to a number of disparate source repositories, including files, databases, and message buses. Although the process of retrieving a data table is similar, each connector has a different user interface.

Data connectivity to third party products is based on general available versions.  Typically new versions are supported within one calendar year of release, although the timing of including the new version in support is dependent on customer demand.  New versions of popular data sources within our customer base are generally supported quickly after general availability.

Data is retrieved into the Panopticon Designer (Desktop) and converted into three data types:

• Number (Double)

• Text (Unicode)

• Timestamp (Nanosecond accuracy)

Date type conversion is specific to each data connector, and ODBC/JDBC driver for Database sources. However typical data type mappings are as follows:

• Boolean ->Text

• Integer -> Number

• Date -> Timestamp

• Date/Time -> Timestamp

• Time -> Timestamp

• GUID -> Text

 

Sources must support Unicode to be able to retrieve Unicode based text.

 

Here is the list of data sources you can use:

• Databases

• Apache ActiveMQ

• Kx kdb+

• Kx kbd+tick

• StreamBase CEP

• StreamBase LiveView

• Text (Including CSV)

• XML

• JSON

• OneTick

• OneTick CEP

• SAP Sybase EventStream Processor (ESP)

• Apache Cassandra

• Monarch Server - Content

• Rserve

• Python

• Cloudant

• MongoDB

• JMX

• Cloudera Impala

• Apache Hadoop Hive

• MySQL

• PostgreSQL

• SQL Server

• Sybase IQ

• Stream Simulator

• Oracle Database

• Amazon Redshift

• Salesforce

• IBM DB2

• Teradata

• WebSocket

• AMPS

• Greenplum

• Business Objects Universe

• Apache Kafka

• Kafka Publisher

• Vertica

• Google Analytics

• JDBC Database

• Google Analytics Streaming

• Livy Spark

• InfluxDB

• RabbitMQ

• Elasticsearch 5.x

• Elasticsearch 6.x

• XMLA

• XMLA On-Demand

• Solace

• Panopticon Streams

 

IMPORTANT:

For streaming connectors, there are two things that need to be considered:

• Real Time limit

This is the period how often the server in-memory table is updated.

• Refresh Period

This is the period how often a client (i.e., Web/WPF) receives data from the server.

 

NOTES:

• Starting version 13.3, the DataDirect connectors are going to use JDBC drivers instead of ODBC in the Panopticon Visualization Server.

• Starting 16.2, DataDirect based connectors are deprecated. The Database connector or JDBC Database connector should be used.

Existing workbooks will continue to operate for this 16.2 release, but connectivity will need to be migrated for subsequent releases.

1. • Amazon Redshift

   • Cloudera Impala

   • IBM DB2

   • Greenplum

   • Hadoop Hive

   • MySQL

   • Oracle

   • PostgreSQL

   • Spark SQL

   • SQL Server

   • Sybase IQ

   • Teradata

In addition, the ODBC-based connector Vertica is deprecated as well.

• Starting 17.1, MS Access, Valo, Apache Qpid, Valo Streaming, Ultra Messaging Streams, and OData connectors are deprecated.

 

Connecting to data connectors may require entering your login credentials. To avoid saving these information in your workbooks, it is recommended to parameterize these connection settings. Refer to Parameterization of Connection Settings for Data Connectors for more information.