Data Migration with Smart Data Frameworks

Smart Data Frameworks is an off the shelf solution for enterprises looking to migrate between almost any database platform to almost any other database platform. It has been developed to allow faster, cheaper and better data integration with shorter time to value. By allowing developers and DBAs to focus on higher value business user needs, our framework takes the risk, cost and time out of “Lift and Shift” type upgrades.

Smart Data Frameworks will allow you to:

• Migrate an existing PureData for Analytics (PDA)/Netezza, Oracle, SQL Server, Teradata, Yellowbrick, MySQL, Greenplum, Snowflake, PostgreSQL, Google Big Table, or Db2 database to any of the above database types with just a few clicks,
• Keep a source and target system in sync by periodically detecting and migrating deltas between the two,
• Reconcile and validate that migrated data matches source data,
• Automatically, regularly, and reliably load sequences of flat file source data in the most performant way possible,
• Automatically generate custom extract, load, and transform (ELT) and data quality detection logic,
• Run SQL scripts against any ODBC-compliant database from any device via a web browser

Smart Data Frameworks (SDF) improves developer productivity, quality, and consistency, whilst simultaneously reducing development, testing, and maintenance timescales, costs, and risk.

• Integrated Release Management for migrating code and database objects between different environments
• Automatic email alerts when scheduled processes fail, for whatever reason
• Native Teradata function and feature (e.g. SET tables, case insensitive character comparisons) compatibility

Smart Data Frameworks consists of:

• A pre-configured virtual machine containing a number of pre-installed software components
• A dedicated metadata database repository for storing control and log information
• Customisable templates for performing data management tasks other than just loading e.g. referential integrity checking; database housekeeping; etc.
• A portable GUI front end (that runs on Windows, OSX, Linux, and HTML 5 web clients) for configuring Framework metadata parameters and monitoring the status of executed code
• A command line interface for the scripting/scheduling/execution of Framework data management processes

If you would like more information, check out our frequently asked questions or contact us here and we'll get in touch.