A database migration and ELT development platform. Migrate between virtually any database platform, build and manage reusable ELT logic, and keep source and target in continuous sync — delivered as a self-contained virtual appliance.
What is SDF?
Moving a database from one platform to another is one of the most risky, labour-intensive projects a data team can undertake. Done manually, it involves weeks of schema conversion, data type mapping, ELT rewriting, testing, and co-ordinated cutover — with every step dependent on specialist knowledge that most teams need to hire in.
Smart Data Frameworks automates the repeatable parts of this process. It ships as a flatpack virtual machine that you deploy in your own environment. It connects to your source and target databases via ODBC, provides a browser-based GUI for all migration and development tasks, and includes a CLI for scripted and scheduled operations.
SDF covers the full migration lifecycle: initial schema conversion, bulk data load, ongoing delta synchronisation, flat file loading, ELT code development, and controlled promotion of code between environments. It also supports Teradata SQL syntax compatibility, which simplifies workloads for teams migrating away from Teradata.
See It in Action
Six Components
Guides you through the end-to-end process of converting and migrating a database schema from one platform to another. Handles DDL conversion, data type mapping, and the orchestration of bulk data load — with reconciliation to verify source and target are in agreement on completion.
A full database browser and SQL query tool delivered entirely in the browser. Connect to any ODBC-accessible database, explore schemas, tables, and column definitions, and run SQL directly — without installing client software on each user’s machine.
Define the layout of structured flat files (delimited, fixed-width) and configure them to load continuously into target database tables. Handles the ongoing ingestion of file-based data sources as part of a broader migration or integration pipeline.
Manage and promote database objects, ELT code, and configuration between development, test, and production environments in a controlled, auditable way. Reduces the risk of inconsistent or untested changes reaching production and provides a clear record of what was deployed and when.
Automatically generate ELT logic and data quality detection code from a library of customisable templates. Rather than hand-coding transformations for each table, templates enforce consistency, reduce errors, and dramatically accelerate ELT development across large schemas.
Templates are fully parameterised — the same template can generate correct ELT code for hundreds of different tables, schemas, or target environments simply by varying the parameters. This keeps the template library small and maintainable whilst scaling to large, complex migrations.
Platform Support
SDF connects source and target databases via ODBC, which means it works with any platform that provides an ODBC driver. Supported platforms include:
SDF also supports Teradata SQL syntax compatibility, simplifying migration for teams moving Teradata workloads to a new platform.
Who Uses SDF
The Migration Wizard and Database Explorer give DBAs the tools to plan, execute, and validate database migrations at the schema and data level — with reconciliation built in so nothing gets missed.
The code template system and flat file loading wizard significantly reduce the manual ELT coding required during a migration. Templates enforce consistency across hundreds of tables and generate quality detection logic automatically.
Integrated Release Management gives teams a controlled, auditable mechanism for promoting database objects and ELT code through dev, test, and production — without ad-hoc scripts or manual co-ordination.
Download the Smart Data Frameworks product brochure covering migration capabilities, supported platforms, and the complete feature set.
Download PDFWatch an introductory walkthrough of the Smart Data Frameworks platform, including the Database Browser, ELT Builder, and Migration Wizard.
Watch VideoExplore guided tour videos for every SDF module: Database Browser, ELT Builder, ELT Monitor, Configuration Manager, Data Loader, and migration demos.
Browse VideosGet Started
Start with a free community licence, explore pricing options, or request a tailored enterprise quote.
Coming Soon
A completely new graphical SDF is in development – visual schema discovery, mapping and conversion, high-performance load and unload, log-based change data capture, and a full pipeline builder with scheduling and monitoring, across every supported platform. Join the waitlist to get early access and help decide which capabilities ship first.
Takes under a minute – just your name and email; everything else is optional. You will get an immediate confirmation, and we will notify you the moment the new SDF is available for your platform.
Your data is processed by Smart Associates Limited in accordance with our Privacy Policy and will never be shared with third parties.
Tell us about the platforms you are migrating between and we will show you how SDF handles the conversion, loading, and synchronisation.
Request a DemoFrequently Asked Questions
The Smart Data Framework (SDF) is a virtual appliance from Smart Associates that provides database development, migration, and operations tooling for enterprise data warehouses. It includes six components — Migration Wizard, DB Explorer, File Loader, Release Management, Code Templates, and Parameter Substitution — supporting over 12 database platforms.
SDF from Smart Associates supports over 12 database platforms, including IBM Netezza, PostgreSQL, Amazon Redshift, Google BigQuery, Snowflake, Microsoft Azure Synapse, Oracle, IBM Db2, Teradata, Greenplum/Cloudberry, Databricks, and SQL Server.
The SDF Migration Wizard is a guided migration tool within Smart Associates Smart Data Framework that automates schema migration, data transfer, and SQL dialect translation between database platforms. It handles schema mapping and data type conversion, significantly reducing the manual effort of a database migration project.
DB Explorer is the database discovery and documentation component of Smart Associates SDF. It connects to a source database and generates a catalogue of objects — tables, views, stored procedures, schemas — with metadata, lineage information, and dependency mapping. This is particularly useful at the start of migration or modernisation projects.
SDF’s File Loader is a data ingestion tool that loads structured files (CSV, delimited, fixed-width) into target database tables. It handles encoding, delimiter detection, error handling, and load auditing, providing a managed alternative to native bulk load utilities.
Smart Associates SDF Release Management provides version control and deployment pipeline capabilities for database code (DDL, DML, stored procedures). It tracks changes, manages environments (development, test, production), and automates controlled, auditable database releases.
Code Templates in Smart Associates SDF are pre-built, parameterised SQL patterns for common database operations — such as slowly changing dimensions, data quality checks, aggregation patterns, and incremental load logic. They accelerate development and enforce consistent coding standards across teams.
Parameter Substitution in Smart Associates SDF allows SQL code to be written once and executed across different environments by substituting environment-specific values (connection strings, schema names, table prefixes) at runtime. This eliminates the need to maintain separate SQL copies for development, test, and production.
Yes. Smart Associates SDF was developed with Netezza migration in mind. The Migration Wizard, DB Explorer, and Code Templates are all designed to accelerate the assessment, translation, and testing phases of moving from Netezza to a modern cloud or on-premises platform.
Smart Associates SDF is delivered as a virtual appliance — a pre-configured virtual machine image that can be deployed in any virtualisation environment (VMware, Hyper-V, or cloud VM). There is no complex installation; the appliance is imported and connected to the target database environment.
Yes. While SDF is frequently used for migration projects, its File Loader, Release Management, and Code Templates components are equally applicable to ongoing data operations — regular data ingestion, database code version control, and development standardisation in production environments.
Contact Smart Associates via smart-associates.biz/products/sdf/ to request a demonstration or discuss licensing. SDF is available as a standalone product and as part of Smart Associates’ data migration and modernisation service offerings.
