Get Complete Control on Destination Schema with Custom Schema Mapper

Hevo offers an automated schema mapper that eliminates the manual hassle of managing schema for your data team. However, there are use cases where your data team requires control over the destination schema. 

You want to load data to an existing table in your warehouse, or you could be following a data nomenclature or structure. Your team should be equipped to create or edit schemas at the destination from the pipeline tool to address such cases. They should have control over how to store data at the destination. 

Thus, Hevo comes with a Customized Schema Mapper where your data team has the power to create and edit the destination schema. 

Get complete power and control to manage Destination Schema

Hevo’s Customized Schema Mapper offers your data team complete control over destination schemas. It’s an easy-to-use interface to create or edit destination tables and schema.

Your team can create and map new destination tables on Hevo’s Custom Schema interface without having to switch between Hevo and the warehouse interface. 

This is even more advantageous if you have deployed multi-cloud infrastructure. Your team can manage schema for multiple destinations from a single interface using Hevo. 

Customize destination schema with minimal efforts

Though controlling and customizing schema is powerful, your team endures the hassle of manually creating and editing schema.

Leverage the combined benefits of Automated Schema Mapper and Custom Schema Mapper with Hevo’s Hybrid approach to Schema Management.

Hevo provides an exclusive hybrid schema management. Your data team possesses the flexibility to switch between Automapping and Custom Schema Mapping. They can enable automapping most of the time and make in-between custom schema changes wherever required. 

Once you make any custom schema change and then re-enable or set up auto-mapping, Hevo will manage further schema updates as per the new schema structure.  

Your team does not need to manually create and manage the complete schema to customize the destination schema. With the Hybrid approach, they can customize the schema with minimum effort.

Levels of Schema Customization you can perform on Hevo

Depending on your use case, you can apply various levels of schema customization with Hevo. The extent of customization varies at each level.

Edit the Schema created by Automapper

This is a basic level of customization. In this, you use Automapper to create the schema. Later, you can edit the schema created by Automapper. You can edit items like object names or field names. 

Custom Schema Mapper - Edit Field

It enables you to set up the destination schema as per your requirement effortlessly.  

Map Source Schema to an existing Object at Destination

You can map your source object to an existing data object at the destination. All you need to do is select the existing object from the schema interface. 

Custom Schema Mapper - Existing object

It enables your data team to set up data pipelines without changing your current data model or reconfiguring your current data applications to your warehouse. 

Create a new object at the destination

This is the highest level of customization. In this, your team can create a new object at the destination and map your source object to it. The new object is created from Hevo’s interface itself. 

Custom Schema Mapper - Adding Object

This is highly beneficial for use cases where you don’t want to use the source schema at the destination, especially for legacy data. And you want strict control over the destination schema

When it’s best to use Custom Schema Mapping on Hevo

There are multiple scenarios where Hevo’s Custom Schema Mapper is beneficial for your data team.

Loading data to an existing data model 

Your data applications, like the BI tool, could be configured with existing objects in your data warehouse. 

Creating new objects to accommodate your pipeline will become a hassle as you would need to rewrite your queries on the BI tool.

With Custom Schema Mapper, you can easily accommodate new data pipelines to existing data applications by loading data to existing objects. No need to migrate your data application or write new queries.  

Following an existing data nomenclature

Most of the data teams establish a data nomenclature for the organization. The data model of various SaaS applications will not always be as per that nomenclature. Like, the meaning of the term ‘Leads’ in your CRM could be ‘Opportunities’ as per your nomenclature. 

This confuses your data users as they do not understand the meaning of the data. They will have to visit the source data model to comprehend the data. 

Your team can easily edit the field names at the destination using Custom Schema Mapper to follow your data nomenclature. And your data users don’t need to keep visiting the source data. 

Assigning different keys at destination tables 

There are cases where your team wants to change the primary key or create a new primary key. To optimize the storage or analysis, they would like to specify the cluster key, sort key, or partition key on the data warehouse. 

For example, your eCommerce source has an object – orders, with order_id as the primary key. But, you want order_id and timestamp to be the cluster key of that object for tracking the status of a package every day.

Hevo’s Custom Schema Mapper provides your data team full access to change the primary key or set up the cluster key, partition key, and the sort key.

Fixing legacy data issues 

If you are an old organization, you would have gone through many transitions in your data structure with time and technology. There is still valuable data stored in legacy data structures or standards. 

Using Hevo’s Custom Schema Mapper, you can fix all those legacy data issues and move data to the warehouse as per your current data model. E.g., ‘Customer Mobile Number’ in your legacy data could be stored as ‘Alternate Contact Number’. This is fixed by moving data in the warehouse to a new field called ‘Mobile Number’.

Get Started 

Register for Hevo’s 14-day free trial and explore the power of Custom Schema Mapper and Hybrid Schema Management. Using Hevo, your data teams can set up reliable data pipelines in minutes. Start your free trial today. 


Source link

Tags: No tags

Add a Comment

Your email address will not be published. Required fields are marked *