Today is the day.
You are starting your next data integration project, the first one with Neos Data Integration Framework.
Your boss promises your life will change forever and you will sing on your way to work.
Your head is filled with questions like: What is Neos DI FMWK? How it will help my work?
Let us answer those.
Every ETL programmer eventually comes across a table named DW_659K765.Your experience as DWH/DI specialist helps you recognize it as a table holding customer data. One look and you knew what data is in which column and what is the source of this data.
That never happened to anyone.
And it is about to change.
Neos DI FMWK will give you basic definitions related to naming conventions, keys, and even standard columns required in each data store. Beside standards defined for logical modeling, framework also includes templates and guidelines for specific technology platforms (like database, Hadoop etc.).
If we add standards and guidelines for documentation management on top of that, you already saved a huge amount of time to your current and future colleagues.
And, even more importantly, to the future yourself.
When we already mentioned the future – you are sitting on your well-deserved break, drinking coffee with your colleague who is talking about an algorithm he developed and how he will reuse it in several of his programs. Suddenly, you start to feel deja-vu, and then you remember – several months ago you developed similar algorithm, and probably someone before you did the same but you didn’t know that. Just like your colleague didn’t know that you did it before him.
All that you now have is duplicated algorithm and waisted amount of time.
Now imagine that you take out this whole step of developing the algorithm and leave only the use part. Sounds tempting? Well, that’s exactly what you’ll get. All Industry specific data models, reusable algorithms, proven principles and modules based on hands-on experience will be available to you, you will only need to use them.
Have you already started calculating the saved time?
Easy to Maintain
Now that you developed all that code, fun part of your job ends and exhausting part of scheduling your mappings begins. You certainly don’t want to load data manually every day, but you also don’t want to waste your time on creating processes, scheduling it, thinking about all possible prerequisites, and, at the end, trace its execution through different tools or system tables.
And you will not have to.
Installation of Neos DI Framework for specific ETL/ELT tool (like Oracle Data Integrator, Informatica etc.) brings you ETL process templates and generic modules which will help you to create process with just two clicks.
Comes with a Library
A library of predefined elements and modules that significantly accelerate mapping and processes in the ELT segment of DW systems is a part of Neos DI Framework. These elements and modules ensure a connection between mapping and system framework (Pre-Map, Post-Map elements etc.).
With standardized components ensuring traceability, data load consistency, scheduling etc., and ETL developers can focus on pure transformation definition – not worrying about prerequisites, loading window, data consistency, positioning in whole loading process etc.
A single console for monitoring and administration of all your processes.
After reading all of this, you are probably thinking about what you will do with all your spare time at work. How much fun you’ll have?
But will you admit that your boss was right?