-- scalable and easy-to-use data transformation
Longneck has been developed and maintained by the Data Warehousing and Business Intelligence Group of the Institute for Computer Science and Control, Hungarian Academy of Sciences (MTA SZTAKI).
Longneck has been successfully applied for data integration and ETL tasks including web log processing for web analytics, IT event log processing, data cleaning for customer master data management enabling efficient entity resolution or for processing web search engine events.
While solving various data integration and business intelligence research and industrial problems around 2005, we realised the lack of a scalable and easily configurable open source data quality and ETL tool. After trying the ones available and also some proprietary software, we decided to begin developing our own framework, that fits our needs.
We experimented with various types of ETL architectures and models before we got to Longneck; some of these earlier tools are still in use.
A lot of new tools arrived and older ones become cleverer since we began working on Longneck. However, we believe that our framework is still unique amongst ETL and data integration tools, with outstanding scalability and a flexible language.
We decided to make Longneck open source and freely available in 2013.