----Data Curation APIs-------------

Understanding and analyzing big data is firmly recognized as a powerful and strategic priority. For deeper interpretation of and better intelligence with big data, it is important to transform raw data (unstructured, semi-structured and structured data sources, e.g., text, video, image data sets) into curated data: contextualized data and knowledge that is maintained and made available for use by end-users and applications. In particular, data curation acts as the glue between raw data and analytics, providing an abstraction layer that relieves users from time consuming, tedious and error prone curation tasks. In this context, the data curation process becomes a vital analytics asset for increasing added value and insights.

We identify and implement a set of curation APIs and make them available (as an open source project on GitHub) to researchers and developers to assist them transforming their raw data into curated data. The curation APIs enable developers to easily add features - such as extracting keyword, part of speech, and named entities such as Persons, Locations, Organizations, Companies, Products, Diseases, Drugs, etc.; providing synonyms and stems for extracted information items leveraging lexical knowledge bases for the English language such as WordNet; linking extracted entities to external knowledge bases such as Google Knowledge Graph and Wikidata; discovering similarity among the extracted information items, such as calculating similarity between string, number, date and time data; classifying, sorting and categorizing data into various types, forms or any other distinct class; and indexing structured and unstructured data - into their applications.

Notice:

We encourage researchers/developers to cite our paper if you have used our APIs, libraries, tools or datasets.

• Beheshti, Tabebordbar, Benatallah, Nouri: "On Automating Basic Data Curation Tasks", WWW 2017, Perth Australia.
• Beheshti, Tabebordbar, Benatallah, Nouri: "Data Curation APIs", CoRR abs/1612.03277 (2016).

You can find the technical report and user guide from the following link: https://arxiv.org/abs/1612.03277

Curation Services Rest APIs: http://d2dcrc.cse.unsw.edu.au:9091/ExtractionAPI-0.0.1-SNAPSHOT/

----License-----------------------

License: This software is licensed under the Apache 2.0 license, quoted below.

Copyright 2016 UNSW.CSE.SOC Research Group [email protected]

You may not use these APIs except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

----Contributors-----------------------

Amin (SMR) Beheshti

Alireza Tabebordbar

Boualem Benatallah

Seyed Mohammad Reza Nouri

Service Oriented Computing (SOC) Research Group, School of Computer Sience and Engineering, The University of New South Wales, Sydney, Australia. This work is part of the Data Curation Foundry project stream, D2D CRC.