Today, efforts in conventional Data warehouses and BI analytics are being complemented with the AI and Big Data analytics to yield competitive standing, in virtually every industry vertical. AI and Big Data are firmly positioned now as practical and invaluable techniques, to lead enterprises to decisions that are truly data driven. Now, on top of typical AI and ML approaches to automating decision making driven by data in the enterprise, the focus is on building applications to be powered by 'knowledge'.
And, businesses are building their 'Enterprise Knowledge Graphs' to remain competitive. Existing data stores in the enterprise such as relational databases, NoSQL data stores, etc. are typically the sources of the first knowledge in this build-out process, besides custom projects. But, most organizations are over looking 'text' documents as a source of knowledge. Text is inherently difficult to process, and most organizations stop at only building document search stores, document caregorizing applications or nominal information extraction applications, which still leaves out the most valuable content that is with in the text - Knowledge! Text is a valuable, ubiquitous source of knowledge in the enterprise.
Our advanced language processing platform – TextDistil consists of NLP pipelines that process unstructured data (raw text) to extract and assign structure and use neural language models to assign meaning to parts of sentences and paragraphs. TextDistil employs novel methods in deep learning and linguistic theory to extract candidate word tokens and phrases to generate high probability predicate matches to a target Ontology and create ‘Knowledge triples’ in RDF and load into a target Semantic Knowledge Graph.
TextDistil is a distibuted and parallel software system and scales routinely to high volumes (tens of thousands) of documents in typical production configurations and scale to higher volumes with compute cluster being the only constraint. TextDistil works with ALL W3C compliant RDF triple stores as target knowledge graph stores.
Knowledge Graphs promote new breed of enterprise applications such as Chatbots, etc. which in turn enable business decisions that are transparent, automatic and supported by data that is curated and whose lineage and context is well understood. We believe Knowledge Graphs are lasting and valuable outcomes of BI and AI pipelines in an enterprise.