Insight Recommender System Based on Text Network Analysis

InfraNodus has a built-in tool that analyzes the connections between your ideas and recommends the next interesting idea that you could have. This can be very interesting for research, creative writing, and data analysis.

It analyzes the connections you've already made between your existing ideas and proposes you to think of the connections you haven't thought of before. Once you add the connections, it will propose you to think of the periphery or to explore the less developed topics. InfraNodus will also make use of OpenAI's GPT-3 natural language generator to ask you the research questions that would link those concepts together.

In this way InfraNodus follows an ecological model of discourse development, based on the assumption that it is important to both connect the existing ideas and to disrupt them in order to develop the discourse and make it diverse at the same time. Focusing on he specificies (zooming in) while also having an overview (zooming out).

You can use this tool in real time or with the texts that you've written before or imported from other sources (files, Evernote, Google, Twitter, newsfeeds, scientific literature etc).

See our Quick Tutorial on the Insight Recommender System:

How it Works? Technical Details

InfraNodus uses text network analysis to generate insight about any discourse or connected data. The basic appoach is to first identify the main clusters (based on the modularity and Louvain community detection algorithms) and the most influential nodes (based on the nodes' betweenness centrality). This will provide a good overview of a discourse or a data set, the main topical clusters contained within and the connections betwen them.

The next step is to identify the structural gaps between these clusters that could be bridged. These are shown both on the graph and in the analytics panel (Insight). InfraNodus will then propose you to make a connection between the two topical clusters that are not connected yet, bridging the gap to generate a new ideas.

These gaps are also referred to as the "structural holes" in the social sciences. The connections between them have a high potential for generating new ideas and innovation. As you are adding your ideas into the network graph, InfraNodus will recommend you the new connections and research questions that can help you develop your discourse and generate new innovative ideas based on this approach.

In addition to analyzing the graph, we use OpenAI's GPT-3 powerful natural language generator model. It will use the structural gap data to generate relevant research questions and ideas for you.

Generating Insight using InfraNodus and GPT-3:

This Video Explains the Technical Approach behind the Workflow in Detail:

Comparative Text Analysis: Finding Your Niche

Another interesting approach is to compare the two texts together in order to see how they differ: what is contained in one of them that is missing from the other.

Imagine you have a research topic you're interested in and you want to know better what aspect of the topic you should focus on.

Using our SEO app, you could visualize Google search results for the topic as one graph and related search queries as another. You will then see these two graphs superimposed, so you can quickly find what exists in the search queries (demand), which is not yet in the search results (supply).

This way you can quickly identify an attractive and not very competitive niche to focus your efforts on.

Alternatively, if you wanted to sync with the discourse (e.g. put something out there that will be hype and understood well, but maybe a bit less innovative), it would make more sense to focus on the most prominent topics, but making sure that you bring something unique to the discourse by focusing on the periphery, the missing parts, and the structural gaps.

How to find your research niche using the SEO app:

Suppose you are interested in a certain topic and want to find out more about it. You can use our SEO app for it.

Start from typing some keywords that relate to your topic of interest. Then InfraNodus SEO app will visualize two graphs superimposed on each other: the graph of the top Google search results for this query (the existing discourse) and the graph of the top search queries related to your keyword phrase (what people are actually looking for).

Using these graphs you can quickly see what other keywords and topics are related to your original keyword phrase and how they are connected. You can also find the gaps in the current discourse: using the Insight / Structual Gap feature or the Insight / Missing Keywords feature. Here's how it works in a few slides:

First, add the keyword query that you are interested to explore. It can be your research topic or a general keyword phrase you want to explore the context for. For example, "topic modeling".

Create a new SEO graph

You will see two graphs superimposed: one that contains the top search results for the query (the existing discourse), the other one that contains the related search queries (the required discourse). Using the Analytics panel you can see what are the main topics related to that search query.

Network graph topic modeling of the search results and queries

You can select the most relevant keywords and topics on the graph and save them into your keywords list.

Add the most relevant keywords for your SEO strategy

You can add more related search keywords using the "+queries" field or more search results for a specific query using the "+results" field.

Add more results into the graph

The most interesting feature is the Missing Keywords: select this option to see what people search for (demand) but do not find (supply). In this case we see that using neural networks for topic modeling is demanded by users but is not represented in search results. So that could be a good niche to explore.

Find the unoccupied niche for your target keywords SEO strategy.

Try It Yourself

You can try this approach yourself using InfraNodus for any text or graph data:

Sign Up


Custom Service: Insight Generation

Please, let us know if you have an interesting proposition, use case, research project, or service request.

Contact Us